2024-09-12T02:11:20.081 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:11:20.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:11:20.230 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901612' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO+3Bd3zgRrFiyuZXYIm/wNdg3kztSSdaPajQJMhl/L3iir+T3IhMMrg3kYEEkeH46XEaiCBBnZQ4Q75u9LZuw0= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFh8wf0HAXR2E7aR9WB7scDS+305bODmLRMaiNCr/5iT2qxSA+4shuNS0Cz7rPiBgXr5ePztaYMOJrsbMSMA/DI= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOVMTDaX5Ldt42/H4lEa88jVHYLvuP04OrHpwpunUNP76+cExxIPC5mneX5gZ0bSjVngWfawSfOYt8Dlmw+AUg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:11:20.230 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:11:20.231 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:11:20.231 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:11:20.233 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:11:20.256 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:11:20.256 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:11:20.256 INFO:teuthology.packaging:ref: None 2024-09-12T02:11:20.256 INFO:teuthology.packaging:tag: None 2024-09-12T02:11:20.256 INFO:teuthology.packaging:branch: squid 2024-09-12T02:11:20.256 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:11:20.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:11:20.478 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:11:20.479 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:11:20.485 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:11:20.485 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:11:20.535 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:11:20.554 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:11:20.559 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:11:20.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:06:19.375906', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO+3Bd3zgRrFiyuZXYIm/wNdg3kztSSdaPajQJMhl/L3iir+T3IhMMrg3kYEEkeH46XEaiCBBnZQ4Q75u9LZuw0='} 2024-09-12T02:11:20.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:06:19.377953', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFh8wf0HAXR2E7aR9WB7scDS+305bODmLRMaiNCr/5iT2qxSA+4shuNS0Cz7rPiBgXr5ePztaYMOJrsbMSMA/DI='} 2024-09-12T02:11:20.655 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:06:19.379700', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMOVMTDaX5Ldt42/H4lEa88jVHYLvuP04OrHpwpunUNP76+cExxIPC5mneX5gZ0bSjVngWfawSfOYt8Dlmw+AUg='} 2024-09-12T02:11:20.655 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:11:20.661 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T02:11:20.661 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T02:11:20.661 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T02:11:20.661 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:11:20.789 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f238bc4bbe0>, signals=[15]) 2024-09-12T02:11:20.789 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:11:20.795 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:11:20.795 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:11:20.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:11:20.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-12T02:11:20.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:11:20.964 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-12T02:11:20.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:11:21.049 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:11:21.055 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-12T02:11:21.073 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-12T02:11:21.073 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-12T02:11:21.131 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:11:21.132 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:11:21.133 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:11:21.133 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:11:21.133 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:11:21.133 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-12T02:11:21.165 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-12T02:11:21.182 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-12T02:11:21.183 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:11:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:11:21.241 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:11:21.241 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:11:21.241 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-12T02:11:21.273 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-12T02:11:21.292 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-12T02:11:21.292 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:11:21.351 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:11:21.352 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:11:21.352 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:11:21.352 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:11:21.352 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-12T02:11:21.381 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:11:21.391 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:11:21.426 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:11:21.427 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:11:21.430 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:11:21.432 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:11:21.451 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:11:21.457 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:11:21.457 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:11:21.488 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:11:21.490 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:11:21.608 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:11:21.711 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:11:21.727 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:11:21.727 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T02:11:21.727 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T02:11:21.727 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:11:21.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:11:21.745 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-12T02:11:21.804 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:11:21.804 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-503.el9.x86_64 2024-09-12T02:11:21.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-09-12T02:11:24.064 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T02:11:25.990 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-12T02:11:30.432 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T02:11:32.091 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-12T02:11:32.828 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-12T02:11:38.710 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T02:11:40.791 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:11:40.791 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:11:40.889 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:11:40.896 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 79 M 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 126 M 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-12T02:11:41.169 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 149 kB/s | 23 kB 00:00 2024-09-12T02:11:42.353 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-12T02:11:42.744 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-09-12T02:11:43.203 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-12T02:11:43.203 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:11:43.204 INFO:teuthology.orchestra.run.smithi001.stdout:Total 34 MB/s | 79 MB 00:02 2024-09-12T02:11:43.914 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-12T02:11:44.301 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-12T02:11:44.301 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-12T02:11:45.298 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-12T02:11:45.298 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-12T02:11:47.895 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-12T02:11:48.687 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:11:48.778 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:11:51.568 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:11:51.699 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:11:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:11:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:02.009 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:41.015 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:41.056 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:41.362 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:41.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:12:41.362 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:12:41.363 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:12:42.215 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-12T02:12:42.538 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:12:42.667 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.667 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:12:42.667 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:12:42.667 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:12:42.668 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:12:42.668 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T02:12:42.668 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:12:42.668 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:12:42.726 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:12:42.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:12:42.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-12T02:12:42.759 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-12T02:12:42.759 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-12T02:12:42.760 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:12:42.761 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:12:42.762 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:12:42.762 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:12:42.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:12:43.443 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-12T02:12:44.714 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:12:44.754 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-12T02:12:44.757 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-12T02:12:44.775 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.WZpUoL4T2L 2024-09-12T02:12:44.776 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WZpUoL4T2L 2024-09-12T02:12:44.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.WZpUoL4T2L 2024-09-12T02:12:44.982 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.WZpUoL4T2L is 6KB 2024-09-12T02:12:45.030 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.WZpUoL4T2L 2024-09-12T02:12:45.045 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:12:45.107 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:12:45.108 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:12:45.108 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:12:45.108 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:12:45.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:12:45.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-12T02:13:15.270 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:13:15.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:13:15.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:13:33.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-12T02:13:42.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:13:42.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:01.025 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-12T02:14:13.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:14:13.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:14.113 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-12T02:14:14.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:14:14.549 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:14:14.550 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-12T02:14:14.567 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:14:14.567 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:14:14.568 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:14:14.568 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:14:15.569 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:15.569 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:14:15.576 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:14:15.576 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:14:15.579 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:14:15.581 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:14:15.600 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:14:15.626 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:14:15.668 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:14:15.668 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:14:15.671 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:14:15.673 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:14:15.810 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:14:15.816 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:14:15.817 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:14:15.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:15.834 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:14:15.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:15.851 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:14:15.854 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:14:15.877 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:14:15.925 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:15.931 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:15.949 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:15.965 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:15.980 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:16.001 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:14:16.003 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:14:16.010 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:14:16.011 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:14:16.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:14:16.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:14:16.045 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:14:16.054 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:14:16.054 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:14:16.085 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:14:16.088 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:14:16.105 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.192 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.233 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.325 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.366 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:14:16.366 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:14:16.440 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.543 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.671 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:14:16.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:14:16.739 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.790 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:14:16.842 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.934 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:14:16.968 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:14:16.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:14:17.036 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-12T02:14:17.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-12T02:14:17.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-12T02:14:17.079 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:14:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:14:17.119 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:14:17.484 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:14:17.492 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:14:17.492 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:14:17.531 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:14:17.575 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:14:17.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-12T02:14:17.677 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-12T02:14:17.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-12T02:14:17.732 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-12T02:14:17.735 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-09-12T02:14:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-09-12T02:14:17.784 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:14:17.784 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-12T02:14:17.816 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-12T02:14:17.817 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-12T02:14:17.843 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-12T02:14:17.843 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-09-12T02:14:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-09-12T02:14:17.870 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:14:17.870 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:14:17.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:17.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:14:17.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:17.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:14:17.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:17.953 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:14:17.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:14:17.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:14:18.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:14:18.050 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:14:18.059 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:14:18.073 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:14:18.074 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:18:25.297 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-12T02:18:25.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:18:25.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:18:25.376 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-12T02:18:25.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-12T02:18:25.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-12T02:18:25.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:18:25.527 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-12T02:18:25.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-12T02:18:25.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-12T02:18:25.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:18:25.689 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-12T02:18:25.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-12T02:18:25.774 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:18:25.807 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:18:25.807 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:18:25.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:18:25.844 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:18:25.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:18:25.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:18:25.854 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:18:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:18:25.883 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:18:25.885 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:18:25.886 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:18:25.899 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:18:25.902 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:18:25.913 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-12T02:18:25.925 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-12T02:18:25.925 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-12T02:18:25.929 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-09-12T02:18:25.935 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-12T02:18:25.940 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-09-12T02:18:25.941 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:18:25.950 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:18:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:18:25.956 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:18:25.964 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:18:25.970 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:18:26.015 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.019 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.028 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:18:26.030 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:18:26.031 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:18:26.032 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-12T02:18:26.032 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.032 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.032 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.032 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.034 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:18:26.034 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-12T02:18:26.034 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.034 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.034 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.035 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:18:26.036 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:18:26.103 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:18:26.103 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:18:26.103 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:18:26.103 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:18:26.108 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:18:26.109 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:18:26.109 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:18:26.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:18:26.112 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:18:26.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:18:26.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:18:26.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:18:26.260 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:18:26.261 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:18:26.272 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:18:26.272 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:18:26.276 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:18:26.276 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:18:26.373 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:18:26.373 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:18:26.373 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:18:26.384 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:18:26.384 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:18:26.384 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:18:26.391 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:18:26.391 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:18:26.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:18:26.401 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:18:26.402 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:18:26.410 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:18:26.410 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:18:26.417 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:18:26.417 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:18:26.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:18:26.476 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:18:26.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:18:26.548 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:18:26.551 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:18:26.558 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:18:26.614 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-12T02:18:26.615 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-09-12T02:18:26.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-12T02:18:26.617 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-09-12T02:18:26.622 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-12T02:18:26.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-12T02:18:26.841 INFO:teuthology.orchestra.run.smithi173.stdout:45 files removed 2024-09-12T02:18:26.849 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-12T02:18:26.853 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-12T02:18:26.869 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:18:26.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:18:26.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:18:27.437 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-12T02:18:27.474 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 264 kB/s | 84 kB 00:00 2024-09-12T02:18:27.489 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 271 kB/s | 84 kB 00:00 2024-09-12T02:18:27.720 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T02:18:27.758 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:18:27.781 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T02:18:27.971 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-12T02:18:28.026 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T02:18:28.057 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:18:28.574 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T02:18:28.809 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T02:18:28.938 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-09-12T02:18:30.352 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-12T02:18:30.639 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-12T02:18:31.944 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-12T02:18:36.227 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T02:18:36.240 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-12T02:18:37.924 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-12T02:18:37.928 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-12T02:18:38.178 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.5 MB 00:03 2024-09-12T02:18:38.791 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T02:18:38.886 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T02:18:39.670 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-12T02:18:40.482 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T02:18:44.263 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:18:44.376 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-12T02:18:46.108 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-12T02:18:46.582 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.583 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.594 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:18:46.595 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.596 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:18:46.597 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.599 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:18:46.601 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.602 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.638 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.639 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.653 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:18:46.653 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:18:46.654 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:18:46.655 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.657 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:18:46.660 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.661 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:18:46.666 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-12T02:18:46.686 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-12T02:18:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-12T02:18:46.686 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:18:46.687 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:18:46.688 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:18:46.689 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:18:46.690 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:18:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:18:46.692 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:18:46.693 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:18:46.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:18:46.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:18:46.696 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:18:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:18:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 226 M 2024-09-12T02:18:46.699 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-12T02:18:46.723 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:18:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:18:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:18:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:18:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:18:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:18:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:18:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:18:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:18:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:18:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:18:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:18:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout:Install 148 Packages 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 8 Packages 2024-09-12T02:18:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:18:46.747 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 226 M 2024-09-12T02:18:46.747 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-12T02:18:46.994 INFO:teuthology.orchestra.run.smithi173.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-12T02:18:47.186 INFO:teuthology.orchestra.run.smithi173.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-12T02:18:47.300 INFO:teuthology.orchestra.run.smithi173.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.2 MB/s | 145 kB 00:00 2024-09-12T02:18:47.378 INFO:teuthology.orchestra.run.smithi173.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T02:18:47.479 INFO:teuthology.orchestra.run.smithi173.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-12T02:18:47.529 INFO:teuthology.orchestra.run.smithi173.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-12T02:18:47.738 INFO:teuthology.orchestra.run.smithi173.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-12T02:18:48.039 INFO:teuthology.orchestra.run.smithi134.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 13 kB/s | 6.5 kB 00:00 2024-09-12T02:18:48.046 INFO:teuthology.orchestra.run.smithi173.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T02:18:48.088 INFO:teuthology.orchestra.run.smithi173.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 608 kB/s | 25 kB 00:00 2024-09-12T02:18:48.480 INFO:teuthology.orchestra.run.smithi173.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 18 MB/s | 17 MB 00:00 2024-09-12T02:18:48.513 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:48.513 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:18:48.524 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:18:48.525 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:18:48.526 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:18:48.527 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:18:48.529 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:18:48.530 INFO:teuthology.orchestra.run.smithi173.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:18:48.532 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:18:48.533 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:18:48.600 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-12T02:18:48.614 INFO:teuthology.orchestra.run.smithi173.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 325 kB/s | 27 kB 00:00 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:18:48.620 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:18:48.621 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:18:48.622 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:18:48.623 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:18:48.624 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:18:48.625 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:18:48.626 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:18:48.627 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:18:48.628 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:18:48.629 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:18:48.630 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:18:48.631 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:18:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:18:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:18:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:18:48.633 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:18:48.634 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-09-12T02:18:48.635 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-12T02:18:48.636 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:18:48.636 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 226 M 2024-09-12T02:18:48.636 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-12T02:18:48.673 INFO:teuthology.orchestra.run.smithi134.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 897 kB 00:00 2024-09-12T02:18:48.689 INFO:teuthology.orchestra.run.smithi173.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 422 kB/s | 32 kB 00:00 2024-09-12T02:18:48.798 INFO:teuthology.orchestra.run.smithi173.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 6.8 MB/s | 752 kB 00:00 2024-09-12T02:18:48.873 INFO:teuthology.orchestra.run.smithi173.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T02:18:48.881 INFO:teuthology.orchestra.run.smithi134.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 697 kB/s | 145 kB 00:00 2024-09-12T02:18:48.940 INFO:teuthology.orchestra.run.smithi173.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T02:18:49.057 INFO:teuthology.orchestra.run.smithi173.stdout:(17/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.0 MB/s | 11 MB 00:01 2024-09-12T02:18:49.090 INFO:teuthology.orchestra.run.smithi173.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 3.3 MB/s | 506 kB 00:00 2024-09-12T02:18:49.141 INFO:teuthology.orchestra.run.smithi173.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 901 kB/s | 45 kB 00:00 2024-09-12T02:18:49.157 INFO:teuthology.orchestra.run.smithi134.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 5.4 MB 00:01 2024-09-12T02:18:49.224 INFO:teuthology.orchestra.run.smithi173.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T02:18:49.308 INFO:teuthology.orchestra.run.smithi173.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-12T02:18:49.408 INFO:teuthology.orchestra.run.smithi173.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-12T02:18:49.432 INFO:teuthology.orchestra.run.smithi134.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.5 MB/s | 1.5 MB 00:00 2024-09-12T02:18:49.501 INFO:teuthology.orchestra.run.smithi173.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.2 MB/s | 301 kB 00:00 2024-09-12T02:18:49.576 INFO:teuthology.orchestra.run.smithi173.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T02:18:49.598 INFO:teuthology.orchestra.run.smithi001.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-12T02:18:49.601 INFO:teuthology.orchestra.run.smithi173.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 993 kB/s | 100 kB 00:00 2024-09-12T02:18:49.627 INFO:teuthology.orchestra.run.smithi173.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:18:49.732 INFO:teuthology.orchestra.run.smithi134.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.8 MB/s | 2.4 MB 00:00 2024-09-12T02:18:49.827 INFO:teuthology.orchestra.run.smithi173.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 854 kB/s | 171 kB 00:00 2024-09-12T02:18:49.916 INFO:teuthology.orchestra.run.smithi134.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 9.7 MB/s | 4.7 MB 00:00 2024-09-12T02:18:50.023 INFO:teuthology.orchestra.run.smithi001.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.1 MB/s | 897 kB 00:00 2024-09-12T02:18:50.123 INFO:teuthology.orchestra.run.smithi001.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.4 MB/s | 145 kB 00:00 2024-09-12T02:18:50.253 INFO:teuthology.orchestra.run.smithi173.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 22 MB/s | 49 MB 00:02 2024-09-12T02:18:50.278 INFO:teuthology.orchestra.run.smithi173.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 71 kB/s | 32 kB 00:00 2024-09-12T02:18:50.336 INFO:teuthology.orchestra.run.smithi173.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.2 MB/s | 3.1 MB 00:00 2024-09-12T02:18:50.362 INFO:teuthology.orchestra.run.smithi173.stdout:(31/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.3 MB/s | 146 kB 00:00 2024-09-12T02:18:50.595 INFO:teuthology.orchestra.run.smithi173.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 11 MB/s | 3.6 MB 00:00 2024-09-12T02:18:50.649 INFO:teuthology.orchestra.run.smithi134.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 14 MB/s | 11 MB 00:00 2024-09-12T02:18:50.690 INFO:teuthology.orchestra.run.smithi001.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.2 MB/s | 2.4 MB 00:00 2024-09-12T02:18:50.866 INFO:teuthology.orchestra.run.smithi134.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 6.3 MB/s | 21 MB 00:03 2024-09-12T02:18:51.066 INFO:teuthology.orchestra.run.smithi134.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 60 kB/s | 25 kB 00:00 2024-09-12T02:18:51.104 INFO:teuthology.orchestra.run.smithi173.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 9.7 MB/s | 7.4 MB 00:00 2024-09-12T02:18:51.129 INFO:teuthology.orchestra.run.smithi173.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 92 kB/s | 49 kB 00:00 2024-09-12T02:18:51.133 INFO:teuthology.orchestra.run.smithi134.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-12T02:18:51.162 INFO:teuthology.orchestra.run.smithi173.stdout:(35/156): ceph-mgr-modules-core-19.1.1-298.gb53 311 kB/s | 249 kB 00:00 2024-09-12T02:18:51.188 INFO:teuthology.orchestra.run.smithi173.stdout:(36/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T02:18:51.200 INFO:teuthology.orchestra.run.smithi134.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-12T02:18:51.213 INFO:teuthology.orchestra.run.smithi173.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.3 MB/s | 285 kB 00:00 2024-09-12T02:18:51.255 INFO:teuthology.orchestra.run.smithi173.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T02:18:51.267 INFO:teuthology.orchestra.run.smithi134.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 477 kB/s | 32 kB 00:00 2024-09-12T02:18:51.297 INFO:teuthology.orchestra.run.smithi173.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-12T02:18:51.307 INFO:teuthology.orchestra.run.smithi001.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-09-12T02:18:51.364 INFO:teuthology.orchestra.run.smithi173.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-12T02:18:51.392 INFO:teuthology.orchestra.run.smithi134.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 752 kB 00:00 2024-09-12T02:18:51.464 INFO:teuthology.orchestra.run.smithi173.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-12T02:18:51.465 INFO:teuthology.orchestra.run.smithi001.stdout:(6/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-09-12T02:18:51.467 INFO:teuthology.orchestra.run.smithi134.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T02:18:51.498 INFO:teuthology.orchestra.run.smithi173.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-12T02:18:51.548 INFO:teuthology.orchestra.run.smithi173.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-12T02:18:51.560 INFO:teuthology.orchestra.run.smithi134.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.4 MB/s | 127 kB 00:00 2024-09-12T02:18:51.574 INFO:teuthology.orchestra.run.smithi173.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T02:18:51.599 INFO:teuthology.orchestra.run.smithi173.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T02:18:51.624 INFO:teuthology.orchestra.run.smithi173.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T02:18:51.661 INFO:teuthology.orchestra.run.smithi134.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.0 MB/s | 506 kB 00:00 2024-09-12T02:18:51.675 INFO:teuthology.orchestra.run.smithi173.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T02:18:51.775 INFO:teuthology.orchestra.run.smithi173.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-12T02:18:51.800 INFO:teuthology.orchestra.run.smithi173.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T02:18:51.859 INFO:teuthology.orchestra.run.smithi173.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-12T02:18:51.901 INFO:teuthology.orchestra.run.smithi173.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-12T02:18:51.926 INFO:teuthology.orchestra.run.smithi173.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-12T02:18:51.959 INFO:teuthology.orchestra.run.smithi173.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-12T02:18:51.985 INFO:teuthology.orchestra.run.smithi173.stdout:(54/156): boost-program-options-1.75.0-8.el9.x8 510 kB/s | 107 kB 00:00 2024-09-12T02:18:51.985 INFO:teuthology.orchestra.run.smithi134.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 7.5 MB/s | 17 MB 00:02 2024-09-12T02:18:52.052 INFO:teuthology.orchestra.run.smithi173.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-12T02:18:52.053 INFO:teuthology.orchestra.run.smithi134.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-12T02:18:52.069 INFO:teuthology.orchestra.run.smithi173.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-12T02:18:52.086 INFO:teuthology.orchestra.run.smithi173.stdout:(57/156): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-12T02:18:52.111 INFO:teuthology.orchestra.run.smithi173.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T02:18:52.136 INFO:teuthology.orchestra.run.smithi173.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-09-12T02:18:52.161 INFO:teuthology.orchestra.run.smithi134.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-12T02:18:52.174 INFO:teuthology.orchestra.run.smithi001.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 5.4 MB/s | 4.7 MB 00:00 2024-09-12T02:18:52.178 INFO:teuthology.orchestra.run.smithi173.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T02:18:52.186 INFO:teuthology.orchestra.run.smithi134.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 1.0 MB/s | 136 kB 00:00 2024-09-12T02:18:52.212 INFO:teuthology.orchestra.run.smithi173.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-12T02:18:52.224 INFO:teuthology.orchestra.run.smithi134.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T02:18:52.245 INFO:teuthology.orchestra.run.smithi173.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-12T02:18:52.261 INFO:teuthology.orchestra.run.smithi134.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-12T02:18:52.271 INFO:teuthology.orchestra.run.smithi173.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-09-12T02:18:52.296 INFO:teuthology.orchestra.run.smithi173.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T02:18:52.320 INFO:teuthology.orchestra.run.smithi134.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-12T02:18:52.329 INFO:teuthology.orchestra.run.smithi173.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-12T02:18:52.354 INFO:teuthology.orchestra.run.smithi173.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T02:18:52.361 INFO:teuthology.orchestra.run.smithi134.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 993 kB/s | 100 kB 00:00 2024-09-12T02:18:52.404 INFO:teuthology.orchestra.run.smithi134.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-12T02:18:52.438 INFO:teuthology.orchestra.run.smithi173.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T02:18:52.512 INFO:teuthology.orchestra.run.smithi134.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-12T02:18:52.579 INFO:teuthology.orchestra.run.smithi173.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T02:18:52.596 INFO:teuthology.orchestra.run.smithi134.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 382 kB/s | 32 kB 00:00 2024-09-12T02:18:52.622 INFO:teuthology.orchestra.run.smithi173.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-12T02:18:52.648 INFO:teuthology.orchestra.run.smithi173.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:18:52.688 INFO:teuthology.orchestra.run.smithi134.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.6 MB/s | 146 kB 00:00 2024-09-12T02:18:52.723 INFO:teuthology.orchestra.run.smithi173.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 12 MB/s | 4.9 MB 00:00 2024-09-12T02:18:52.757 INFO:teuthology.orchestra.run.smithi173.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-12T02:18:52.838 INFO:teuthology.orchestra.run.smithi134.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.5 MB/s | 3.1 MB 00:00 2024-09-12T02:18:52.848 INFO:teuthology.orchestra.run.smithi173.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-12T02:18:52.874 INFO:teuthology.orchestra.run.smithi173.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 581 kB/s | 87 kB 00:00 2024-09-12T02:18:52.907 INFO:teuthology.orchestra.run.smithi173.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:18:52.958 INFO:teuthology.orchestra.run.smithi173.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-12T02:18:53.033 INFO:teuthology.orchestra.run.smithi173.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-12T02:18:53.058 INFO:teuthology.orchestra.run.smithi173.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-12T02:18:53.092 INFO:teuthology.orchestra.run.smithi173.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-12T02:18:53.105 INFO:teuthology.orchestra.run.smithi134.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 8.5 MB/s | 3.6 MB 00:00 2024-09-12T02:18:53.117 INFO:teuthology.orchestra.run.smithi173.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-12T02:18:53.142 INFO:teuthology.orchestra.run.smithi173.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-12T02:18:53.168 INFO:teuthology.orchestra.run.smithi173.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-12T02:18:53.226 INFO:teuthology.orchestra.run.smithi173.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-12T02:18:53.260 INFO:teuthology.orchestra.run.smithi173.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T02:18:53.344 INFO:teuthology.orchestra.run.smithi173.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-12T02:18:53.358 INFO:teuthology.orchestra.run.smithi001.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 9.0 MB/s | 11 MB 00:01 2024-09-12T02:18:53.369 INFO:teuthology.orchestra.run.smithi173.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-12T02:18:53.394 INFO:teuthology.orchestra.run.smithi173.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 461 kB/s | 77 kB 00:00 2024-09-12T02:18:53.408 INFO:teuthology.orchestra.run.smithi001.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T02:18:53.419 INFO:teuthology.orchestra.run.smithi173.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-12T02:18:53.453 INFO:teuthology.orchestra.run.smithi173.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-12T02:18:53.478 INFO:teuthology.orchestra.run.smithi173.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-12T02:18:53.503 INFO:teuthology.orchestra.run.smithi173.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-12T02:18:53.513 INFO:teuthology.orchestra.run.smithi134.stdout:(32/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T02:18:53.529 INFO:teuthology.orchestra.run.smithi173.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-12T02:18:53.539 INFO:teuthology.orchestra.run.smithi134.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 575 kB/s | 249 kB 00:00 2024-09-12T02:18:53.564 INFO:teuthology.orchestra.run.smithi134.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 989 kB/s | 49 kB 00:00 2024-09-12T02:18:53.579 INFO:teuthology.orchestra.run.smithi173.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-12T02:18:53.596 INFO:teuthology.orchestra.run.smithi134.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 287 kB/s | 16 kB 00:00 2024-09-12T02:18:53.604 INFO:teuthology.orchestra.run.smithi173.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-12T02:18:53.608 INFO:teuthology.orchestra.run.smithi001.stdout:(10/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 21 MB 00:04 2024-09-12T02:18:53.622 INFO:teuthology.orchestra.run.smithi134.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.9 MB/s | 285 kB 00:00 2024-09-12T02:18:53.654 INFO:teuthology.orchestra.run.smithi173.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T02:18:53.672 INFO:teuthology.orchestra.run.smithi134.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-12T02:18:53.672 INFO:teuthology.orchestra.run.smithi173.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-12T02:18:53.697 INFO:teuthology.orchestra.run.smithi134.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 242 kB/s | 18 kB 00:00 2024-09-12T02:18:53.738 INFO:teuthology.orchestra.run.smithi173.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-12T02:18:53.755 INFO:teuthology.orchestra.run.smithi173.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-09-12T02:18:53.780 INFO:teuthology.orchestra.run.smithi173.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-12T02:18:53.783 INFO:teuthology.orchestra.run.smithi001.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 7.3 MB/s | 17 MB 00:02 2024-09-12T02:18:53.790 INFO:teuthology.orchestra.run.smithi134.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.8 MB/s | 7.4 MB 00:00 2024-09-12T02:18:53.809 INFO:teuthology.orchestra.run.smithi001.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.1 MB/s | 228 kB 00:00 2024-09-12T02:18:53.822 INFO:teuthology.orchestra.run.smithi173.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T02:18:53.834 INFO:teuthology.orchestra.run.smithi001.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 540 kB/s | 27 kB 00:00 2024-09-12T02:18:53.848 INFO:teuthology.orchestra.run.smithi173.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 946 kB/s | 64 kB 00:00 2024-09-12T02:18:53.859 INFO:teuthology.orchestra.run.smithi001.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T02:18:53.889 INFO:teuthology.orchestra.run.smithi134.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 368 kB/s | 80 kB 00:00 2024-09-12T02:18:53.909 INFO:teuthology.orchestra.run.smithi001.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-12T02:18:53.923 INFO:teuthology.orchestra.run.smithi173.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-09-12T02:18:53.943 INFO:teuthology.orchestra.run.smithi001.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 6.8 MB/s | 752 kB 00:00 2024-09-12T02:18:53.965 INFO:teuthology.orchestra.run.smithi134.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-12T02:18:53.968 INFO:teuthology.orchestra.run.smithi001.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T02:18:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-12T02:18:54.015 INFO:teuthology.orchestra.run.smithi134.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-12T02:18:54.047 INFO:teuthology.orchestra.run.smithi001.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.8 MB/s | 506 kB 00:00 2024-09-12T02:18:54.066 INFO:teuthology.orchestra.run.smithi134.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-12T02:18:54.086 INFO:teuthology.orchestra.run.smithi001.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.2 MB/s | 45 kB 00:00 2024-09-12T02:18:54.091 INFO:teuthology.orchestra.run.smithi134.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-12T02:18:54.116 INFO:teuthology.orchestra.run.smithi134.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-12T02:18:54.136 INFO:teuthology.orchestra.run.smithi001.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-12T02:18:54.141 INFO:teuthology.orchestra.run.smithi134.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T02:18:54.157 INFO:teuthology.orchestra.run.smithi173.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-12T02:18:54.182 INFO:teuthology.orchestra.run.smithi173.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-09-12T02:18:54.195 INFO:teuthology.orchestra.run.smithi001.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T02:18:54.199 INFO:teuthology.orchestra.run.smithi134.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-12T02:18:54.232 INFO:teuthology.orchestra.run.smithi173.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T02:18:54.253 INFO:teuthology.orchestra.run.smithi001.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T02:18:54.258 INFO:teuthology.orchestra.run.smithi173.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-12T02:18:54.292 INFO:teuthology.orchestra.run.smithi173.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-12T02:18:54.308 INFO:teuthology.orchestra.run.smithi134.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 988 kB/s | 107 kB 00:00 2024-09-12T02:18:54.312 INFO:teuthology.orchestra.run.smithi001.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 301 kB 00:00 2024-09-12T02:18:54.316 INFO:teuthology.orchestra.run.smithi173.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:18:54.333 INFO:teuthology.orchestra.run.smithi134.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-12T02:18:54.342 INFO:teuthology.orchestra.run.smithi173.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:18:54.350 INFO:teuthology.orchestra.run.smithi134.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-12T02:18:54.362 INFO:teuthology.orchestra.run.smithi001.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:18:54.367 INFO:teuthology.orchestra.run.smithi173.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:18:54.392 INFO:teuthology.orchestra.run.smithi173.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T02:18:54.393 INFO:teuthology.orchestra.run.smithi134.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-12T02:18:54.413 INFO:teuthology.orchestra.run.smithi001.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:18:54.443 INFO:teuthology.orchestra.run.smithi173.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T02:18:54.446 INFO:teuthology.orchestra.run.smithi134.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.7 MB/s | 313 kB 00:00 2024-09-12T02:18:54.468 INFO:teuthology.orchestra.run.smithi134.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-12T02:18:54.485 INFO:teuthology.orchestra.run.smithi173.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T02:18:54.485 INFO:teuthology.orchestra.run.smithi134.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 470 kB/s | 18 kB 00:00 2024-09-12T02:18:54.487 INFO:teuthology.orchestra.run.smithi001.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-12T02:18:54.510 INFO:teuthology.orchestra.run.smithi173.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:18:54.535 INFO:teuthology.orchestra.run.smithi134.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-12T02:18:54.538 INFO:teuthology.orchestra.run.smithi001.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-12T02:18:54.561 INFO:teuthology.orchestra.run.smithi134.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T02:18:54.577 INFO:teuthology.orchestra.run.smithi173.stdout:(115/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T02:18:54.586 INFO:teuthology.orchestra.run.smithi134.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-12T02:18:54.594 INFO:teuthology.orchestra.run.smithi173.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-09-12T02:18:54.596 INFO:teuthology.orchestra.run.smithi001.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 547 kB/s | 32 kB 00:00 2024-09-12T02:18:54.611 INFO:teuthology.orchestra.run.smithi173.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2024-09-12T02:18:54.644 INFO:teuthology.orchestra.run.smithi173.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:18:54.655 INFO:teuthology.orchestra.run.smithi001.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-12T02:18:54.661 INFO:teuthology.orchestra.run.smithi134.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-12T02:18:54.670 INFO:teuthology.orchestra.run.smithi173.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:18:54.686 INFO:teuthology.orchestra.run.smithi134.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-12T02:18:54.695 INFO:teuthology.orchestra.run.smithi173.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T02:18:54.720 INFO:teuthology.orchestra.run.smithi134.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-12T02:18:54.722 INFO:teuthology.orchestra.run.smithi001.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-12T02:18:54.729 INFO:teuthology.orchestra.run.smithi173.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T02:18:54.745 INFO:teuthology.orchestra.run.smithi134.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-12T02:18:54.762 INFO:teuthology.orchestra.run.smithi173.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T02:18:54.770 INFO:teuthology.orchestra.run.smithi134.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-12T02:18:54.787 INFO:teuthology.orchestra.run.smithi173.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-12T02:18:54.795 INFO:teuthology.orchestra.run.smithi134.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T02:18:54.813 INFO:teuthology.orchestra.run.smithi173.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-12T02:18:54.821 INFO:teuthology.orchestra.run.smithi134.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-12T02:18:54.838 INFO:teuthology.orchestra.run.smithi173.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-12T02:18:54.846 INFO:teuthology.orchestra.run.smithi134.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-12T02:18:54.863 INFO:teuthology.orchestra.run.smithi173.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T02:18:54.889 INFO:teuthology.orchestra.run.smithi173.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-12T02:18:54.939 INFO:teuthology.orchestra.run.smithi173.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T02:18:54.946 INFO:teuthology.orchestra.run.smithi134.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-12T02:18:54.964 INFO:teuthology.orchestra.run.smithi173.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:18:54.988 INFO:teuthology.orchestra.run.smithi134.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-12T02:18:55.005 INFO:teuthology.orchestra.run.smithi001.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-12T02:18:55.030 INFO:teuthology.orchestra.run.smithi134.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-12T02:18:55.055 INFO:teuthology.orchestra.run.smithi134.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:18:55.056 INFO:teuthology.orchestra.run.smithi001.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T02:18:55.115 INFO:teuthology.orchestra.run.smithi001.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 848 kB/s | 49 kB 00:00 2024-09-12T02:18:55.115 INFO:teuthology.orchestra.run.smithi173.stdout:(130/156): protobuf-compiler-3.14.0-13.el9.x86_ 725 kB/s | 863 kB 00:01 2024-09-12T02:18:55.130 INFO:teuthology.orchestra.run.smithi134.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T02:18:55.165 INFO:teuthology.orchestra.run.smithi001.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-12T02:18:55.198 INFO:teuthology.orchestra.run.smithi173.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 337 kB/s | 79 kB 00:00 2024-09-12T02:18:55.206 INFO:teuthology.orchestra.run.smithi134.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-12T02:18:55.231 INFO:teuthology.orchestra.run.smithi134.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-12T02:18:55.232 INFO:teuthology.orchestra.run.smithi173.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 494 kB/s | 58 kB 00:00 2024-09-12T02:18:55.257 INFO:teuthology.orchestra.run.smithi001.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-12T02:18:55.257 INFO:teuthology.orchestra.run.smithi173.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.7 MB/s | 272 kB 00:00 2024-09-12T02:18:55.282 INFO:teuthology.orchestra.run.smithi001.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.4 MB/s | 285 kB 00:00 2024-09-12T02:18:55.282 INFO:teuthology.orchestra.run.smithi173.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-12T02:18:55.290 INFO:teuthology.orchestra.run.smithi134.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:18:55.316 INFO:teuthology.orchestra.run.smithi173.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2024-09-12T02:18:55.333 INFO:teuthology.orchestra.run.smithi001.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-12T02:18:55.341 INFO:teuthology.orchestra.run.smithi173.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-12T02:18:55.358 INFO:teuthology.orchestra.run.smithi001.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 241 kB/s | 18 kB 00:00 2024-09-12T02:18:55.365 INFO:teuthology.orchestra.run.smithi134.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-12T02:18:55.366 INFO:teuthology.orchestra.run.smithi173.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 825 kB/s | 90 kB 00:00 2024-09-12T02:18:55.390 INFO:teuthology.orchestra.run.smithi134.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T02:18:55.391 INFO:teuthology.orchestra.run.smithi173.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-12T02:18:55.415 INFO:teuthology.orchestra.run.smithi134.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-12T02:18:55.417 INFO:teuthology.orchestra.run.smithi173.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T02:18:55.441 INFO:teuthology.orchestra.run.smithi134.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-12T02:18:55.442 INFO:teuthology.orchestra.run.smithi173.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T02:18:55.465 INFO:teuthology.orchestra.run.smithi134.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T02:18:55.467 INFO:teuthology.orchestra.run.smithi173.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T02:18:55.491 INFO:teuthology.orchestra.run.smithi134.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T02:18:55.493 INFO:teuthology.orchestra.run.smithi173.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T02:18:55.500 INFO:teuthology.orchestra.run.smithi001.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-12T02:18:55.516 INFO:teuthology.orchestra.run.smithi134.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-12T02:18:55.518 INFO:teuthology.orchestra.run.smithi173.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:18:55.543 INFO:teuthology.orchestra.run.smithi173.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T02:18:55.567 INFO:teuthology.orchestra.run.smithi134.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-12T02:18:55.568 INFO:teuthology.orchestra.run.smithi173.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T02:18:55.592 INFO:teuthology.orchestra.run.smithi001.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T02:18:55.594 INFO:teuthology.orchestra.run.smithi173.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:18:55.619 INFO:teuthology.orchestra.run.smithi173.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:18:55.633 INFO:teuthology.orchestra.run.smithi001.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-12T02:18:55.634 INFO:teuthology.orchestra.run.smithi134.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-12T02:18:55.659 INFO:teuthology.orchestra.run.smithi134.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T02:18:55.659 INFO:teuthology.orchestra.run.smithi001.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T02:18:55.669 INFO:teuthology.orchestra.run.smithi173.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:18:55.709 INFO:teuthology.orchestra.run.smithi001.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:18:55.717 INFO:teuthology.orchestra.run.smithi134.stdout:(85/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-09-12T02:18:55.734 INFO:teuthology.orchestra.run.smithi134.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-09-12T02:18:55.760 INFO:teuthology.orchestra.run.smithi134.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 420 kB/s | 42 kB 00:00 2024-09-12T02:18:55.760 INFO:teuthology.orchestra.run.smithi001.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-09-12T02:18:55.785 INFO:teuthology.orchestra.run.smithi134.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T02:18:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 269 kB 00:00 2024-09-12T02:18:55.818 INFO:teuthology.orchestra.run.smithi001.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T02:18:55.835 INFO:teuthology.orchestra.run.smithi134.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T02:18:55.861 INFO:teuthology.orchestra.run.smithi134.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T02:18:55.861 INFO:teuthology.orchestra.run.smithi173.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-12T02:18:55.868 INFO:teuthology.orchestra.run.smithi001.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T02:18:55.886 INFO:teuthology.orchestra.run.smithi134.stdout:(92/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-12T02:18:55.903 INFO:teuthology.orchestra.run.smithi134.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 992 kB/s | 42 kB 00:00 2024-09-12T02:18:55.920 INFO:teuthology.orchestra.run.smithi134.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-12T02:18:55.962 INFO:teuthology.orchestra.run.smithi134.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T02:18:55.979 INFO:teuthology.orchestra.run.smithi134.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-12T02:18:56.004 INFO:teuthology.orchestra.run.smithi134.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T02:18:56.028 INFO:teuthology.orchestra.run.smithi173.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-12T02:18:56.029 INFO:teuthology.orchestra.run.smithi134.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T02:18:56.054 INFO:teuthology.orchestra.run.smithi134.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:18:56.079 INFO:teuthology.orchestra.run.smithi134.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:18:56.105 INFO:teuthology.orchestra.run.smithi134.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:18:56.129 INFO:teuthology.orchestra.run.smithi173.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 408 kB/s | 41 kB 00:00 2024-09-12T02:18:56.130 INFO:teuthology.orchestra.run.smithi134.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-12T02:18:56.221 INFO:teuthology.orchestra.run.smithi173.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.3 MB/s | 2.3 MB 00:00 2024-09-12T02:18:56.271 INFO:teuthology.orchestra.run.smithi173.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-12T02:18:56.313 INFO:teuthology.orchestra.run.smithi173.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.0 MB/s | 1.8 MB 00:00 2024-09-12T02:18:56.319 INFO:teuthology.orchestra.run.smithi001.stdout:(47/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-12T02:18:56.361 INFO:teuthology.orchestra.run.smithi001.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-12T02:18:56.372 INFO:teuthology.orchestra.run.smithi134.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-12T02:18:56.394 INFO:teuthology.orchestra.run.smithi001.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-09-12T02:18:56.397 INFO:teuthology.orchestra.run.smithi134.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-12T02:18:56.420 INFO:teuthology.orchestra.run.smithi001.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T02:18:56.436 INFO:teuthology.orchestra.run.smithi001.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-12T02:18:56.448 INFO:teuthology.orchestra.run.smithi134.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-12T02:18:56.473 INFO:teuthology.orchestra.run.smithi134.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-12T02:18:56.478 INFO:teuthology.orchestra.run.smithi001.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-12T02:18:56.498 INFO:teuthology.orchestra.run.smithi134.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-09-12T02:18:56.503 INFO:teuthology.orchestra.run.smithi001.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-12T02:18:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 1.4 MB 00:00 2024-09-12T02:18:56.523 INFO:teuthology.orchestra.run.smithi134.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:18:56.549 INFO:teuthology.orchestra.run.smithi134.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:18:56.553 INFO:teuthology.orchestra.run.smithi001.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-12T02:18:56.574 INFO:teuthology.orchestra.run.smithi134.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:18:56.600 INFO:teuthology.orchestra.run.smithi134.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T02:18:56.604 INFO:teuthology.orchestra.run.smithi001.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-12T02:18:56.624 INFO:teuthology.orchestra.run.smithi134.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-12T02:18:56.629 INFO:teuthology.orchestra.run.smithi001.stdout:(56/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-12T02:18:56.646 INFO:teuthology.orchestra.run.smithi001.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-12T02:18:56.680 INFO:teuthology.orchestra.run.smithi001.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-12T02:18:56.683 INFO:teuthology.orchestra.run.smithi134.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-12T02:18:56.708 INFO:teuthology.orchestra.run.smithi134.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:18:56.733 INFO:teuthology.orchestra.run.smithi134.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:18:56.746 INFO:teuthology.orchestra.run.smithi173.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-09-12T02:18:56.747 INFO:teuthology.orchestra.run.smithi001.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T02:18:56.753 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:18:56.753 INFO:teuthology.orchestra.run.smithi173.stdout:Total 23 MB/s | 226 MB 00:10 2024-09-12T02:18:56.758 INFO:teuthology.orchestra.run.smithi134.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-12T02:18:56.784 INFO:teuthology.orchestra.run.smithi134.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-12T02:18:56.789 INFO:teuthology.orchestra.run.smithi001.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-12T02:18:56.809 INFO:teuthology.orchestra.run.smithi134.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:18:56.814 INFO:teuthology.orchestra.run.smithi001.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-12T02:18:56.851 INFO:teuthology.orchestra.run.smithi134.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T02:18:56.881 INFO:teuthology.orchestra.run.smithi001.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-09-12T02:18:56.885 INFO:teuthology.orchestra.run.smithi134.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-12T02:18:56.910 INFO:teuthology.orchestra.run.smithi134.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T02:18:56.977 INFO:teuthology.orchestra.run.smithi134.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-12T02:18:56.981 INFO:teuthology.orchestra.run.smithi001.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-12T02:18:57.002 INFO:teuthology.orchestra.run.smithi134.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-12T02:18:57.006 INFO:teuthology.orchestra.run.smithi001.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-12T02:18:57.028 INFO:teuthology.orchestra.run.smithi134.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:18:57.032 INFO:teuthology.orchestra.run.smithi001.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-12T02:18:57.053 INFO:teuthology.orchestra.run.smithi134.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T02:18:57.078 INFO:teuthology.orchestra.run.smithi134.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T02:18:57.103 INFO:teuthology.orchestra.run.smithi134.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T02:18:57.129 INFO:teuthology.orchestra.run.smithi134.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T02:18:57.132 INFO:teuthology.orchestra.run.smithi001.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-09-12T02:18:57.154 INFO:teuthology.orchestra.run.smithi134.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:18:57.187 INFO:teuthology.orchestra.run.smithi134.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T02:18:57.213 INFO:teuthology.orchestra.run.smithi134.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:18:57.216 INFO:teuthology.orchestra.run.smithi001.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T02:18:57.246 INFO:teuthology.orchestra.run.smithi134.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T02:18:57.273 INFO:teuthology.orchestra.run.smithi134.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T02:18:57.283 INFO:teuthology.orchestra.run.smithi001.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 13 MB/s | 910 kB 00:00 2024-09-12T02:18:57.297 INFO:teuthology.orchestra.run.smithi134.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T02:18:57.322 INFO:teuthology.orchestra.run.smithi134.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T02:18:57.339 INFO:teuthology.orchestra.run.smithi134.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 673 kB/s | 28 kB 00:00 2024-09-12T02:18:57.355 INFO:teuthology.orchestra.run.smithi001.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.9 MB/s | 137 kB 00:00 2024-09-12T02:18:57.356 INFO:teuthology.orchestra.run.smithi134.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 914 kB/s | 31 kB 00:00 2024-09-12T02:18:57.373 INFO:teuthology.orchestra.run.smithi134.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-12T02:18:57.398 INFO:teuthology.orchestra.run.smithi134.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-12T02:18:57.440 INFO:teuthology.orchestra.run.smithi134.stdout:(140/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-12T02:18:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-09-12T02:18:57.482 INFO:teuthology.orchestra.run.smithi134.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-12T02:18:57.516 INFO:teuthology.orchestra.run.smithi134.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-12T02:18:57.525 INFO:teuthology.orchestra.run.smithi001.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 34 MB/s | 5.8 MB 00:00 2024-09-12T02:18:57.541 INFO:teuthology.orchestra.run.smithi134.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T02:18:57.566 INFO:teuthology.orchestra.run.smithi134.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T02:18:57.592 INFO:teuthology.orchestra.run.smithi134.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:18:57.592 INFO:teuthology.orchestra.run.smithi001.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T02:18:57.617 INFO:teuthology.orchestra.run.smithi134.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T02:18:57.650 INFO:teuthology.orchestra.run.smithi001.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:18:57.659 INFO:teuthology.orchestra.run.smithi134.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T02:18:57.826 INFO:teuthology.orchestra.run.smithi001.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-12T02:18:57.859 INFO:teuthology.orchestra.run.smithi134.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-12T02:18:57.884 INFO:teuthology.orchestra.run.smithi001.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T02:18:57.909 INFO:teuthology.orchestra.run.smithi134.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.5 MB/s | 2.3 MB 00:00 2024-09-12T02:18:57.943 INFO:teuthology.orchestra.run.smithi001.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T02:18:57.984 INFO:teuthology.orchestra.run.smithi134.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-12T02:18:57.995 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-12T02:18:58.001 INFO:teuthology.orchestra.run.smithi001.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T02:18:58.010 INFO:teuthology.orchestra.run.smithi134.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 406 kB/s | 41 kB 00:00 2024-09-12T02:18:58.052 INFO:teuthology.orchestra.run.smithi001.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-09-12T02:18:58.077 INFO:teuthology.orchestra.run.smithi134.stdout:(153/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.9 MB/s | 3.2 MB 00:00 2024-09-12T02:18:58.102 INFO:teuthology.orchestra.run.smithi001.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T02:18:58.103 INFO:teuthology.orchestra.run.smithi134.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-12T02:18:58.136 INFO:teuthology.orchestra.run.smithi134.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-12T02:18:58.147 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-12T02:18:58.147 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-12T02:18:58.161 INFO:teuthology.orchestra.run.smithi001.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T02:18:58.211 INFO:teuthology.orchestra.run.smithi001.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-12T02:18:58.252 INFO:teuthology.orchestra.run.smithi134.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-12T02:18:58.257 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:18:58.257 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T02:18:58.378 INFO:teuthology.orchestra.run.smithi001.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-09-12T02:18:58.437 INFO:teuthology.orchestra.run.smithi001.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T02:18:58.487 INFO:teuthology.orchestra.run.smithi001.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T02:18:58.545 INFO:teuthology.orchestra.run.smithi001.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:18:58.604 INFO:teuthology.orchestra.run.smithi001.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-09-12T02:18:58.671 INFO:teuthology.orchestra.run.smithi001.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-09-12T02:18:58.746 INFO:teuthology.orchestra.run.smithi001.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T02:18:58.813 INFO:teuthology.orchestra.run.smithi001.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-12T02:18:58.864 INFO:teuthology.orchestra.run.smithi001.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T02:18:58.922 INFO:teuthology.orchestra.run.smithi001.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 921 kB/s | 54 kB 00:00 2024-09-12T02:18:59.364 INFO:teuthology.orchestra.run.smithi001.stdout:(91/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-12T02:18:59.431 INFO:teuthology.orchestra.run.smithi001.stdout:(92/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-12T02:18:59.464 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-12T02:18:59.464 INFO:teuthology.orchestra.run.smithi001.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-12T02:18:59.490 INFO:teuthology.orchestra.run.smithi001.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-12T02:18:59.557 INFO:teuthology.orchestra.run.smithi001.stdout:(95/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.9 MB/s | 4.9 MB 00:02 2024-09-12T02:18:59.582 INFO:teuthology.orchestra.run.smithi001.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-09-12T02:18:59.607 INFO:teuthology.orchestra.run.smithi001.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-12T02:18:59.615 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-12T02:18:59.615 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-12T02:18:59.633 INFO:teuthology.orchestra.run.smithi001.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-12T02:18:59.658 INFO:teuthology.orchestra.run.smithi001.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:18:59.709 INFO:teuthology.orchestra.run.smithi001.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:18:59.733 INFO:teuthology.orchestra.run.smithi001.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 951 kB/s | 96 kB 00:00 2024-09-12T02:18:59.759 INFO:teuthology.orchestra.run.smithi001.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T02:18:59.792 INFO:teuthology.orchestra.run.smithi001.stdout:(103/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-12T02:18:59.844 INFO:teuthology.orchestra.run.smithi001.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-12T02:18:59.876 INFO:teuthology.orchestra.run.smithi001.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T02:18:59.910 INFO:teuthology.orchestra.run.smithi001.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 626 kB/s | 19 kB 00:00 2024-09-12T02:18:59.943 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-12T02:18:59.943 INFO:teuthology.orchestra.run.smithi001.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-09-12T02:18:59.943 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-12T02:18:59.969 INFO:teuthology.orchestra.run.smithi001.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:18:59.994 INFO:teuthology.orchestra.run.smithi001.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:19:00.019 INFO:teuthology.orchestra.run.smithi001.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:19:00.044 INFO:teuthology.orchestra.run.smithi001.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-12T02:19:00.078 INFO:teuthology.orchestra.run.smithi001.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T02:19:00.120 INFO:teuthology.orchestra.run.smithi001.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-12T02:19:00.137 INFO:teuthology.orchestra.run.smithi001.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T02:19:00.154 INFO:teuthology.orchestra.run.smithi001.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T02:19:00.171 INFO:teuthology.orchestra.run.smithi001.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 856 kB/s | 14 kB 00:00 2024-09-12T02:19:00.196 INFO:teuthology.orchestra.run.smithi001.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-12T02:19:00.230 INFO:teuthology.orchestra.run.smithi001.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-12T02:19:00.256 INFO:teuthology.orchestra.run.smithi001.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:19:00.288 INFO:teuthology.orchestra.run.smithi001.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T02:19:00.314 INFO:teuthology.orchestra.run.smithi001.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T02:19:00.339 INFO:teuthology.orchestra.run.smithi001.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:19:00.364 INFO:teuthology.orchestra.run.smithi001.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-12T02:19:00.390 INFO:teuthology.orchestra.run.smithi001.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-12T02:19:00.415 INFO:teuthology.orchestra.run.smithi001.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-12T02:19:00.440 INFO:teuthology.orchestra.run.smithi001.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-12T02:19:00.465 INFO:teuthology.orchestra.run.smithi001.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-12T02:19:00.541 INFO:teuthology.orchestra.run.smithi001.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-12T02:19:00.566 INFO:teuthology.orchestra.run.smithi001.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:19:00.600 INFO:teuthology.orchestra.run.smithi001.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-12T02:19:00.625 INFO:teuthology.orchestra.run.smithi001.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-12T02:19:00.650 INFO:teuthology.orchestra.run.smithi001.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T02:19:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T02:19:00.701 INFO:teuthology.orchestra.run.smithi001.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T02:19:00.726 INFO:teuthology.orchestra.run.smithi001.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T02:19:00.751 INFO:teuthology.orchestra.run.smithi001.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-12T02:19:00.777 INFO:teuthology.orchestra.run.smithi001.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T02:19:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-12T02:19:00.844 INFO:teuthology.orchestra.run.smithi001.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-12T02:19:00.869 INFO:teuthology.orchestra.run.smithi001.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T02:19:00.894 INFO:teuthology.orchestra.run.smithi001.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-12T02:19:00.920 INFO:teuthology.orchestra.run.smithi001.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-12T02:19:00.945 INFO:teuthology.orchestra.run.smithi001.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:19:00.970 INFO:teuthology.orchestra.run.smithi001.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-12T02:19:00.995 INFO:teuthology.orchestra.run.smithi001.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T02:19:01.021 INFO:teuthology.orchestra.run.smithi001.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:19:01.046 INFO:teuthology.orchestra.run.smithi001.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:19:01.096 INFO:teuthology.orchestra.run.smithi001.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:19:01.305 INFO:teuthology.orchestra.run.smithi001.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:19:01.380 INFO:teuthology.orchestra.run.smithi001.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-12T02:19:01.419 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-12T02:19:01.420 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-12T02:19:01.455 INFO:teuthology.orchestra.run.smithi001.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 545 kB/s | 41 kB 00:00 2024-09-12T02:19:01.531 INFO:teuthology.orchestra.run.smithi001.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 8.0 MB/s | 1.8 MB 00:00 2024-09-12T02:19:01.589 INFO:teuthology.orchestra.run.smithi001.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-12T02:19:01.631 INFO:teuthology.orchestra.run.smithi001.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-12T02:19:01.740 INFO:teuthology.orchestra.run.smithi001.stdout:(155/156): NetworkManager-1.49.90-1.el9.x86_64. 3.6 MB/s | 2.3 MB 00:00 2024-09-12T02:19:02.590 INFO:teuthology.orchestra.run.smithi001.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-12T02:19:02.597 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:19:02.597 INFO:teuthology.orchestra.run.smithi001.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-12T02:19:03.882 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-12T02:19:04.052 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-12T02:19:04.052 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-12T02:19:06.314 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-12T02:19:06.367 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-12T02:19:06.367 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-12T02:19:06.434 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:19:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:19:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:19:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:19:06.593 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:19:06.636 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:19:06.957 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:19:07.061 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:07.183 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:07.212 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:07.285 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:07.316 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:19:07.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:19:07.529 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:19:07.558 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:07.645 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:07.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:07.754 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:07.761 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-12T02:19:07.776 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:07.800 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:07.873 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:19:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:19:07.981 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:19:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:19:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:19:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:19:08.204 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:08.345 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:08.405 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:19:08.491 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:19:08.516 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:08.603 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:08.630 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:08.667 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:08.668 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:08.759 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:08.788 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:19:08.891 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:08.944 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:19:08.993 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:19:09.004 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:19:09.021 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:09.098 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:19:09.108 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:09.130 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:09.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:19:09.177 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:09.177 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:19:09.198 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:09.251 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:19:09.295 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:19:09.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:19:09.380 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:19:09.408 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:09.411 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:19:09.439 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:19:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:19:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:09.569 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:19:09.600 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:19:09.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:19:09.679 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:19:09.711 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:19:09.746 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:19:09.779 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:09.790 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:19:09.819 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:19:09.847 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:09.888 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:19:09.933 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:19:10.015 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:19:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:10.157 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:19:10.179 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:19:10.210 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:19:10.274 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:19:10.319 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:19:10.363 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:19:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:19:10.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:19:10.545 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:19:10.588 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:19:10.624 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:19:10.652 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:19:10.720 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:19:10.731 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:19:10.773 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:19:10.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:19:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:19:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:19:10.848 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:19:10.878 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:19:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:19:10.926 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:19:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:19:10.966 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:19:11.002 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:19:11.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:19:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:19:11.132 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:19:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:19:11.186 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:19:11.228 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:19:11.241 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:19:11.313 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:19:11.346 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:19:11.368 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:19:11.381 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:19:11.422 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:19:11.436 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:19:11.473 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:19:11.532 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:19:11.575 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:19:11.710 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:19:11.760 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:19:11.801 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:19:11.911 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:19:11.943 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:19:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:19:12.056 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:19:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:19:12.136 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:19:12.143 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:19:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:19:12.183 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:19:12.208 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:19:12.233 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:19:12.309 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:19:12.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:19:12.405 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:19:12.433 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:19:12.460 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:19:12.473 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:19:12.501 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:19:12.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:19:12.536 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:19:12.572 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:19:12.575 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:19:12.607 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:19:12.608 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:19:12.645 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:19:12.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:19:12.688 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:19:12.707 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:19:12.723 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:19:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:19:12.773 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:19:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:19:12.824 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:19:12.911 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:19:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:19:12.963 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:19:12.967 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-12T02:19:12.969 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:19:12.994 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:19:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:19:13.069 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:19:13.106 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:19:13.112 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:19:13.118 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:19:13.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:19:13.161 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:19:13.179 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:19:13.192 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:19:13.218 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:19:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:19:13.245 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:19:13.271 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:19:13.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:19:13.327 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:19:13.444 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:19:13.671 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:19:13.684 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:19:13.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:19:13.796 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:19:13.845 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:19:13.880 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:19:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:19:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:19:13.922 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:13.925 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:19:13.947 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:19:13.959 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:19:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:19:14.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:19:14.041 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:14.057 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:19:14.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:19:14.069 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:19:14.114 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:19:14.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:19:14.159 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:19:14.197 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:19:14.236 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:19:14.246 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:19:14.254 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:19:14.278 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:19:14.299 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:19:14.326 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:14.339 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:19:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:19:14.416 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:14.444 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:14.463 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:19:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:19:14.499 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:19:14.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:14.548 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:19:14.570 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:19:14.741 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:14.926 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:19:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:19:15.096 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:19:15.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:19:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:15.192 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:19:15.219 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:19:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:15.290 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:19:15.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:19:15.350 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:19:15.391 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:19:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:19:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:19:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:19:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:19:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:19:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:19:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:19:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:19:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:19:15.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:19:15.844 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:19:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:19:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:19:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:19:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:19:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:19:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:19:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:19:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:19:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:19:16.355 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:19:16.387 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:19:16.431 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:19:16.439 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:19:16.459 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:19:16.533 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:19:16.564 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:19:16.574 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:19:16.582 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:19:16.661 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:19:16.663 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:19:16.691 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:19:16.724 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:19:16.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:19:16.861 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:19:17.034 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:19:17.087 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:17.178 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:17.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:19:17.253 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:19:17.424 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:19:17.516 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:19:17.551 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:19:17.594 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:19:17.632 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:19:17.674 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:19:17.733 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:19:17.774 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:17.777 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:19:17.835 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:19:17.845 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:17.853 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:19:17.875 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:19:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:19:17.902 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:19:17.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:19:17.958 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:19:18.032 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:19:18.069 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:19:18.105 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:19:18.153 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:19:18.187 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:19:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:19:18.232 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:19:18.274 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:19:18.277 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:18.351 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:18.390 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:19:18.417 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:19:18.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:19:18.608 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:19:18.650 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:19:18.758 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:19:18.791 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:19:18.831 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:19:18.904 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:19:18.930 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:18.959 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:19:18.984 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:19.115 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:19:19.207 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:19:19.334 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:19:19.468 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:19:19.497 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:19:19.525 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:19:19.564 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:19:19.607 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:19:19.650 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:19:19.679 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:19:19.714 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:19:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:19:19.790 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:19:19.823 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:19:19.914 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:19:19.963 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:19:19.993 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:19:20.102 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:19:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:20.171 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:19:20.205 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:20.751 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:20.886 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:20.887 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:19:20.887 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:19:20.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:20.918 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:20.939 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:19:20.991 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:19:21.025 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:19:21.128 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:19:21.189 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:19:21.234 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:19:21.325 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:19:21.361 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:19:21.407 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:21.560 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:19:21.591 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:19:21.672 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:19:21.991 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:22.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:22.131 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:22.132 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:19:22.132 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:19:22.132 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:22.166 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:22.366 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:19:22.486 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:19:23.822 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:19:23.912 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:19:23.940 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:19:23.973 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:19:24.301 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:19:24.344 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:24.444 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:19:24.482 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:19:24.519 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:19:25.027 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:19:25.063 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:25.135 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:19:25.165 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:19:27.617 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:27.661 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:28.244 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:19:28.290 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:28.381 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:19:28.381 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:19:28.381 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:19:28.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:28.416 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:32.479 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:32.479 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-09-12T02:19:32.479 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-09-12T02:19:32.479 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-09-12T02:19:32.479 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-09-12T02:19:32.480 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-09-12T02:19:32.480 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-09-12T02:19:32.480 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-09-12T02:19:32.480 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:32.655 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:32.673 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:32.673 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:32.673 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:19:32.673 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-12T02:19:33.799 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-12T02:19:33.800 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:33.967 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:33.984 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:33.984 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:19:33.984 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:34.174 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:34.201 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:34.202 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:34.202 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:19:34.202 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:34.202 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:34.202 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:34.425 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:34.449 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:34.884 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:35.016 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:19:35.071 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:19:35.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:19:35.321 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:19:35.368 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:19:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:19:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:35.496 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:35.496 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:19:35.496 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:35.497 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:19:35.675 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:19:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:35.726 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:19:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:35.743 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:35.744 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:19:35.744 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:35.744 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:35.758 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:19:35.794 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:19:36.179 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:36.202 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:36.202 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:36.203 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:19:36.203 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:36.203 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:36.203 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:36.254 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:36.285 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:36.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:19:36.316 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:19:36.358 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:19:36.379 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:19:36.408 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:36.421 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:19:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:19:36.655 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:19:36.733 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:19:36.830 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:19:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:19:37.022 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:19:37.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:19:37.081 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:19:37.452 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:37.464 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:37.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:37.518 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:37.536 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:19:37.598 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:19:37.627 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:38.482 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:38.510 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:38.613 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:38.665 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:38.696 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:38.773 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:19:38.803 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:38.879 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:38.891 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:38.995 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:19:39.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:19:39.658 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:39.696 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:39.797 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:39.961 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:19:39.968 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:19:39.990 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:40.007 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:40.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:40.030 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:40.031 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:19:40.031 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:40.031 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:40.082 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:40.106 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:40.106 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:40.106 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:19:40.107 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:40.158 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:40.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:19:40.182 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:40.182 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:40.182 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:19:40.183 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:40.183 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:40.183 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:40.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:19:40.492 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:40.517 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-12T02:19:40.815 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-12T02:19:40.816 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-12T02:19:40.816 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:40.988 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:41.006 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:19:41.006 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:41.006 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:19:41.006 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:19:41.185 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:41.208 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:41.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:41.274 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:41.275 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:41.275 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:19:41.275 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:41.319 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:41.342 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:41.653 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:41.676 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:19:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:41.677 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:42.541 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:19:42.570 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:42.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:42.834 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:19:42.834 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:42.834 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:19:42.834 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:42.834 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:19:42.835 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:43.292 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:19:43.318 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:43.431 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:19:43.489 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:19:43.554 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:19:43.750 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:19:43.810 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:19:43.892 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:19:43.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:19:44.133 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:19:44.186 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:19:44.217 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:19:44.244 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:19:44.696 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:44.726 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:19:44.766 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:19:44.831 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:19:44.857 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:45.079 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:19:45.120 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:19:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:19:45.193 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:19:45.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:19:45.402 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:19:45.442 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:19:45.481 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:19:45.518 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:19:45.565 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:19:45.966 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:19:46.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:46.187 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:46.215 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:19:46.229 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:46.250 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:46.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:19:46.296 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:19:46.329 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:19:46.356 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:19:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:19:46.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:19:46.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:19:46.646 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:19:46.700 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:19:47.023 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:19:47.051 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:47.093 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:19:47.162 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:19:47.184 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:19:47.225 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:19:47.297 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:47.308 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:19:47.338 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:19:47.339 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:47.345 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:19:47.360 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:47.371 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:19:47.378 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:47.397 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:19:47.397 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:19:47.404 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:47.462 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:47.475 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:19:47.489 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:47.489 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:47.573 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:47.576 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:19:47.598 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:19:47.604 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:47.604 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:47.640 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:19:47.791 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:47.792 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:47.876 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:47.939 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:19:48.285 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:19:48.326 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:19:48.407 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:19:48.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:19:48.472 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:19:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:19:48.498 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:48.590 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:48.590 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:48.632 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:19:48.665 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:48.674 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:48.690 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:19:48.691 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:48.691 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:19:48.691 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:48.691 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:19:48.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:48.703 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:19:48.708 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:48.708 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:48.732 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:19:48.757 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:48.757 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:19:48.757 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:48.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:48.833 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:19:48.833 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:48.833 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:19:48.833 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:48.834 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:19:48.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:48.884 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:48.960 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:49.023 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:49.167 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:49.192 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:19:49.193 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:19:49.193 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:19:49.193 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:49.193 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:19:49.193 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:19:53.777 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:19:53.778 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:19:53.779 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:19:53.780 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:19:53.781 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:19:53.782 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:19:53.783 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:19:53.784 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:19:53.785 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:19:53.786 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:19:53.787 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:19:53.788 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:19:53.789 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:19:54.046 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:19:54.088 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:19:54.129 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:19:54.160 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:19:54.187 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:19:54.398 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:19:54.444 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:19:54.472 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:19:54.503 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:19:54.540 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:19:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:19:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:19:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:19:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:19:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:19:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:19:54.640 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:19:54.641 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:19:54.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:19:54.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:19:54.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:19:54.645 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:19:54.646 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:19:54.647 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:19:54.647 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:19:54.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:19:54.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:19:54.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:19:54.651 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:19:55.095 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:55.138 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:55.159 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:19:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:19:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:19:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:19:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:19:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:56.329 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:19:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:19:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:19:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:19:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:19:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:19:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:19:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:19:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:19:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:19:56.342 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-12T02:19:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:19:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:19:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:19:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:19:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:19:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:19:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:56.740 DEBUG:teuthology.parallel:result is None 2024-09-12T02:19:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:19:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:56.934 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:19:57.010 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:57.053 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:57.054 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.056 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:19:57.057 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:19:57.058 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:19:57.060 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:19:57.061 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:19:57.062 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:19:57.063 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:19:57.064 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:19:57.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:19:57.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:19:57.067 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:19:57.068 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:19:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:19:57.069 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:19:57.069 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-12T02:19:57.493 DEBUG:teuthology.parallel:result is None 2024-09-12T02:20:02.655 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:20:02.655 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:20:02.655 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:20:02.655 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:20:02.656 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:20:02.657 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:20:02.658 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:20:02.659 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:20:02.660 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:20:02.661 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:20:02.662 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:20:02.663 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:20:02.664 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:20:02.665 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:20:02.666 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:20:02.667 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:20:02.668 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:20:05.474 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.475 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.476 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:20:05.477 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:20:05.478 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:20:05.479 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:20:05.480 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.481 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:20:05.482 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:20:05.483 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:20:05.484 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:20:05.485 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:20:05.486 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:20:05.487 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:20:05.488 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:20:05.488 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:20:05.488 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-12T02:20:05.910 DEBUG:teuthology.parallel:result is None 2024-09-12T02:20:05.911 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:06.065 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:20:06.089 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.090 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.090 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:20:06.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:06.240 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:20:06.267 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.268 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.268 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:20:06.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:06.416 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:20:06.444 INFO:teuthology.orchestra.run.smithi173.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.444 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:20:06.444 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:20:06.446 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:20:06.447 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:20:06.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:20:06.480 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:20:06.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:20:06.514 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:20:06.514 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:20:06.548 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:20:06.548 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:20:06.548 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:20:06.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:20:06.648 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:20:06.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:20:06.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:20:06.749 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:20:06.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:20:06.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:20:06.848 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:20:06.849 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:20:06.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:20:06.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:20:06.948 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:20:06.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:20:06.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:20:07.045 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:20:07.045 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:20:07.075 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:20:07.144 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:20:07.145 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:20:07.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:20:07.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:20:07.245 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:20:07.245 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:20:07.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:20:07.345 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:20:07.345 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:20:07.376 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:20:07.445 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T02:20:07.576 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T02:20:07.577 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:07.577 INFO:tasks.cephadm:Cluster fsid is 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:20:07.577 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T02:20:07.577 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.134', 'mon.c': '172.21.15.173'} 2024-09-12T02:20:07.578 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-12T02:20:07.578 INFO:tasks.cephadm:First mgr is x 2024-09-12T02:20:07.578 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T02:20:07.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-12T02:20:07.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-09-12T02:20:07.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-09-12T02:20:07.671 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T02:20:07.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:07.817 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T02:20:07.964 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:20:07.965 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:20:07.966 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:20:07.966 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:08.398 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:20 /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:08.399 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:08.804 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:20 /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:08.804 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:09.198 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:20 /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:09.198 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:09.218 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:09.238 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:20:09.274 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T02:20:09.274 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:20:09.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:20:09.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:20:10.922 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:20:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:20:11.075 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:20:39.497 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-12T02:20:39.498 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:20:41.569 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-12T02:20:41.570 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T02:20:41.594 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-12T02:20:41.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-09-12T02:20:41.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-09-12T02:20:41.692 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-12T02:20:41.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-09-12T02:20:41.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-09-12T02:20:41.778 INFO:tasks.cephadm:Writing seed config... 2024-09-12T02:20:41.779 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T02:20:41.779 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T02:20:41.780 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T02:20:41.781 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:20:41.782 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T02:20:41.783 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T02:20:41.784 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:20:41.784 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T02:20:41.803 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 877143dc-70ad-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T02:20:41.804 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T02:20:41.847 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T02:20:41.890 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T02:20:41.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:20:42.109 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '877143dc-70ad-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-12T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T02:20:42.110 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-12T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-12T02:20:42.134 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-12T02:20:42.141 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:20:42.142 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:20:42.148 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:20:42.148 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:20:42.155 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-12T02:20:42.161 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-12T02:20:42.161 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:20:42.162 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-12T02:20:42.194 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:20:42.194 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T02:20:42.194 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-12T02:20:42.195 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-12T02:20:42.202 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:20:42.203 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:20:42.208 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:20:42.208 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:20:42.214 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-12T02:20:42.221 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-12T02:20:42.221 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 140254547538944 on /run/cephadm/877143dc-70ad-11ef-bcea-c7b262605968.lock 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 140254547538944 acquired on /run/cephadm/877143dc-70ad-11ef-bcea-c7b262605968.lock 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-12T02:20:42.222 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-12T02:20:42.226 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-12T02:20:42.226 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-12T02:20:42.229 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T02:20:42.229 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T02:20:42.229 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-12T02:20:42.231 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:20:42.232 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-12T02:20:42.232 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-12T02:20:42.232 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T02:20:42.232 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T02:20:42.233 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:20:45.754 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T02:20:46.665 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:20:46.665 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:20:46.665 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T02:20:47.563 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-12T02:20:47.563 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-12T02:20:50.023 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQD/T+Jm2Rx7NBAAXlPkL9ezd5FL7OyA7Bk++A== 2024-09-12T02:20:59.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQAEUOJmQMB8OxAAewC2YYuPS973pN8iGFeScw== 2024-09-12T02:21:02.004 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQANUOJmwSZtGBAAlJwpnT6PM2scMjmZKGYNFA== 2024-09-12T02:21:02.005 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-12T02:21:02.903 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:21:02.903 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:21:02.904 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-12T02:21:03.893 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-12T02:21:04.123 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T02:21:04.305 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T02:21:04.511 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target. 2024-09-12T02:21:04.511 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target. 2024-09-12T02:21:04.781 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:21:04.781 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T02:21:04.956 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target.wants/ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968@.service. 2024-09-12T02:21:05.493 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:21:05.493 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-12T02:21:05.500 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:21:05.500 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:21:05.500 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-12T02:21:05.500 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:21:05.501 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-12T02:21:05.501 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-12T02:21:05.589 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:05 smithi001 systemd[1]: Started Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:21:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:21:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: monmap epoch 1 2024-09-12T02:21:06.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: last_changed 2024-09-12T02:21:02.319189+0000 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: min_mon_release 19 (squid) 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: election_strategy: 1 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: fsmap 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: mgrmap e1: no daemons active 2024-09-12T02:21:06.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:06 smithi001 ceph-mon[30889]: from='client.? 172.21.15.1:0/3594615386' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T02:21:07.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.522638s) 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T02:21:07.382 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.901+0000 7f2b39b5e640 1 Processor -- start 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.901+0000 7f2b39b5e640 1 -- start start 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.901+0000 7f2b39b5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.901+0000 7f2b39b5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3407c7d0 con 0x7f2b3407dde0 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.902+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.902+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47684/0 (socket says 172.21.15.1:47684) 2024-09-12T02:21:07.383 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.902+0000 7f2b337fe640 1 -- 172.21.15.1:0/1890029749 learned_addr learned my addr 172.21.15.1:0/1890029749 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.902+0000 7f2b337fe640 1 -- 172.21.15.1:0/1890029749 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3407c950 con 0x7f2b3407dde0 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.904+0000 7f2b337fe640 1 --2- 172.21.15.1:0/1890029749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009820 tx=0x7f2b2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d5bd2099940bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.904+0000 7f2b327fc640 1 -- 172.21.15.1:0/1890029749 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24037070 con 0x7f2b3407dde0 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.904+0000 7f2b327fc640 1 -- 172.21.15.1:0/1890029749 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b24032440 con 0x7f2b3407dde0 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.904+0000 7f2b327fc640 1 -- 172.21.15.1:0/1890029749 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24032740 con 0x7f2b3407dde0 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 -- 172.21.15.1:0/1890029749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 msgr2=0x7f2b3407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 --2- 172.21.15.1:0/1890029749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009820 tx=0x7f2b2402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 -- 172.21.15.1:0/1890029749 shutdown_connections 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 --2- 172.21.15.1:0/1890029749 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3407c290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 -- 172.21.15.1:0/1890029749 >> 172.21.15.1:0/1890029749 conn(0x7f2b34102dc0 msgr2=0x7f2b341051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 -- 172.21.15.1:0/1890029749 shutdown_connections 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 -- 172.21.15.1:0/1890029749 wait complete. 2024-09-12T02:21:07.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.905+0000 7f2b39b5e640 1 Processor -- start 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b39b5e640 1 -- start start 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b39b5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b39b5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3407cef0 con 0x7f2b3407dde0 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47690/0 (socket says 172.21.15.1:47690) 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b337fe640 1 -- 172.21.15.1:0/3594615386 learned_addr learned my addr 172.21.15.1:0/3594615386 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b337fe640 1 -- 172.21.15.1:0/3594615386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3419d7d0 con 0x7f2b3407dde0 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.906+0000 7f2b337fe640 1 --2- 172.21.15.1:0/3594615386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2b240090b0 tx=0x7f2b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24041070 con 0x7f2b3407dde0 2024-09-12T02:21:07.385 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2403c7a0 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b24037040 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3419da60 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b341a0750 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b24044070 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.907+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b2403d3f0 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.908+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3407c310 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.910+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2b24046450 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.972+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2b34075f30 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.972+0000 7f2b30ff9640 1 -- 172.21.15.1:0/3594615386 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2b34075f30 con 0x7f2b3407dde0 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 msgr2=0x7f2b3419d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 --2- 172.21.15.1:0/3594615386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2b240090b0 tx=0x7f2b240046c0 comp rx=0 tx=0).stop 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 shutdown_connections 2024-09-12T02:21:07.386 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 --2- 172.21.15.1:0/3594615386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b3407dde0 0x7f2b3419d290 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:07.387 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 >> 172.21.15.1:0/3594615386 conn(0x7f2b34102dc0 msgr2=0x7f2b34104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:07.387 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 shutdown_connections 2024-09-12T02:21:07.387 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:05.973+0000 7f2b39b5e640 1 -- 172.21.15.1:0/3594615386 wait complete. 2024-09-12T02:21:07.387 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-12T02:21:07.387 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T02:21:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:07 smithi001 ceph-mon[30889]: from='client.? 172.21.15.1:0/2090451398' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:21:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:07 smithi001 ceph-mon[30889]: from='client.? 172.21.15.1:0/2090451398' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T02:21:08.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:08.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:21:08.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.810+0000 7ff599d0b640 1 Processor -- start 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.810+0000 7ff599d0b640 1 -- start start 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.810+0000 7ff599d0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.810+0000 7ff599d0b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff594107f30 con 0x7ff594107560 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.811+0000 7ff5937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.811+0000 7ff5937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47704/0 (socket says 172.21.15.1:47704) 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.811+0000 7ff5937fe640 1 -- 172.21.15.1:0/1305423851 learned_addr learned my addr 172.21.15.1:0/1305423851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.811+0000 7ff5937fe640 1 -- 172.21.15.1:0/1305423851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff594108760 con 0x7ff594107560 2024-09-12T02:21:08.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.812+0000 7ff5937fe640 1 --2- 172.21.15.1:0/1305423851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff584009820 tx=0x7ff58402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fcd7a1c970ae95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.812+0000 7ff5927fc640 1 -- 172.21.15.1:0/1305423851 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584037070 con 0x7ff594107560 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.812+0000 7ff5927fc640 1 -- 172.21.15.1:0/1305423851 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff584032440 con 0x7ff594107560 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.812+0000 7ff5927fc640 1 -- 172.21.15.1:0/1305423851 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584032740 con 0x7ff594107560 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 -- 172.21.15.1:0/1305423851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 msgr2=0x7ff594107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 --2- 172.21.15.1:0/1305423851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff584009820 tx=0x7ff58402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 -- 172.21.15.1:0/1305423851 shutdown_connections 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 --2- 172.21.15.1:0/1305423851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff594107960 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 -- 172.21.15.1:0/1305423851 >> 172.21.15.1:0/1305423851 conn(0x7ff594102d10 msgr2=0x7ff594105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:08.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 -- 172.21.15.1:0/1305423851 shutdown_connections 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 -- 172.21.15.1:0/1305423851 wait complete. 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.813+0000 7ff599d0b640 1 Processor -- start 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff599d0b640 1 -- start start 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff599d0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff599d0b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff594108d00 con 0x7ff594107560 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff5937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff5937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47712/0 (socket says 172.21.15.1:47712) 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff5937fe640 1 -- 172.21.15.1:0/2090451398 learned_addr learned my addr 172.21.15.1:0/2090451398 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff5937fe640 1 -- 172.21.15.1:0/2090451398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419d810 con 0x7ff594107560 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.814+0000 7ff5937fe640 1 --2- 172.21.15.1:0/2090451398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff5840090b0 tx=0x7ff5840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584041070 con 0x7ff594107560 2024-09-12T02:21:08.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58403c7a0 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59419daa0 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff584037040 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941a0790 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff584044070 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.815+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff58403d3f0 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.816+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff594109350 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.818+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff584046450 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.878+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff5941a1ae0 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.881+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7ff584046630 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff590ff9640 1 -- 172.21.15.1:0/2090451398 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff584056070 con 0x7ff594107560 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 msgr2=0x7ff59419d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff599d0b640 1 --2- 172.21.15.1:0/2090451398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff5840090b0 tx=0x7ff5840046c0 comp rx=0 tx=0).stop 2024-09-12T02:21:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 shutdown_connections 2024-09-12T02:21:08.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff599d0b640 1 --2- 172.21.15.1:0/2090451398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff594107560 0x7ff59419d2d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:08.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.882+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 >> 172.21.15.1:0/2090451398 conn(0x7ff594102d10 msgr2=0x7ff59407c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:08.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.883+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 shutdown_connections 2024-09-12T02:21:08.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:07.883+0000 7ff599d0b640 1 -- 172.21.15.1:0/2090451398 wait complete. 2024-09-12T02:21:08.501 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-12T02:21:09.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:09 smithi001 ceph-mon[30889]: from='client.? 172.21.15.1:0/3504222014' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:21:09.943 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.905+0000 7fe000523640 1 Processor -- start 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.905+0000 7fe000523640 1 -- start start 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fe000523640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fe000523640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdff807be60 con 0x7fdff8107f80 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fdffe2bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fdffe2bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47722/0 (socket says 172.21.15.1:47722) 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fdffe2bf640 1 -- 172.21.15.1:0/2314443976 learned_addr learned my addr 172.21.15.1:0/2314443976 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.906+0000 7fdffe2bf640 1 -- 172.21.15.1:0/2314443976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff810a8b0 con 0x7fdff8107f80 2024-09-12T02:21:09.944 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.907+0000 7fdffe2bf640 1 --2- 172.21.15.1:0/2314443976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009820 tx=0x7fdff402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6fa084cb69cc80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.907+0000 7fdffd2bd640 1 -- 172.21.15.1:0/2314443976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff4037070 con 0x7fdff8107f80 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.907+0000 7fdffd2bd640 1 -- 172.21.15.1:0/2314443976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdff4032900 con 0x7fdff8107f80 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.907+0000 7fdffd2bd640 1 -- 172.21.15.1:0/2314443976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff4030850 con 0x7fdff8107f80 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 -- 172.21.15.1:0/2314443976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 msgr2=0x7fdff810a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 --2- 172.21.15.1:0/2314443976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009820 tx=0x7fdff402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 -- 172.21.15.1:0/2314443976 shutdown_connections 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 --2- 172.21.15.1:0/2314443976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff810a370 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 -- 172.21.15.1:0/2314443976 >> 172.21.15.1:0/2314443976 conn(0x7fdff8101b80 msgr2=0x7fdff8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 -- 172.21.15.1:0/2314443976 shutdown_connections 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 -- 172.21.15.1:0/2314443976 wait complete. 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.908+0000 7fe000523640 1 Processor -- start 2024-09-12T02:21:09.945 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fe000523640 1 -- start start 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fe000523640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fe000523640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810b950 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdffe2bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdffe2bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47730/0 (socket says 172.21.15.1:47730) 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdffe2bf640 1 -- 172.21.15.1:0/3504222014 learned_addr learned my addr 172.21.15.1:0/3504222014 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdffe2bf640 1 -- 172.21.15.1:0/3504222014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff819bd70 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdffe2bf640 1 --2- 172.21.15.1:0/3504222014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdff40097f0 tx=0x7fdff4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.909+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff4037040 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdff4040070 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff819c000 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff403a390 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff819ecf0 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdff403a5e0 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.910+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdff4045950 con 0x7fdff8107f80 2024-09-12T02:21:09.946 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.911+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff81083e0 con 0x7fdff8107f80 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.913+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdff403b430 con 0x7fdff8107f80 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.972+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdff81953b0 con 0x7fdff8107f80 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.973+0000 7fdfef7fe640 1 -- 172.21.15.1:0/3504222014 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7fdff403b7c0 con 0x7fdff8107f80 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 msgr2=0x7fdff819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 --2- 172.21.15.1:0/3504222014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdff40097f0 tx=0x7fdff4030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 shutdown_connections 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 --2- 172.21.15.1:0/3504222014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdff8107f80 0x7fdff819b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 >> 172.21.15.1:0/3504222014 conn(0x7fdff8101b80 msgr2=0x7fdff8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 shutdown_connections 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:08.974+0000 7fe000523640 1 -- 172.21.15.1:0/3504222014 wait complete. 2024-09-12T02:21:09.947 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-12T02:21:10.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:09 smithi001 systemd[1]: Stopping Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:21:10.513 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:10 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a[30885]: 2024-09-12T02:21:10.247+0000 7f8d3c56c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:21:10.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:10 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a[30885]: 2024-09-12T02:21:10.247+0000 7f8d3c56c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T02:21:10.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:10 smithi001 podman[31130]: 2024-09-12 02:21:10.514173569 +0000 UTC m=+0.362000343 container died ec056cf412cce30b0dee25de210d3d4ab015c98db8a00e6200053e264e98da56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:21:11.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:10 smithi001 podman[31130]: 2024-09-12 02:21:10.889024331 +0000 UTC m=+0.736851104 container cleanup ec056cf412cce30b0dee25de210d3d4ab015c98db8a00e6200053e264e98da56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:21:11.352 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:10 smithi001 bash[31130]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:21:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 podman[31142]: 2024-09-12 02:21:11.089794903 +0000 UTC m=+0.573192419 container remove ec056cf412cce30b0dee25de210d3d4ab015c98db8a00e6200053e264e98da56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:21:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:21:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 systemd[1]: Stopped Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:21:11.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 systemd[1]: Starting Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:21:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 podman[31233]: 2024-09-12 02:21:11.336263892 +0000 UTC m=+0.016100577 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:21:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:11 smithi001 podman[31233]: 2024-09-12 02:21:11.46618037 +0000 UTC m=+0.146017043 container create 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:21:12.423 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T02:21:12.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 podman[31233]: 2024-09-12 02:21:12.343823201 +0000 UTC m=+1.023659875 container init 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:21:12.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 podman[31233]: 2024-09-12 02:21:12.34732058 +0000 UTC m=+1.027157265 container start 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T02:21:12.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: pidfile_write: ignore empty --pid-file 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: load: jerasure load: lrc 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Git sha 0 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: DB SUMMARY 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: DB Session ID: ZS1NVALA76L9BC42Z0U2 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T02:21:12.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104796 ; 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.env: 0x55eae8025940 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.info_log: 0x55eaea5cd6e0 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.statistics: (nil) 2024-09-12T02:21:12.538 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.use_fsync: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.db_log_dir: 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.wal_dir: 2024-09-12T02:21:12.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.write_buffer_manager: 0x55eaea5dcdc0 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:21:12.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.unordered_write: 0 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.row_cache: None 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.wal_filter: None 2024-09-12T02:21:12.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:21:12.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.wal_compression: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:21:12.543 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:21:12.544 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_open_files: -1 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Compression algorithms supported: 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kZSTD supported: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:21:12.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.merge_operator: 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_filter: None 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eaea5cd320) 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:21:12.546 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x55eaea5c11f0 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-12T02:21:12.547 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-12T02:21:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression: NoCompression 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.num_levels: 7 2024-09-12T02:21:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:21:12.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:21:12.551 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:21:12.552 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:21:12.553 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.ttl: 2592000 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:21:12.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0693c013-0081-4e63-9d8f-94eaa66d3567 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107672375794, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107672376843, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99900, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97786, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14179, "raw_average_key_size": 49, "raw_value_size": 90122, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726107672, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0693c013-0081-4e63-9d8f-94eaa66d3567", "db_session_id": "ZS1NVALA76L9BC42Z0U2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107672376955, "job": 1, "event": "recovery_finished"} 2024-09-12T02:21:12.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eaea5eee00 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: DB pointer 0x55eaea6ea000 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:21:12.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 99.42 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 99.42 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:21:12.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 27.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 27.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x55eaea5c11f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.558 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???) e1 preinit fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).mds e1 new map 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).mds e1 print_map 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-12T02:21:05:451625+0000 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:21:12.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 bash[31233]: 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 systemd[1]: Started Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: monmap epoch 1 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: last_changed 2024-09-12T02:21:02.319189+0000 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: min_mon_release 19 (squid) 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: election_strategy: 1 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: fsmap 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:21:12.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:12 smithi001 ceph-mon[31252]: mgrmap e1: no daemons active 2024-09-12T02:21:13.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e34b6c640 1 Processor -- start 2024-09-12T02:21:13.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e34b6c640 1 -- start start 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e34b6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e34b6c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7e30107f50 con 0x7f7e30107580 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60124/0 (socket says 172.21.15.1:60124) 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.906+0000 7f7e2e59c640 1 -- 172.21.15.1:0/3391430601 learned_addr learned my addr 172.21.15.1:0/3391430601 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.907+0000 7f7e2e59c640 1 -- 172.21.15.1:0/3391430601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e30108780 con 0x7f7e30107580 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.908+0000 7f7e2e59c640 1 --2- 172.21.15.1:0/3391430601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009820 tx=0x7f7e2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e3091a6d4c9afe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e2dd9b640 1 -- 172.21.15.1:0/3391430601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e20037070 con 0x7f7e30107580 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e2dd9b640 1 -- 172.21.15.1:0/3391430601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e20032900 con 0x7f7e30107580 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e2dd9b640 1 -- 172.21.15.1:0/3391430601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e20030850 con 0x7f7e30107580 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3391430601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 msgr2=0x7f7e30107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 --2- 172.21.15.1:0/3391430601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009820 tx=0x7f7e2002a270 comp rx=0 tx=0).stop 2024-09-12T02:21:13.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3391430601 shutdown_connections 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 --2- 172.21.15.1:0/3391430601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e30107980 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3391430601 >> 172.21.15.1:0/3391430601 conn(0x7f7e30102d90 msgr2=0x7f7e301051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3391430601 shutdown_connections 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.909+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3391430601 wait complete. 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e34b6c640 1 Processor -- start 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e34b6c640 1 -- start start 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e34b6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e34b6c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3010bb30 con 0x7f7e30107580 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60130/0 (socket says 172.21.15.1:60130) 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.910+0000 7f7e2e59c640 1 -- 172.21.15.1:0/3610914137 learned_addr learned my addr 172.21.15.1:0/3610914137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e2e59c640 1 -- 172.21.15.1:0/3610914137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3007e060 con 0x7f7e30107580 2024-09-12T02:21:13.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e2e59c640 1 --2- 172.21.15.1:0/3610914137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097f0 tx=0x7f7e20030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e20037040 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e20040070 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3007c250 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e2003a390 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3007c730 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7e2003a5e0 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.911+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e20045950 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.912+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3010bcb0 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.915+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7e20045460 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.974+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f7e30107a00 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.975+0000 7f7e277fe640 1 -- 172.21.15.1:0/3610914137 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f7e2003b430 con 0x7f7e30107580 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 msgr2=0x7f7e3007db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 --2- 172.21.15.1:0/3610914137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097f0 tx=0x7f7e20030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 shutdown_connections 2024-09-12T02:21:13.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 --2- 172.21.15.1:0/3610914137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7e30107580 0x7f7e3007db20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:13.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 >> 172.21.15.1:0/3610914137 conn(0x7f7e30102d90 msgr2=0x7f7e30103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:13.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 shutdown_connections 2024-09-12T02:21:13.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:12.976+0000 7f7e34b6c640 1 -- 172.21.15.1:0/3610914137 wait complete. 2024-09-12T02:21:13.544 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T02:21:13.583 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:21:13.583 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-12T02:21:13.583 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T02:21:13.584 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T02:21:13.845 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:21:13.845 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T02:21:14.007 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968.target.wants/ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-877143dc-70ad-11ef-bcea-c7b262605968@.service. 2024-09-12T02:21:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:13 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3610914137' entity='client.admin' 2024-09-12T02:21:14.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 systemd[1]: Starting Ceph mgr.x for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:21:14.546 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 podman[31461]: 2024-09-12 02:21:14.146559123 +0000 UTC m=+0.016551894 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:21:14.547 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 podman[31461]: 2024-09-12 02:21:14.244518107 +0000 UTC m=+0.114510868 container create b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:21:14.547 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 podman[31461]: 2024-09-12 02:21:14.463440482 +0000 UTC m=+0.333433252 container init b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T02:21:14.547 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 podman[31461]: 2024-09-12 02:21:14.466255455 +0000 UTC m=+0.336248224 container start b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T02:21:14.547 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 bash[31461]: b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf 2024-09-12T02:21:14.561 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:21:14.561 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-12T02:21:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:21:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:21:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-12T02:21:14.569 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:21:14.578 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:21:14.578 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-12T02:21:14.586 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:21:14.586 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:21:14.586 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-12T02:21:14.586 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T02:21:14.587 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-12T02:21:14.587 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-12T02:21:14.797 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 systemd[1]: Started Ceph mgr.x for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:21:14.797 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:14.592+0000 7f6e62b36040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:21:14.797 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:14.653+0000 7f6e62b36040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:15.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:14.814+0000 7f6e62b36040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:21:15.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:14.883+0000 7f6e62b36040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:21:15.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:15.044+0000 7f6e62b36040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:15.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4165525756' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:21:15.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:15.197+0000 7f6e62b36040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:21:15.703 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:15.532+0000 7f6e62b36040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:21:15.703 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:15.596+0000 7f6e62b36040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:21:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:21:15.709 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:21:15.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:21:05:451625+0000", 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:21:15.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:21:05.452276+0000", 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:15.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27de145640 1 Processor -- start 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27de145640 1 -- start start 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27de145640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27de145640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27d807be60 con 0x7f27d8107f80 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60158/0 (socket says 172.21.15.1:60158) 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.972+0000 7f27d77fe640 1 -- 172.21.15.1:0/2599172808 learned_addr learned my addr 172.21.15.1:0/2599172808 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.973+0000 7f27d77fe640 1 -- 172.21.15.1:0/2599172808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d810a8b0 con 0x7f27d8107f80 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27d77fe640 1 --2- 172.21.15.1:0/2599172808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009820 tx=0x7f27c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43552a2e8b35489b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27d67fc640 1 -- 172.21.15.1:0/2599172808 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c8037070 con 0x7f27d8107f80 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27d67fc640 1 -- 172.21.15.1:0/2599172808 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27c8032900 con 0x7f27d8107f80 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27d67fc640 1 -- 172.21.15.1:0/2599172808 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c8030850 con 0x7f27d8107f80 2024-09-12T02:21:15.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27de145640 1 -- 172.21.15.1:0/2599172808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 msgr2=0x7f27d810a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27de145640 1 --2- 172.21.15.1:0/2599172808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009820 tx=0x7f27c802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27de145640 1 -- 172.21.15.1:0/2599172808 shutdown_connections 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27de145640 1 --2- 172.21.15.1:0/2599172808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d810a370 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.974+0000 7f27de145640 1 -- 172.21.15.1:0/2599172808 >> 172.21.15.1:0/2599172808 conn(0x7f27d8101b80 msgr2=0x7f27d8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.975+0000 7f27de145640 1 -- 172.21.15.1:0/2599172808 shutdown_connections 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.975+0000 7f27de145640 1 -- 172.21.15.1:0/2599172808 wait complete. 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.975+0000 7f27de145640 1 Processor -- start 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.975+0000 7f27de145640 1 -- start start 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27de145640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27de145640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27d810b950 con 0x7f27d8107f80 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60160/0 (socket says 172.21.15.1:60160) 2024-09-12T02:21:15.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d77fe640 1 -- 172.21.15.1:0/4165525756 learned_addr learned my addr 172.21.15.1:0/4165525756 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d77fe640 1 -- 172.21.15.1:0/4165525756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d819bd70 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d77fe640 1 --2- 172.21.15.1:0/4165525756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27c8032ce0 tx=0x7f27c8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c8042070 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27c80308c0 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d819c000 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c8037040 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.976+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d819ecf0 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.977+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27c8045070 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.977+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27c8047bd0 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.977+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d81083e0 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:14.980+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f27c803c830 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.042+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f27d81953b0 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.043+0000 7f27d4ff9640 1 -- 172.21.15.1:0/4165525756 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f27c803ca10 con 0x7f27d8107f80 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 msgr2=0x7f27d819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:15.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 --2- 172.21.15.1:0/4165525756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27c8032ce0 tx=0x7f27c8032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 shutdown_connections 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 --2- 172.21.15.1:0/4165525756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27d8107f80 0x7f27d819b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 >> 172.21.15.1:0/4165525756 conn(0x7f27d8101b80 msgr2=0x7f27d8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 shutdown_connections 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:15.044+0000 7f27de145640 1 -- 172.21.15.1:0/4165525756 wait complete. 2024-09-12T02:21:15.724 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-12T02:21:16.125 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:15.796+0000 7f6e62b36040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:21:17.027 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:16 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:16.723+0000 7f6e62b36040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:21:17.027 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:16 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:16.793+0000 7f6e62b36040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:21:17.830 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:17.551+0000 7f6e62b36040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:21:17.830 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:17.671+0000 7f6e62b36040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:21:18.097 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:17.829+0000 7f6e62b36040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:18.097 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:17.894+0000 7f6e62b36040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:21:18.097 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.062+0000 7f6e62b36040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:21:18.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3318075101' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:21:18.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.138+0000 7f6e62b36040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:21:18.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.207+0000 7f6e62b36040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:21:18.674 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.379+0000 7f6e62b36040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:21:18.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.450+0000 7f6e62b36040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:21:18.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.522+0000 7f6e62b36040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:21:18.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.610+0000 7f6e62b36040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:18.675 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.674+0000 7f6e62b36040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:21:18.788 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:21:18.791 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:18.792 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:21:18.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:21:18.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:21:18.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:21:18.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:21:18.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:21:18.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:18.801 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:21:05:451625+0000", 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:21:05.452276+0000", 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.103+0000 7f0b5dea3640 1 Processor -- start 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.103+0000 7f0b5dea3640 1 -- start start 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.103+0000 7f0b5dea3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.103+0000 7f0b5dea3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5807be00 con 0x7f0b58107fe0 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.104+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.104+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60168/0 (socket says 172.21.15.1:60168) 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.104+0000 7f0b577fe640 1 -- 172.21.15.1:0/3791256170 learned_addr learned my addr 172.21.15.1:0/3791256170 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:18.803 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.104+0000 7f0b577fe640 1 -- 172.21.15.1:0/3791256170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5810a910 con 0x7f0b58107fe0 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.105+0000 7f0b577fe640 1 --2- 172.21.15.1:0/3791256170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009820 tx=0x7f0b4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fb30f986ec878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.105+0000 7f0b567fc640 1 -- 172.21.15.1:0/3791256170 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b48037070 con 0x7f0b58107fe0 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.105+0000 7f0b567fc640 1 -- 172.21.15.1:0/3791256170 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b48032900 con 0x7f0b58107fe0 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.105+0000 7f0b567fc640 1 -- 172.21.15.1:0/3791256170 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b48030850 con 0x7f0b58107fe0 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3791256170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 msgr2=0x7f0b5810a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 --2- 172.21.15.1:0/3791256170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009820 tx=0x7f0b4802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3791256170 shutdown_connections 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 --2- 172.21.15.1:0/3791256170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5810a3d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3791256170 >> 172.21.15.1:0/3791256170 conn(0x7f0b58101b80 msgr2=0x7f0b58103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3791256170 shutdown_connections 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.106+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3791256170 wait complete. 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b5dea3640 1 Processor -- start 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b5dea3640 1 -- start start 2024-09-12T02:21:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b5dea3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b5dea3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5810b950 con 0x7f0b58107fe0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60174/0 (socket says 172.21.15.1:60174) 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.107+0000 7f0b577fe640 1 -- 172.21.15.1:0/3318075101 learned_addr learned my addr 172.21.15.1:0/3318075101 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b577fe640 1 -- 172.21.15.1:0/3318075101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5819df80 con 0x7f0b58107fe0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b577fe640 1 --2- 172.21.15.1:0/3318075101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097f0 tx=0x7f0b48030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b48037040 con 0x7f0b58107fe0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5819e210 con 0x7f0b58107fe0 2024-09-12T02:21:18.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b48040070 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4803a390 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.108+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b581a0f00 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.109+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b4803a630 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.109+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0b480459a0 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.109+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b58108440 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.111+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0b48045460 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.174+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0b581977b0 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.174+0000 7f0b54ff9640 1 -- 172.21.15.1:0/3318075101 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f0b4803b430 con 0x7f0b58107fe0 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 msgr2=0x7f0b5819da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 --2- 172.21.15.1:0/3318075101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097f0 tx=0x7f0b48030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 shutdown_connections 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 --2- 172.21.15.1:0/3318075101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b58107fe0 0x7f0b5819da40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:18.806 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 >> 172.21.15.1:0/3318075101 conn(0x7f0b58101b80 msgr2=0x7f0b581028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:18.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 shutdown_connections 2024-09-12T02:21:18.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:18.175+0000 7f0b5dea3640 1 -- 172.21.15.1:0/3318075101 wait complete. 2024-09-12T02:21:18.807 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-09-12T02:21:19.125 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:18.737+0000 7f6e62b36040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:19.574+0000 7f6e62b36040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: Activating manager daemon x 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: mgrmap e2: x(active, starting, since 0.00290899s) 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:21:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: Manager daemon x is now available 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' 2024-09-12T02:21:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:19 smithi001 ceph-mon[31252]: from='mgr.14100 172.21.15.1:0/580314699' entity='mgr.x' 2024-09-12T02:21:21.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:21 smithi001 ceph-mon[31252]: mgrmap e3: x(active, since 1.00725s) 2024-09-12T02:21:21.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2183256277' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:21:22.054 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:21:22.055 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:21:22.056 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:21:22.064 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:21:05:451625+0000", 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.065 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:21:05.452276+0000", 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:21:22.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f300d640 1 Processor -- start 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f300d640 1 -- start start 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f300d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f300d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec106220 con 0x7fe9ec105850 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f0da9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f0da9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34812/0 (socket says 172.21.15.1:34812) 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.224+0000 7fe9f0da9640 1 -- 172.21.15.1:0/3681675598 learned_addr learned my addr 172.21.15.1:0/3681675598 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.225+0000 7fe9f0da9640 1 -- 172.21.15.1:0/3681675598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec108830 con 0x7fe9ec105850 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.225+0000 7fe9f0da9640 1 --2- 172.21.15.1:0/3681675598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009820 tx=0x7fe9d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b330c3dfc33054 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9eb7fe640 1 -- 172.21.15.1:0/3681675598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4037070 con 0x7fe9ec105850 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9eb7fe640 1 -- 172.21.15.1:0/3681675598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9d4032900 con 0x7fe9ec105850 2024-09-12T02:21:22.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9eb7fe640 1 -- 172.21.15.1:0/3681675598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4030850 con 0x7fe9ec105850 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 -- 172.21.15.1:0/3681675598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 msgr2=0x7fe9ec105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 --2- 172.21.15.1:0/3681675598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009820 tx=0x7fe9d402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 -- 172.21.15.1:0/3681675598 shutdown_connections 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 --2- 172.21.15.1:0/3681675598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec105c50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 -- 172.21.15.1:0/3681675598 >> 172.21.15.1:0/3681675598 conn(0x7fe9ec101400 msgr2=0x7fe9ec103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 -- 172.21.15.1:0/3681675598 shutdown_connections 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.226+0000 7fe9f300d640 1 -- 172.21.15.1:0/3681675598 wait complete. 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f300d640 1 Processor -- start 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f300d640 1 -- start start 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f300d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f300d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec10ba60 con 0x7fe9ec105850 2024-09-12T02:21:22.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f0da9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f0da9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34824/0 (socket says 172.21.15.1:34824) 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.227+0000 7fe9f0da9640 1 -- 172.21.15.1:0/2183256277 learned_addr learned my addr 172.21.15.1:0/2183256277 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9f0da9640 1 -- 172.21.15.1:0/2183256277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec19bab0 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9f0da9640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009940 tx=0x7fe9d4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4042070 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9d40308c0 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4037040 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec19bd40 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.228+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec19ea30 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.229+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fe9d4045070 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.229+0000 7fe9e9ffb640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 0x7fe9d803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.229+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec105cd0 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.229+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe9d406bdb0 con 0x7fe9ec105850 2024-09-12T02:21:22.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.229+0000 7fe9ebfff640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 0x7fe9d803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.230+0000 7fe9ebfff640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 0x7fe9d803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00ad30 tx=0x7fe9dc0093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.235+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9d404b170 con 0x7fe9ec105850 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.477+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe9ec19f080 con 0x7fe9ec105850 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.477+0000 7fe9e9ffb640 1 -- 172.21.15.1:0/2183256277 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fe9d402fd90 con 0x7fe9ec105850 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 msgr2=0x7fe9d803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 0x7fe9d803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00ad30 tx=0x7fe9dc0093f0 comp rx=0 tx=0).stop 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 msgr2=0x7fe9ec19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009940 tx=0x7fe9d4032ce0 comp rx=0 tx=0).stop 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 shutdown_connections 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fe9d8038e60 0x7fe9d803b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 --2- 172.21.15.1:0/2183256277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9ec105850 0x7fe9ec19b570 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 >> 172.21.15.1:0/2183256277 conn(0x7fe9ec101400 msgr2=0x7fe9ec101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:22.070 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 shutdown_connections 2024-09-12T02:21:22.071 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:21.481+0000 7fe9f300d640 1 -- 172.21.15.1:0/2183256277 wait complete. 2024-09-12T02:21:22.071 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-12T02:21:22.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:22 smithi001 ceph-mon[31252]: mgrmap e4: x(active, since 2s) 2024-09-12T02:21:23.198 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-12T02:21:23.199 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc8f21640 1 Processor -- start 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc8f21640 1 -- start start 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc8f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc8f21640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fccc407c7d0 con 0x7fccc407dde0 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34836/0 (socket says 172.21.15.1:34836) 2024-09-12T02:21:23.200 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc259c640 1 -- 172.21.15.1:0/3147235561 learned_addr learned my addr 172.21.15.1:0/3147235561 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.450+0000 7fccc259c640 1 -- 172.21.15.1:0/3147235561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc407c950 con 0x7fccc407dde0 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.451+0000 7fccc259c640 1 --2- 172.21.15.1:0/3147235561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009820 tx=0x7fccb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1abb3e218debc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.451+0000 7fccc159a640 1 -- 172.21.15.1:0/3147235561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4037070 con 0x7fccc407dde0 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.451+0000 7fccc159a640 1 -- 172.21.15.1:0/3147235561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccb4032900 con 0x7fccc407dde0 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.451+0000 7fccc159a640 1 -- 172.21.15.1:0/3147235561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4030850 con 0x7fccc407dde0 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 -- 172.21.15.1:0/3147235561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 msgr2=0x7fccc407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3147235561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009820 tx=0x7fccb402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 -- 172.21.15.1:0/3147235561 shutdown_connections 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3147235561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc407c290 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 -- 172.21.15.1:0/3147235561 >> 172.21.15.1:0/3147235561 conn(0x7fccc4102dc0 msgr2=0x7fccc41051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 -- 172.21.15.1:0/3147235561 shutdown_connections 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.452+0000 7fccc8f21640 1 -- 172.21.15.1:0/3147235561 wait complete. 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc8f21640 1 Processor -- start 2024-09-12T02:21:23.201 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc8f21640 1 -- start start 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc8f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc8f21640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fccc410dc20 con 0x7fccc407dde0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34840/0 (socket says 172.21.15.1:34840) 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc259c640 1 -- 172.21.15.1:0/3873703807 learned_addr learned my addr 172.21.15.1:0/3873703807 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.453+0000 7fccc259c640 1 -- 172.21.15.1:0/3873703807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc419dfe0 con 0x7fccc407dde0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccc259c640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccb4032ce0 tx=0x7fccb4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4042070 con 0x7fccc407dde0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccb40308c0 con 0x7fccc407dde0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc419e270 con 0x7fccc407dde0 2024-09-12T02:21:23.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4037040 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc41a0f60 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.454+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fccb4045070 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.455+0000 7fccb37fe640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 0x7fccac03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.455+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fccb406bff0 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.455+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc407c310 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.455+0000 7fccc1d9b640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 0x7fccac03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.455+0000 7fccc1d9b640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 0x7fccac03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccb80098c0 tx=0x7fccb8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.460+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fccb406ba10 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.637+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fccc4075f40 con 0x7fccc407dde0 2024-09-12T02:21:23.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.638+0000 7fccb37fe640 1 -- 172.21.15.1:0/3873703807 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7fccb4045520 con 0x7fccc407dde0 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 msgr2=0x7fccac03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 0x7fccac03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccb80098c0 tx=0x7fccb8006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 msgr2=0x7fccc419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccb4032ce0 tx=0x7fccb4032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 shutdown_connections 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7fccac038f20 0x7fccac03b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 --2- 172.21.15.1:0/3873703807 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccc407dde0 0x7fccc419daa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 >> 172.21.15.1:0/3873703807 conn(0x7fccc4102dc0 msgr2=0x7fccc4103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 shutdown_connections 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:22.640+0000 7fccc8f21640 1 -- 172.21.15.1:0/3873703807 wait complete. 2024-09-12T02:21:23.204 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-12T02:21:23.802 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:23 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3873703807' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:21:24.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3556576375' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T02:21:24.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ignoring --setuser ceph since I am not root 2024-09-12T02:21:24.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ignoring --setgroup ceph since I am not root 2024-09-12T02:21:24.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:24.738+0000 7fdf73178040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:21:24.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:24.798+0000 7fdf73178040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:25.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:24.955+0000 7fdf73178040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:21:25.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.025+0000 7fdf73178040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:21:25.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.180+0000 7fdf73178040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:25.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.566+0000 7f16fa4fa640 1 Processor -- start 2024-09-12T02:21:25.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.566+0000 7f16fa4fa640 1 -- start start 2024-09-12T02:21:25.202 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16fa4fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16fa4fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4106de0 con 0x7f16f4106410 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34854/0 (socket says 172.21.15.1:34854) 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16f3fff640 1 -- 172.21.15.1:0/506723902 learned_addr learned my addr 172.21.15.1:0/506723902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.567+0000 7f16f3fff640 1 -- 172.21.15.1:0/506723902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4107610 con 0x7f16f4106410 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16f3fff640 1 --2- 172.21.15.1:0/506723902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009820 tx=0x7f16e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ef1afe93f3e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16f2ffd640 1 -- 172.21.15.1:0/506723902 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e4037070 con 0x7f16f4106410 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16f2ffd640 1 -- 172.21.15.1:0/506723902 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16e4032900 con 0x7f16f4106410 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16f2ffd640 1 -- 172.21.15.1:0/506723902 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e4030850 con 0x7f16f4106410 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16fa4fa640 1 -- 172.21.15.1:0/506723902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 msgr2=0x7f16f4106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/506723902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009820 tx=0x7f16e402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16fa4fa640 1 -- 172.21.15.1:0/506723902 shutdown_connections 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/506723902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4106810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:25.203 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.568+0000 7f16fa4fa640 1 -- 172.21.15.1:0/506723902 >> 172.21.15.1:0/506723902 conn(0x7f16f4101b80 msgr2=0x7f16f4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 -- 172.21.15.1:0/506723902 shutdown_connections 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 -- 172.21.15.1:0/506723902 wait complete. 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 Processor -- start 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 -- start start 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.569+0000 7f16fa4fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410a9c0 con 0x7f16f4106410 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34858/0 (socket says 172.21.15.1:34858) 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f3fff640 1 -- 172.21.15.1:0/3556576375 learned_addr learned my addr 172.21.15.1:0/3556576375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f3fff640 1 -- 172.21.15.1:0/3556576375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4191b80 con 0x7f16f4106410 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f3fff640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097f0 tx=0x7f16e4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e4037040 con 0x7f16f4106410 2024-09-12T02:21:25.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f418fd70 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f4190250 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16e4040070 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.570+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e4045ad0 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.571+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f16e4045c70 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.571+0000 7f16f17fa640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 0x7f16dc03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.571+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e00052c0 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.571+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16e406bf70 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.571+0000 7f16f37fe640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 0x7f16dc03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.572+0000 7f16f37fe640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 0x7f16dc03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16e80098c0 tx=0x7f16e8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.576+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16e4042b30 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:23.802+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f16e00055b0 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.586+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f16e40392f0 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.587+0000 7f16f17fa640 1 -- 172.21.15.1:0/3556576375 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f16e4070070 con 0x7f16f4106410 2024-09-12T02:21:25.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 msgr2=0x7f16dc03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 0x7f16dc03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16e80098c0 tx=0x7f16e8006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 msgr2=0x7f16f4191640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097f0 tx=0x7f16e4030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 shutdown_connections 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f16dc038f20 0x7f16dc03b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 --2- 172.21.15.1:0/3556576375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16f4106410 0x7f16f4191640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 >> 172.21.15.1:0/3556576375 conn(0x7f16f4101b80 msgr2=0x7f16f4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 shutdown_connections 2024-09-12T02:21:25.206 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:24.590+0000 7f16fa4fa640 1 -- 172.21.15.1:0/3556576375 wait complete. 2024-09-12T02:21:25.464 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.330+0000 7fdf73178040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:21:25.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3556576375' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T02:21:25.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-mon[31252]: mgrmap e5: x(active, since 5s) 2024-09-12T02:21:25.735 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.669+0000 7fdf73178040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:21:25.735 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.733+0000 7fdf73178040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:21:26.125 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:25.941+0000 7fdf73178040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b80ab6640 1 Processor -- start 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b80ab6640 1 -- start start 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b80ab6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b80ab6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c07be20 con 0x7f7b7c107fc0 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:26.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34880/0 (socket says 172.21.15.1:34880) 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b7a59c640 1 -- 172.21.15.1:0/2086090551 learned_addr learned my addr 172.21.15.1:0/2086090551 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.543+0000 7f7b7a59c640 1 -- 172.21.15.1:0/2086090551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c10a8f0 con 0x7f7b7c107fc0 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.544+0000 7f7b7a59c640 1 --2- 172.21.15.1:0/2086090551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009820 tx=0x7f7b6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb409d9b3156eeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.544+0000 7f7b7959a640 1 -- 172.21.15.1:0/2086090551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c037070 con 0x7f7b7c107fc0 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.544+0000 7f7b7959a640 1 -- 172.21.15.1:0/2086090551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b6c032900 con 0x7f7b7c107fc0 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.544+0000 7f7b7959a640 1 -- 172.21.15.1:0/2086090551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c030850 con 0x7f7b7c107fc0 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 -- 172.21.15.1:0/2086090551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 msgr2=0x7f7b7c10a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/2086090551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009820 tx=0x7f7b6c02a270 comp rx=0 tx=0).stop 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 -- 172.21.15.1:0/2086090551 shutdown_connections 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/2086090551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c10a3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 -- 172.21.15.1:0/2086090551 >> 172.21.15.1:0/2086090551 conn(0x7f7b7c101b80 msgr2=0x7f7b7c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 -- 172.21.15.1:0/2086090551 shutdown_connections 2024-09-12T02:21:26.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.545+0000 7f7b80ab6640 1 -- 172.21.15.1:0/2086090551 wait complete. 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b80ab6640 1 Processor -- start 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b80ab6640 1 -- start start 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b80ab6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b80ab6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c10b930 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34886/0 (socket says 172.21.15.1:34886) 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.546+0000 7f7b7a59c640 1 -- 172.21.15.1:0/3542389019 learned_addr learned my addr 172.21.15.1:0/3542389019 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b7a59c640 1 -- 172.21.15.1:0/3542389019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c107d80 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b7a59c640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c032ce0 tx=0x7f7b6c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c042070 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b6c0308c0 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c105f70 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c037040 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.547+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c1064b0 con 0x7f7b7c107fc0 2024-09-12T02:21:26.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7c108420 con 0x7f7b7c107fc0 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f7b6c045070 con 0x7f7b7c107fc0 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b6b7fe640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 0x7f7b6403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7b6c06c1b0 con 0x7f7b7c107fc0 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b79d9b640 1 -- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 msgr2=0x7f7b6403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.548+0000 7f7b79d9b640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 0x7f7b6403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.553+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b6c03add0 con 0x7f7b7c107fc0 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.749+0000 7f7b79d9b640 1 -- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 msgr2=0x7f7b6403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.749+0000 7f7b79d9b640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 0x7f7b6403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.778+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7b7c195020 con 0x7f7b7c107fc0 2024-09-12T02:21:26.338 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.778+0000 7f7b6b7fe640 1 -- 172.21.15.1:0/3542389019 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f7b6c045520 con 0x7f7b7c107fc0 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 msgr2=0x7f7b6403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 0x7f7b6403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 msgr2=0x7f7b7c107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c032ce0 tx=0x7f7b6c032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 shutdown_connections 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f7b64038fc0 0x7f7b6403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 --2- 172.21.15.1:0/3542389019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b7c107fc0 0x7f7b7c107840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 >> 172.21.15.1:0/3542389019 conn(0x7f7b7c101b80 msgr2=0x7f7b7c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.781+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 shutdown_connections 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:25.782+0000 7f7b80ab6640 1 -- 172.21.15.1:0/3542389019 wait complete. 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-12T02:21:26.339 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-12T02:21:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:26 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3542389019' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:21:27.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:26.887+0000 7fdf73178040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:21:27.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:26.958+0000 7fdf73178040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:21:27.983 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:27.711+0000 7fdf73178040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:21:27.983 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:27.832+0000 7fdf73178040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:21:28.274 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:27.981+0000 7fdf73178040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:28.274 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.045+0000 7fdf73178040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:21:28.275 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.202+0000 7fdf73178040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:21:28.275 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.273+0000 7fdf73178040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:21:28.571 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.336+0000 7fdf73178040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:21:28.572 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.502+0000 7fdf73178040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:21:28.572 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.570+0000 7fdf73178040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:21:28.855 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.640+0000 7fdf73178040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:21:28.855 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.728+0000 7fdf73178040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:28.855 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.792+0000 7fdf73178040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:21:28.855 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:28.854+0000 7fdf73178040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:21:30.125 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:29.688+0000 7fdf73178040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: Active manager daemon x restarted 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: Activating manager daemon x 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: mgrmap e6: x(active, starting, since 0.00334121s) 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:21:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: Manager daemon x is now available 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:21:30.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:29 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:21:31.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:30 smithi001 ceph-mon[31252]: Found migration_current of "None". Setting to last migration. 2024-09-12T02:21:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:30 smithi001 ceph-mon[31252]: mgrmap e7: x(active, since 1.00599s) 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f477a43f640 1 Processor -- start 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f477a43f640 1 -- start start 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f477a43f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f477a43f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f477407bde0 con 0x7f4774108030 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f4773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f4773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34896/0 (socket says 172.21.15.1:34896) 2024-09-12T02:21:31.242 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f4773fff640 1 -- 172.21.15.1:0/3159278547 learned_addr learned my addr 172.21.15.1:0/3159278547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.734+0000 7f4773fff640 1 -- 172.21.15.1:0/3159278547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477410a960 con 0x7f4774108030 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.735+0000 7f4773fff640 1 --2- 172.21.15.1:0/3159278547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4764009820 tx=0x7f476402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1804760239adbe83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.736+0000 7f47737fe640 1 -- 172.21.15.1:0/3159278547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4764037070 con 0x7f4774108030 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.736+0000 7f47737fe640 1 -- 172.21.15.1:0/3159278547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4764032900 con 0x7f4774108030 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.736+0000 7f47737fe640 1 -- 172.21.15.1:0/3159278547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4764030850 con 0x7f4774108030 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.736+0000 7f477a43f640 1 -- 172.21.15.1:0/3159278547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 msgr2=0x7f477410a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.736+0000 7f477a43f640 1 --2- 172.21.15.1:0/3159278547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4764009820 tx=0x7f476402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- 172.21.15.1:0/3159278547 shutdown_connections 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 --2- 172.21.15.1:0/3159278547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477410a420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- 172.21.15.1:0/3159278547 >> 172.21.15.1:0/3159278547 conn(0x7f4774101b90 msgr2=0x7f4774104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- 172.21.15.1:0/3159278547 shutdown_connections 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- 172.21.15.1:0/3159278547 wait complete. 2024-09-12T02:21:31.243 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 Processor -- start 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- start start 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.737+0000 7f477a43f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f477410b940 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4773fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34912/0 (socket says 172.21.15.1:34912) 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4773fff640 1 -- 172.21.15.1:0/1223320654 learned_addr learned my addr 172.21.15.1:0/1223320654 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4773fff640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477419dfe0 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4773fff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4764032ce0 tx=0x7f4764032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4764042070 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47640308c0 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477419e270 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47741a0f60 con 0x7f4774108030 2024-09-12T02:21:31.244 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.738+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4764037040 con 0x7f4774108030 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.739+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4764045070 con 0x7f4774108030 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.740+0000 7f4771ffb640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.740+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f476003bb90 con 0x7f4760038fc0 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.740+0000 7f476bfff640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 msgr2=0x7f476003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.740+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f476406bff0 con 0x7f4774108030 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.740+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.941+0000 7f476bfff640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 msgr2=0x7f476003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:26.941+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:27.342+0000 7f476bfff640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 msgr2=0x7f476003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:27.342+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:28.143+0000 7f476bfff640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 msgr2=0x7f476003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3479905526 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:28.143+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:21:31.245 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:29.692+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f476406aad0 con 0x7f4774108030 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:29.692+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 msgr2=0x7f476003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:29.692+0000 7f4771ffb640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.693+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f476403c860 con 0x7f4774108030 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.693+0000 7f4771ffb640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 0x7f476003ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.693+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f476406b720 con 0x7f476003c8f0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.694+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 0x7f476003ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.695+0000 7f476bfff640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 0x7f476003ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f475c003980 tx=0x7f475c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.695+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f476406b720 con 0x7f476003c8f0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.702+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f47540025a0 con 0x7f476003c8f0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f4771ffb640 1 -- 172.21.15.1:0/1223320654 <== mgr.14118 v2:172.21.15.1:6800/556592053 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f47540025a0 con 0x7f476003c8f0 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 msgr2=0x7f476003ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 0x7f476003ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f475c003980 tx=0x7f475c0092b0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 msgr2=0x7f477419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4764032ce0 tx=0x7f4764032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 shutdown_connections 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f476003c8f0 0x7f476003ece0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:6800/3479905526,v1:172.21.15.1:6801/3479905526] conn(0x7f4760038fc0 0x7f476003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 --2- 172.21.15.1:0/1223320654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4774108030 0x7f477419daa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 >> 172.21.15.1:0/1223320654 conn(0x7f4774101b90 msgr2=0x7f4774102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 shutdown_connections 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:30.703+0000 7f477a43f640 1 -- 172.21.15.1:0/1223320654 wait complete. 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-12T02:21:31.247 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:32.189 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:31 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:32.271+0000 7fdeda492640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:21:32] ENGINE Error in HTTPServer.serve 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: Traceback (most recent call last): 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._connections.run(self.expiration_interval) 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._run(expiration_interval) 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:21:32.483 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: s = self.context.wrap_socket( 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: return self.sslsocket_class._create( 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self.do_handshake() 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:21:32.484 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._sslobj.do_handshake() 2024-09-12T02:21:32.485 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:21:32.485 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.681+0000 7f691bd15640 1 Processor -- start 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.681+0000 7f691bd15640 1 -- start start 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f691bd15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f691bd15640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6914106de0 con 0x7f6914106410 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f6919ab1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f6919ab1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50426/0 (socket says 172.21.15.1:50426) 2024-09-12T02:21:32.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f6919ab1640 1 -- 172.21.15.1:0/1427316425 learned_addr learned my addr 172.21.15.1:0/1427316425 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.682+0000 7f6919ab1640 1 -- 172.21.15.1:0/1427316425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6914107610 con 0x7f6914106410 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.683+0000 7f6919ab1640 1 --2- 172.21.15.1:0/1427316425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6910009820 tx=0x7f691002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2933f9ff822089d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.683+0000 7f6918aaf640 1 -- 172.21.15.1:0/1427316425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6910037070 con 0x7f6914106410 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.683+0000 7f6918aaf640 1 -- 172.21.15.1:0/1427316425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6910032900 con 0x7f6914106410 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.683+0000 7f6918aaf640 1 -- 172.21.15.1:0/1427316425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6910030850 con 0x7f6914106410 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 -- 172.21.15.1:0/1427316425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 msgr2=0x7f6914106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 --2- 172.21.15.1:0/1427316425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6910009820 tx=0x7f691002a270 comp rx=0 tx=0).stop 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 -- 172.21.15.1:0/1427316425 shutdown_connections 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 --2- 172.21.15.1:0/1427316425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f6914106810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:32.492 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 -- 172.21.15.1:0/1427316425 >> 172.21.15.1:0/1427316425 conn(0x7f6914101b80 msgr2=0x7f6914103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 -- 172.21.15.1:0/1427316425 shutdown_connections 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.684+0000 7f691bd15640 1 -- 172.21.15.1:0/1427316425 wait complete. 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f691bd15640 1 Processor -- start 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f691bd15640 1 -- start start 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f691bd15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:32.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f691bd15640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f691410a9c0 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f6919ab1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f6919ab1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50432/0 (socket says 172.21.15.1:50432) 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f6919ab1640 1 -- 172.21.15.1:0/1277171134 learned_addr learned my addr 172.21.15.1:0/1277171134 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f6919ab1640 1 -- 172.21.15.1:0/1277171134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691419bd80 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.685+0000 7f6919ab1640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69100097f0 tx=0x7f6910030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.686+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6910037040 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.686+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6910040070 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.686+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691419c010 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.686+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691003a390 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.686+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691419ed00 con 0x7f6914106410 2024-09-12T02:21:32.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.687+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f6910032900 con 0x7f6914106410 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.687+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6914106890 con 0x7f6914106410 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.687+0000 7f690affd640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 0x7f690003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.687+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f691006c250 con 0x7f6914106410 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.687+0000 7f69192b0640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 0x7f690003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.688+0000 7f69192b0640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 0x7f690003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69040098c0 tx=0x7f6904006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.692+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6910040cc0 con 0x7f6914106410 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.881+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f691402d830 con 0x7f6900038eb0 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.887+0000 7f690affd640 1 -- 172.21.15.1:0/1277171134 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f691402d830 con 0x7f6900038eb0 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 msgr2=0x7f690003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 0x7f690003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f69040098c0 tx=0x7f6904006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:32.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 msgr2=0x7f691419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69100097f0 tx=0x7f6910030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 shutdown_connections 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f6900038eb0 0x7f690003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 --2- 172.21.15.1:0/1277171134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6914106410 0x7f691419b840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 >> 172.21.15.1:0/1277171134 conn(0x7f6914101b80 msgr2=0x7f69141028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 shutdown_connections 2024-09-12T02:21:32.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:31.889+0000 7f691bd15640 1 -- 172.21.15.1:0/1277171134 wait complete. 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: mgrmap e8: x(active, since 2s) 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:32] ENGINE Bus STARTING 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:32] ENGINE Serving on http://172.21.15.1:8765 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:32] ENGINE Serving on https://172.21.15.1:7150 2024-09-12T02:21:33.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:32] ENGINE Bus STARTED 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:32 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:32] ENGINE Error in HTTPServer.serve 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-12T02:21:33.046 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-12T02:21:33.047 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:21:33.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc7483640 1 Processor -- start 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc7483640 1 -- start start 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc7483640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc7483640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc007bde0 con 0x7ffbc0108080 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc521f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc521f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50434/0 (socket says 172.21.15.1:50434) 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.858+0000 7ffbc521f640 1 -- 172.21.15.1:0/1778389152 learned_addr learned my addr 172.21.15.1:0/1778389152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.859+0000 7ffbc521f640 1 -- 172.21.15.1:0/1778389152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc010a9b0 con 0x7ffbc0108080 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.859+0000 7ffbc521f640 1 --2- 172.21.15.1:0/1778389152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009820 tx=0x7ffbbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece0af92f2cebe9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.859+0000 7ffbb7fff640 1 -- 172.21.15.1:0/1778389152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc037070 con 0x7ffbc0108080 2024-09-12T02:21:33.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.859+0000 7ffbb7fff640 1 -- 172.21.15.1:0/1778389152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbbc032900 con 0x7ffbc0108080 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbb7fff640 1 -- 172.21.15.1:0/1778389152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc030850 con 0x7ffbc0108080 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 -- 172.21.15.1:0/1778389152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 msgr2=0x7ffbc010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1778389152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009820 tx=0x7ffbbc02a270 comp rx=0 tx=0).stop 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 -- 172.21.15.1:0/1778389152 shutdown_connections 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1778389152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc010a470 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 -- 172.21.15.1:0/1778389152 >> 172.21.15.1:0/1778389152 conn(0x7ffbc0101c60 msgr2=0x7ffbc0104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 -- 172.21.15.1:0/1778389152 shutdown_connections 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.860+0000 7ffbc7483640 1 -- 172.21.15.1:0/1778389152 wait complete. 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc7483640 1 Processor -- start 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc7483640 1 -- start start 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc7483640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc7483640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010b990 con 0x7ffbc0108080 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc521f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:33.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc521f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50448/0 (socket says 172.21.15.1:50448) 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc521f640 1 -- 172.21.15.1:0/1302743918 learned_addr learned my addr 172.21.15.1:0/1302743918 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc521f640 1 -- 172.21.15.1:0/1302743918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc019bd80 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.861+0000 7ffbc521f640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc032ce0 tx=0x7ffbbc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.862+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc042070 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.862+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbbc0308c0 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.862+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc019c010 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.862+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbbc037040 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.862+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc019ed00 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ffbbc045070 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbb67fc640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 0x7ffbac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc01084e0 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffbbc06c180 con 0x7ffbc0108080 2024-09-12T02:21:33.622 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbc4a1e640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 0x7ffbac03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.863+0000 7ffbc4a1e640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 0x7ffbac03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00098c0 tx=0x7ffbb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:32.868+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffbbc03cc50 con 0x7ffbc0108080 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.045+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7ffbc0062630 con 0x7ffbac038fc0 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.045+0000 7ffbb67fc640 1 -- 172.21.15.1:0/1302743918 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7ffbc0062630 con 0x7ffbac038fc0 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 msgr2=0x7ffbac03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 0x7ffbac03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00098c0 tx=0x7ffbb0006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 msgr2=0x7ffbc019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc032ce0 tx=0x7ffbbc032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 shutdown_connections 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7ffbac038fc0 0x7ffbac03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 --2- 172.21.15.1:0/1302743918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffbc0108080 0x7ffbc019b840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.047+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 >> 172.21.15.1:0/1302743918 conn(0x7ffbc0101c60 msgr2=0x7ffbc0102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.048+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 shutdown_connections 2024-09-12T02:21:33.623 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:33.048+0000 7ffbc7483640 1 -- 172.21.15.1:0/1302743918 wait complete. 2024-09-12T02:21:33.624 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-12T02:21:34.191 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:33 smithi001 ceph-mon[31252]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:34.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: Generating public/private rsa key pair. 2024-09-12T02:21:34.876 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: Your identification has been saved in /tmp/tmpu7ntf7cm/key 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: Your public key has been saved in /tmp/tmpu7ntf7cm/key.pub 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: The key fingerprint is: 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: SHA256:JFFy3u1O2n9zdFY0G/21IiAQUvP2hRrVg6GBWOJIm20 ceph-877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: The key's randomart image is: 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: +---[RSA 3072]----+ 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | . o+**ooo+ .| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: |. *.o.o*++.+ o+| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | + E .=+.o.o .B| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | . .o+ .o . oo| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | .S. + . .| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | = +| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | . o o.| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | . .o| 2024-09-12T02:21:34.877 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: | ..o| 2024-09-12T02:21:34.878 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: +----[SHA256]-----+ 2024-09-12T02:21:35.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31fd7e5640 1 Processor -- start 2024-09-12T02:21:35.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31fd7e5640 1 -- start start 2024-09-12T02:21:35.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31fd7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31fd7e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31f807c7d0 con 0x7f31f807dde0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50452/0 (socket says 172.21.15.1:50452) 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.001+0000 7f31f6ffd640 1 -- 172.21.15.1:0/2115181095 learned_addr learned my addr 172.21.15.1:0/2115181095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.002+0000 7f31f6ffd640 1 -- 172.21.15.1:0/2115181095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f807c950 con 0x7f31f807dde0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.002+0000 7f31f6ffd640 1 --2- 172.21.15.1:0/2115181095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009820 tx=0x7f31e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729c6dbd2d612d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31f67fc640 1 -- 172.21.15.1:0/2115181095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8037070 con 0x7f31f807dde0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31f67fc640 1 -- 172.21.15.1:0/2115181095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31e8032900 con 0x7f31f807dde0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31f67fc640 1 -- 172.21.15.1:0/2115181095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8030850 con 0x7f31f807dde0 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2115181095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 msgr2=0x7f31f807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2115181095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009820 tx=0x7f31e802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2115181095 shutdown_connections 2024-09-12T02:21:35.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2115181095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f807c290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2115181095 >> 172.21.15.1:0/2115181095 conn(0x7f31f8102dc0 msgr2=0x7f31f81051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2115181095 shutdown_connections 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.003+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2115181095 wait complete. 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31fd7e5640 1 Processor -- start 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31fd7e5640 1 -- start start 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31fd7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31fd7e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31f810dc20 con 0x7f31f807dde0 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50466/0 (socket says 172.21.15.1:50466) 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31f6ffd640 1 -- 172.21.15.1:0/2742567575 learned_addr learned my addr 172.21.15.1:0/2742567575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.004+0000 7f31f6ffd640 1 -- 172.21.15.1:0/2742567575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f819dfe0 con 0x7f31f807dde0 2024-09-12T02:21:35.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31f6ffd640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31e8032ce0 tx=0x7f31e8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8042070 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31e80308c0 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f819e270 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8037040 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.005+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81a0f60 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f31e8045070 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31f4ff9640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 0x7f31e403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f31e806c040 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f807c310 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31effff640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 0x7f31e403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.006+0000 7f31effff640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 0x7f31e403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31e00098c0 tx=0x7f31e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.011+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31e804b170 con 0x7f31f807dde0 2024-09-12T02:21:35.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.191+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f31f8062630 con 0x7f31e4038f70 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.597+0000 7f31f4ff9640 1 -- 172.21.15.1:0/2742567575 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f31f8062630 con 0x7f31e4038f70 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 msgr2=0x7f31e403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 0x7f31e403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f31e00098c0 tx=0x7f31e0006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 msgr2=0x7f31f819daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31e8032ce0 tx=0x7f31e8032d10 comp rx=0 tx=0).stop 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 shutdown_connections 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f31e4038f70 0x7f31e403b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 --2- 172.21.15.1:0/2742567575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31f807dde0 0x7f31f819daa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 >> 172.21.15.1:0/2742567575 conn(0x7f31f8102dc0 msgr2=0x7f31f8103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 shutdown_connections 2024-09-12T02:21:35.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:34.599+0000 7f31fd7e5640 1 -- 172.21.15.1:0/2742567575 wait complete. 2024-09-12T02:21:35.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:35 smithi001 ceph-mon[31252]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:35.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:35 smithi001 ceph-mon[31252]: Generating ssh key... 2024-09-12T02:21:35.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:35 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:35.827 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:35 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:36.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:21:36.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.638+0000 7faadeec6640 1 Processor -- start 2024-09-12T02:21:36.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.638+0000 7faadeec6640 1 -- start start 2024-09-12T02:21:36.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadeec6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:36.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadeec6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faad8107fc0 con 0x7faad81075f0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadcc62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadcc62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50468/0 (socket says 172.21.15.1:50468) 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadcc62640 1 -- 172.21.15.1:0/1118003699 learned_addr learned my addr 172.21.15.1:0/1118003699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.639+0000 7faadcc62640 1 -- 172.21.15.1:0/1118003699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad81087a0 con 0x7faad81075f0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.640+0000 7faadcc62640 1 --2- 172.21.15.1:0/1118003699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faac0009820 tx=0x7faac002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e3c0ab696e2fad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.640+0000 7faad77fe640 1 -- 172.21.15.1:0/1118003699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0037070 con 0x7faad81075f0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.640+0000 7faad77fe640 1 -- 172.21.15.1:0/1118003699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faac0032900 con 0x7faad81075f0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.640+0000 7faad77fe640 1 -- 172.21.15.1:0/1118003699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0030850 con 0x7faad81075f0 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- 172.21.15.1:0/1118003699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 msgr2=0x7faad81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 --2- 172.21.15.1:0/1118003699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faac0009820 tx=0x7faac002a270 comp rx=0 tx=0).stop 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- 172.21.15.1:0/1118003699 shutdown_connections 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 --2- 172.21.15.1:0/1118003699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad81079f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- 172.21.15.1:0/1118003699 >> 172.21.15.1:0/1118003699 conn(0x7faad8102dc0 msgr2=0x7faad81051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- 172.21.15.1:0/1118003699 shutdown_connections 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- 172.21.15.1:0/1118003699 wait complete. 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 Processor -- start 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 -- start start 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.641+0000 7faadeec6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadeec6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faad810bb50 con 0x7faad81075f0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadcc62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadcc62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50478/0 (socket says 172.21.15.1:50478) 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadcc62640 1 -- 172.21.15.1:0/1427007211 learned_addr learned my addr 172.21.15.1:0/1427007211 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadcc62640 1 -- 172.21.15.1:0/1427007211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad819e020 con 0x7faad81075f0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadcc62640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faac00097f0 tx=0x7faac0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0037040 con 0x7faad81075f0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faac0040070 con 0x7faad81075f0 2024-09-12T02:21:36.401 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad819e2b0 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac003a390 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.642+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81a0fa0 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.643+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faac003a630 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.644+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad8107a70 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.644+0000 7faad5ffb640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 0x7faac403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.644+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faac006c4c0 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.644+0000 7faad7fff640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 0x7faac403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.644+0000 7faad7fff640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 0x7faac403b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faac800ad30 tx=0x7faac80093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.649+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faac004a200 con 0x7faad81075f0 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.826+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7faad802d830 con 0x7faac4038f70 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.827+0000 7faad5ffb640 1 -- 172.21.15.1:0/1427007211 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7faad802d830 con 0x7faac4038f70 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 msgr2=0x7faac403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 0x7faac403b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faac800ad30 tx=0x7faac80093f0 comp rx=0 tx=0).stop 2024-09-12T02:21:36.402 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 msgr2=0x7faad819dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faac00097f0 tx=0x7faac0030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 shutdown_connections 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7faac4038f70 0x7faac403b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 --2- 172.21.15.1:0/1427007211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faad81075f0 0x7faad819dae0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 >> 172.21.15.1:0/1427007211 conn(0x7faad8102dc0 msgr2=0x7faad8103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 shutdown_connections 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:35.829+0000 7faadeec6640 1 -- 172.21.15.1:0/1427007211 wait complete. 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:21:36.403 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T02:21:36.404 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-12T02:21:37.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:36 smithi001 ceph-mon[31252]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:38.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:37 smithi001 ceph-mon[31252]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:38.770 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:38 smithi001 ceph-mon[31252]: Deploying cephadm binary to smithi001 2024-09-12T02:21:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-12T02:21:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.924+0000 7fba2fed2640 1 Processor -- start 2024-09-12T02:21:41.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2fed2640 1 -- start start 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2fed2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2fed2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba28106e30 con 0x7fba28106460 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2dc6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2dc6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50482/0 (socket says 172.21.15.1:50482) 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2dc6e640 1 -- 172.21.15.1:0/2540940578 learned_addr learned my addr 172.21.15.1:0/2540940578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.925+0000 7fba2dc6e640 1 -- 172.21.15.1:0/2540940578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba28107660 con 0x7fba28106460 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.926+0000 7fba2dc6e640 1 --2- 172.21.15.1:0/2540940578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba24009820 tx=0x7fba2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1fcbf8449180e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.926+0000 7fba2cc6c640 1 -- 172.21.15.1:0/2540940578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba24037070 con 0x7fba28106460 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.926+0000 7fba2cc6c640 1 -- 172.21.15.1:0/2540940578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba24032900 con 0x7fba28106460 2024-09-12T02:21:41.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.926+0000 7fba2cc6c640 1 -- 172.21.15.1:0/2540940578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba24030850 con 0x7fba28106460 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 -- 172.21.15.1:0/2540940578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 msgr2=0x7fba28106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 --2- 172.21.15.1:0/2540940578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba24009820 tx=0x7fba2402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 -- 172.21.15.1:0/2540940578 shutdown_connections 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 --2- 172.21.15.1:0/2540940578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba28106860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 -- 172.21.15.1:0/2540940578 >> 172.21.15.1:0/2540940578 conn(0x7fba28101c30 msgr2=0x7fba28104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 -- 172.21.15.1:0/2540940578 shutdown_connections 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.927+0000 7fba2fed2640 1 -- 172.21.15.1:0/2540940578 wait complete. 2024-09-12T02:21:41.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2fed2640 1 Processor -- start 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2fed2640 1 -- start start 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2fed2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2fed2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba2810aa10 con 0x7fba28106460 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2dc6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2dc6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50496/0 (socket says 172.21.15.1:50496) 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2dc6e640 1 -- 172.21.15.1:0/3402670724 learned_addr learned my addr 172.21.15.1:0/3402670724 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2dc6e640 1 -- 172.21.15.1:0/3402670724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2819be00 con 0x7fba28106460 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.928+0000 7fba2dc6e640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba240097f0 tx=0x7fba24030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.929+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba24037040 con 0x7fba28106460 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.929+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba24040070 con 0x7fba28106460 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.929+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2403a390 con 0x7fba28106460 2024-09-12T02:21:41.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.929+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2819c090 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.929+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2819ed80 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fba24032900 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba1effd640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 0x7fba1403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba281068e0 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fba2406c440 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba2d46d640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 0x7fba1403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.930+0000 7fba2d46d640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 0x7fba1403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba180098c0 tx=0x7fba18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:36.935+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba24044ca0 con 0x7fba28106460 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:37.117+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}) -- 0x7fba28062630 con 0x7fba14038fc0 2024-09-12T02:21:41.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.005+0000 7fba1effd640 1 -- 172.21.15.1:0/3402670724 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fba28062630 con 0x7fba14038fc0 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 msgr2=0x7fba1403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 0x7fba1403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba180098c0 tx=0x7fba18006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 msgr2=0x7fba2819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba240097f0 tx=0x7fba24030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 shutdown_connections 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fba14038fc0 0x7fba1403b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 --2- 172.21.15.1:0/3402670724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba28106460 0x7fba2819b8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 >> 172.21.15.1:0/3402670724 conn(0x7fba28101c30 msgr2=0x7fba28102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 shutdown_connections 2024-09-12T02:21:41.621 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:41.008+0000 7fba2fed2640 1 -- 172.21.15.1:0/3402670724 wait complete. 2024-09-12T02:21:41.622 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-12T02:21:42.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:42 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:42.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:42 smithi001 ceph-mon[31252]: Added host smithi001 2024-09-12T02:21:42.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:42 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16aae96640 1 Processor -- start 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16aae96640 1 -- start start 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16aae96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16aae96640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16a4106220 con 0x7f16a4105850 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16a8c32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16a8c32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54274/0 (socket says 172.21.15.1:54274) 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.048+0000 7f16a8c32640 1 -- 172.21.15.1:0/957745889 learned_addr learned my addr 172.21.15.1:0/957745889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:43.092 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.049+0000 7f16a8c32640 1 -- 172.21.15.1:0/957745889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a4108830 con 0x7f16a4105850 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.049+0000 7f16a8c32640 1 --2- 172.21.15.1:0/957745889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1698009820 tx=0x7f169802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db38d869752ffc5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16a37fe640 1 -- 172.21.15.1:0/957745889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698037070 con 0x7f16a4105850 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16a37fe640 1 -- 172.21.15.1:0/957745889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1698032900 con 0x7f16a4105850 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16a37fe640 1 -- 172.21.15.1:0/957745889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698030850 con 0x7f16a4105850 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 -- 172.21.15.1:0/957745889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 msgr2=0x7f16a4105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 --2- 172.21.15.1:0/957745889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1698009820 tx=0x7f169802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 -- 172.21.15.1:0/957745889 shutdown_connections 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 --2- 172.21.15.1:0/957745889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a4105c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 -- 172.21.15.1:0/957745889 >> 172.21.15.1:0/957745889 conn(0x7f16a4101400 msgr2=0x7f16a4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 -- 172.21.15.1:0/957745889 shutdown_connections 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.050+0000 7f16aae96640 1 -- 172.21.15.1:0/957745889 wait complete. 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16aae96640 1 Processor -- start 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16aae96640 1 -- start start 2024-09-12T02:21:43.093 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16aae96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16aae96640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ba60 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16a8c32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16a8c32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54280/0 (socket says 172.21.15.1:54280) 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.051+0000 7f16a8c32640 1 -- 172.21.15.1:0/3232352866 learned_addr learned my addr 172.21.15.1:0/3232352866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16a8c32640 1 -- 172.21.15.1:0/3232352866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a41085f0 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16a8c32640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16980097f0 tx=0x7f1698030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698037040 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1698040070 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a41067e0 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169803a390 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.052+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a4106cc0 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.053+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f169803a5e0 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.053+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4105cd0 con 0x7f16a4105850 2024-09-12T02:21:43.094 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.053+0000 7f16a1ffb640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 0x7f169403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.053+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f169806c700 con 0x7f16a4105850 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.053+0000 7f16a3fff640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 0x7f169403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.054+0000 7f16a3fff640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 0x7f169403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f16900098c0 tx=0x7f1690006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.058+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1698043760 con 0x7f16a4105850 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.258+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f16a4107610 con 0x7f1694038fc0 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.264+0000 7f16a1ffb640 1 -- 172.21.15.1:0/3232352866 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f16a4107610 con 0x7f1694038fc0 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 msgr2=0x7f169403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 0x7f169403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f16900098c0 tx=0x7f1690006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 msgr2=0x7f16a41080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16980097f0 tx=0x7f1698030d80 comp rx=0 tx=0).stop 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 shutdown_connections 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f1694038fc0 0x7f169403b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 --2- 172.21.15.1:0/3232352866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16a4105850 0x7f16a41080b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 >> 172.21.15.1:0/3232352866 conn(0x7f16a4101400 msgr2=0x7f16a4101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 shutdown_connections 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:42.267+0000 7f16aae96640 1 -- 172.21.15.1:0/3232352866 wait complete. 2024-09-12T02:21:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-12T02:21:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:43 smithi001 ceph-mon[31252]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:43 smithi001 ceph-mon[31252]: Saving service mon spec with placement count:5 2024-09-12T02:21:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:43 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:44.754 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.623+0000 7f45ef31b640 1 Processor -- start 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.623+0000 7f45ef31b640 1 -- start start 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ef31b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ef31b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45e8106de0 con 0x7f45e8106410 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ed0b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ed0b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54284/0 (socket says 172.21.15.1:54284) 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ed0b7640 1 -- 172.21.15.1:0/3764509727 learned_addr learned my addr 172.21.15.1:0/3764509727 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.624+0000 7f45ed0b7640 1 -- 172.21.15.1:0/3764509727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e8107610 con 0x7f45e8106410 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.625+0000 7f45ed0b7640 1 --2- 172.21.15.1:0/3764509727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e80 tx=0x7f45e002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16f4c4e9e3bf391 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.625+0000 7f45e7fff640 1 -- 172.21.15.1:0/3764509727 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0036070 con 0x7f45e8106410 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.625+0000 7f45e7fff640 1 -- 172.21.15.1:0/3764509727 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45e00318c0 con 0x7f45e8106410 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.625+0000 7f45e7fff640 1 -- 172.21.15.1:0/3764509727 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0007ab0 con 0x7f45e8106410 2024-09-12T02:21:44.755 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 -- 172.21.15.1:0/3764509727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 msgr2=0x7f45e8106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 --2- 172.21.15.1:0/3764509727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e80 tx=0x7f45e002a7a0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 -- 172.21.15.1:0/3764509727 shutdown_connections 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 --2- 172.21.15.1:0/3764509727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e8106810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 -- 172.21.15.1:0/3764509727 >> 172.21.15.1:0/3764509727 conn(0x7f45e8101b80 msgr2=0x7f45e8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 -- 172.21.15.1:0/3764509727 shutdown_connections 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.626+0000 7f45ef31b640 1 -- 172.21.15.1:0/3764509727 wait complete. 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ef31b640 1 Processor -- start 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ef31b640 1 -- start start 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ef31b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ef31b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45e810a9c0 con 0x7f45e8106410 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ed0b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ed0b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54288/0 (socket says 172.21.15.1:54288) 2024-09-12T02:21:44.756 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ed0b7640 1 -- 172.21.15.1:0/1808378252 learned_addr learned my addr 172.21.15.1:0/1808378252 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.627+0000 7f45ed0b7640 1 -- 172.21.15.1:0/1808378252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e819bdb0 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45ed0b7640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45e002ad90 tx=0x7f45e0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0036050 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45e0042070 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e819c040 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e003d7e0 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.628+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e819ed30 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.629+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f45e003dae0 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.629+0000 7f45e67fc640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 0x7f45d003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.629+0000 7f45ec8b6640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 0x7f45d003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.629+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45e0007e00 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.629+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e810ab40 con 0x7f45e8106410 2024-09-12T02:21:44.757 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.630+0000 7f45ec8b6640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 0x7f45d003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0098c0 tx=0x7f45dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.635+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e003de20 con 0x7f45e8106410 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.827+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f45e8062630 con 0x7f45d0038f70 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.831+0000 7f45e67fc640 1 -- 172.21.15.1:0/1808378252 <== mgr.14118 v2:172.21.15.1:6800/556592053 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f45e8062630 con 0x7f45d0038f70 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 msgr2=0x7f45d003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 0x7f45d003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0098c0 tx=0x7f45dc006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 msgr2=0x7f45e819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45e002ad90 tx=0x7f45e0031ca0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 shutdown_connections 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f45d0038f70 0x7f45d003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 --2- 172.21.15.1:0/1808378252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45e8106410 0x7f45e819b870 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45e002ad90 tx=0x7f45e0031ca0 comp rx=0 tx=0).stop 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.833+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 >> 172.21.15.1:0/1808378252 conn(0x7f45e8101b80 msgr2=0x7f45e8102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:44.758 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.834+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 shutdown_connections 2024-09-12T02:21:44.759 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:43.834+0000 7f45ef31b640 1 -- 172.21.15.1:0/1808378252 wait complete. 2024-09-12T02:21:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:44 smithi001 ceph-mon[31252]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:44 smithi001 ceph-mon[31252]: Saving service mgr spec with placement count:2 2024-09-12T02:21:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:44 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:46.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.137+0000 7f96537a1640 1 Processor -- start 2024-09-12T02:21:46.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f96537a1640 1 -- start start 2024-09-12T02:21:46.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f96537a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f96537a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f964c10a240 con 0x7f964c109870 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f965153d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f965153d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54290/0 (socket says 172.21.15.1:54290) 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f965153d640 1 -- 172.21.15.1:0/831554730 learned_addr learned my addr 172.21.15.1:0/831554730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.138+0000 7f965153d640 1 -- 172.21.15.1:0/831554730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c10a980 con 0x7f964c109870 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.139+0000 7f965153d640 1 --2- 172.21.15.1:0/831554730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9648009820 tx=0x7f964802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39318400dedd6941 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.139+0000 7f9643fff640 1 -- 172.21.15.1:0/831554730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9648037070 con 0x7f964c109870 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.139+0000 7f9643fff640 1 -- 172.21.15.1:0/831554730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9648032900 con 0x7f964c109870 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.139+0000 7f9643fff640 1 -- 172.21.15.1:0/831554730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9648030850 con 0x7f964c109870 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 -- 172.21.15.1:0/831554730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 msgr2=0x7f964c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 --2- 172.21.15.1:0/831554730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9648009820 tx=0x7f964802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 -- 172.21.15.1:0/831554730 shutdown_connections 2024-09-12T02:21:46.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 --2- 172.21.15.1:0/831554730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c109c70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 -- 172.21.15.1:0/831554730 >> 172.21.15.1:0/831554730 conn(0x7f964c07cdc0 msgr2=0x7f964c07d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 -- 172.21.15.1:0/831554730 shutdown_connections 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.140+0000 7f96537a1640 1 -- 172.21.15.1:0/831554730 wait complete. 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f96537a1640 1 Processor -- start 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f96537a1640 1 -- start start 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f96537a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f96537a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f964c10dd30 con 0x7f964c109870 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f965153d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f965153d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54300/0 (socket says 172.21.15.1:54300) 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f965153d640 1 -- 172.21.15.1:0/715430289 learned_addr learned my addr 172.21.15.1:0/715430289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f965153d640 1 -- 172.21.15.1:0/715430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c19dfc0 con 0x7f964c109870 2024-09-12T02:21:46.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.141+0000 7f965153d640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9648009940 tx=0x7f9648032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.142+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9648042070 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.142+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c19e250 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.142+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96480308c0 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.142+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9648037040 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.142+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a0f40 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.143+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9648045070 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.143+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c10deb0 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.143+0000 7f96427fc640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 0x7f963803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.143+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f964806c070 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.143+0000 7f9650d3c640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 0x7f963803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.144+0000 7f9650d3c640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 0x7f963803b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098c0 tx=0x7f963c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.148+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f964804b170 con 0x7f964c109870 2024-09-12T02:21:46.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.321+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f964c109cf0 con 0x7f964c109870 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.324+0000 7f96427fc640 1 -- 172.21.15.1:0/715430289 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f964803cd90 con 0x7f964c109870 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 msgr2=0x7f963803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 0x7f963803b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098c0 tx=0x7f963c006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 msgr2=0x7f964c19da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9648009940 tx=0x7f9648032ce0 comp rx=0 tx=0).stop 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 shutdown_connections 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f9638038f70 0x7f963803b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 --2- 172.21.15.1:0/715430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f964c109870 0x7f964c19da80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 >> 172.21.15.1:0/715430289 conn(0x7f964c07cdc0 msgr2=0x7f964c107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 shutdown_connections 2024-09-12T02:21:46.226 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:45.327+0000 7f96537a1640 1 -- 172.21.15.1:0/715430289 wait complete. 2024-09-12T02:21:46.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:46 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/715430289' entity='client.admin' 2024-09-12T02:21:46.541 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:46 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:47.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.629+0000 7f236f367640 1 Processor -- start 2024-09-12T02:21:47.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.629+0000 7f236f367640 1 -- start start 2024-09-12T02:21:47.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236f367640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:47.395 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236f367640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2368106220 con 0x7f2368105850 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236d103640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236d103640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54316/0 (socket says 172.21.15.1:54316) 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236d103640 1 -- 172.21.15.1:0/592356813 learned_addr learned my addr 172.21.15.1:0/592356813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.630+0000 7f236d103640 1 -- 172.21.15.1:0/592356813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368108830 con 0x7f2368105850 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f236d103640 1 --2- 172.21.15.1:0/592356813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2364009820 tx=0x7f236402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d83003390fa118d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f235ffff640 1 -- 172.21.15.1:0/592356813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2364037070 con 0x7f2368105850 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f235ffff640 1 -- 172.21.15.1:0/592356813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2364032920 con 0x7f2368105850 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f235ffff640 1 -- 172.21.15.1:0/592356813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2364030810 con 0x7f2368105850 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f236f367640 1 -- 172.21.15.1:0/592356813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 msgr2=0x7f2368105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.631+0000 7f236f367640 1 --2- 172.21.15.1:0/592356813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2364009820 tx=0x7f236402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 -- 172.21.15.1:0/592356813 shutdown_connections 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 --2- 172.21.15.1:0/592356813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f2368105c50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:47.396 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 -- 172.21.15.1:0/592356813 >> 172.21.15.1:0/592356813 conn(0x7f2368101400 msgr2=0x7f2368103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 -- 172.21.15.1:0/592356813 shutdown_connections 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 -- 172.21.15.1:0/592356813 wait complete. 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 Processor -- start 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.632+0000 7f236f367640 1 -- start start 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236f367640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236f367640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f236810ba60 con 0x7f2368105850 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236d103640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236d103640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54326/0 (socket says 172.21.15.1:54326) 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236d103640 1 -- 172.21.15.1:0/1542792760 learned_addr learned my addr 172.21.15.1:0/1542792760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236d103640 1 -- 172.21.15.1:0/1542792760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23681085f0 con 0x7f2368105850 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236d103640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2364030560 tx=0x7f2364032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:47.397 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2364037040 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2364040070 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23681067e0 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236403a740 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.633+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2368106d20 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.634+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f236403a9b0 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.634+0000 7f235e7fc640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 0x7f235403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.634+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2368105cd0 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.635+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f236406c560 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.635+0000 7f236c902640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 0x7f235403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.635+0000 7f236c902640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 0x7f235403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23580098c0 tx=0x7f2358006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.639+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2364041270 con 0x7f2368105850 2024-09-12T02:21:47.398 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.821+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f2368107670 con 0x7f2368105850 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.824+0000 7f235e7fc640 1 -- 172.21.15.1:0/1542792760 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f2368107670 con 0x7f2368105850 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 msgr2=0x7f235403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 0x7f235403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23580098c0 tx=0x7f2358006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 msgr2=0x7f23681080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2364030560 tx=0x7f2364032670 comp rx=0 tx=0).stop 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 shutdown_connections 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f2354038f70 0x7f235403b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 --2- 172.21.15.1:0/1542792760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2368105850 0x7f23681080b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 >> 172.21.15.1:0/1542792760 conn(0x7f2368101400 msgr2=0x7f2368101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 shutdown_connections 2024-09-12T02:21:47.399 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:46.826+0000 7f236f367640 1 -- 172.21.15.1:0/1542792760 wait complete. 2024-09-12T02:21:47.400 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-12T02:21:48.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:47 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:48.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:47 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1542792760' entity='client.admin' 2024-09-12T02:21:48.919 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1163891831' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T02:21:48.919 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-mon[31252]: from='mgr.14118 172.21.15.1:0/4032058563' entity='mgr.x' 2024-09-12T02:21:48.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ignoring --setuser ceph since I am not root 2024-09-12T02:21:48.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ignoring --setgroup ceph since I am not root 2024-09-12T02:21:48.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:48.919+0000 7fd1ea219040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:21:49.173 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:48.984+0000 7fd1ea219040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:49.173 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.151+0000 7fd1ea219040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.799+0000 7f3fd3c42640 1 Processor -- start 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.799+0000 7f3fd3c42640 1 -- start start 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd3c42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd3c42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc106de0 con 0x7f3fcc106410 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd19de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd19de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54332/0 (socket says 172.21.15.1:54332) 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd19de640 1 -- 172.21.15.1:0/2542840159 learned_addr learned my addr 172.21.15.1:0/2542840159 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.800+0000 7f3fd19de640 1 -- 172.21.15.1:0/2542840159 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc107610 con 0x7f3fcc106410 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd19de640 1 --2- 172.21.15.1:0/2542840159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009820 tx=0x7f3fc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc86791beeeb9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd09dc640 1 -- 172.21.15.1:0/2542840159 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8037070 con 0x7f3fcc106410 2024-09-12T02:21:49.368 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd09dc640 1 -- 172.21.15.1:0/2542840159 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fc8032920 con 0x7f3fcc106410 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd09dc640 1 -- 172.21.15.1:0/2542840159 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8030810 con 0x7f3fcc106410 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd3c42640 1 -- 172.21.15.1:0/2542840159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 msgr2=0x7f3fcc106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.801+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/2542840159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009820 tx=0x7f3fc802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- 172.21.15.1:0/2542840159 shutdown_connections 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/2542840159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc106810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- 172.21.15.1:0/2542840159 >> 172.21.15.1:0/2542840159 conn(0x7f3fcc101b80 msgr2=0x7f3fcc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- 172.21.15.1:0/2542840159 shutdown_connections 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- 172.21.15.1:0/2542840159 wait complete. 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 Processor -- start 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- start start 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.802+0000 7f3fd3c42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc10a9c0 con 0x7f3fcc106410 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd19de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:49.369 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd19de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54344/0 (socket says 172.21.15.1:54344) 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd19de640 1 -- 172.21.15.1:0/1163891831 learned_addr learned my addr 172.21.15.1:0/1163891831 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd19de640 1 -- 172.21.15.1:0/1163891831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc19ac80 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd19de640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097f0 tx=0x7f3fc80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8037040 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fc8030cc0 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc19af10 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc803a640 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.803+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc19dc00 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.804+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3fc803b3f0 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.804+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc10ab40 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.804+0000 7f3fc2ffd640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 0x7f3fb803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.804+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fc806c4e0 con 0x7f3fcc106410 2024-09-12T02:21:49.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.804+0000 7f3fd11dd640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 0x7f3fb803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.805+0000 7f3fd11dd640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 0x7f3fb803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0098c0 tx=0x7f3fbc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:47.809+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fc8042e10 con 0x7f3fcc106410 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.035+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3fcc02d7c0 con 0x7f3fcc106410 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.754+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3fc803ba40 con 0x7f3fcc106410 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.756+0000 7f3fc2ffd640 1 -- 172.21.15.1:0/1163891831 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f3fc8049ca0 con 0x7f3fcc106410 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.756+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 msgr2=0x7f3fb803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.756+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 0x7f3fb803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0098c0 tx=0x7f3fbc006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 msgr2=0x7f3fcc19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097f0 tx=0x7f3fc80327b0 comp rx=0 tx=0).stop 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 shutdown_connections 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f3fb8038f70 0x7f3fb803b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:49.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 --2- 172.21.15.1:0/1163891831 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fcc106410 0x7f3fcc19a740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:49.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 >> 172.21.15.1:0/1163891831 conn(0x7f3fcc101b80 msgr2=0x7f3fcc102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:49.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 shutdown_connections 2024-09-12T02:21:49.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:48.757+0000 7f3fd3c42640 1 -- 172.21.15.1:0/1163891831 wait complete. 2024-09-12T02:21:49.485 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.223+0000 7fd1ea219040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:21:49.485 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.383+0000 7fd1ea219040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:49.754 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.535+0000 7fd1ea219040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:21:50.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1163891831' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T02:21:50.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-mon[31252]: mgrmap e9: x(active, since 19s) 2024-09-12T02:21:50.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.873+0000 7fd1ea219040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:21:50.093 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:49.940+0000 7fd1ea219040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:21:50.375 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:50.138+0000 7fd1ea219040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:21:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T02:21:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:21:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:21:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.884+0000 7fd293fe6640 1 Processor -- start 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd293fe6640 1 -- start start 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd293fe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd293fe6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c07be60 con 0x7fd28c107f80 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd291d82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd291d82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54370/0 (socket says 172.21.15.1:54370) 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.885+0000 7fd291d82640 1 -- 172.21.15.1:0/2333371461 learned_addr learned my addr 172.21.15.1:0/2333371461 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.886+0000 7fd291d82640 1 -- 172.21.15.1:0/2333371461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c10a8b0 con 0x7fd28c107f80 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.886+0000 7fd291d82640 1 --2- 172.21.15.1:0/2333371461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd288009820 tx=0x7fd28802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4341e6ba2a1f2b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:50.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.886+0000 7fd290d80640 1 -- 172.21.15.1:0/2333371461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd288037070 con 0x7fd28c107f80 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.887+0000 7fd290d80640 1 -- 172.21.15.1:0/2333371461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd288032920 con 0x7fd28c107f80 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.887+0000 7fd290d80640 1 -- 172.21.15.1:0/2333371461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd288030810 con 0x7fd28c107f80 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.887+0000 7fd293fe6640 1 -- 172.21.15.1:0/2333371461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 msgr2=0x7fd28c10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.887+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2333371461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd288009820 tx=0x7fd28802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- 172.21.15.1:0/2333371461 shutdown_connections 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2333371461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c10a370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- 172.21.15.1:0/2333371461 >> 172.21.15.1:0/2333371461 conn(0x7fd28c101b80 msgr2=0x7fd28c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- 172.21.15.1:0/2333371461 shutdown_connections 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- 172.21.15.1:0/2333371461 wait complete. 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 Processor -- start 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- start start 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:50.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.888+0000 7fd293fe6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c10b990 con 0x7fd28c107f80 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd291d82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd291d82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54372/0 (socket says 172.21.15.1:54372) 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd291d82640 1 -- 172.21.15.1:0/2315824389 learned_addr learned my addr 172.21.15.1:0/2315824389 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd291d82640 1 -- 172.21.15.1:0/2315824389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c107d40 con 0x7fd28c107f80 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd291d82640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097f0 tx=0x7fd2880327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd288037040 con 0x7fd28c107f80 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd288030cc0 con 0x7fd28c107f80 2024-09-12T02:21:50.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c105f30 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd28803a6b0 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.889+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c106470 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.890+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd28803a8a0 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.890+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c1083e0 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.891+0000 7fd282ffd640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 0x7fd27803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.891+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd28806c540 con 0x7fd28c107f80 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.891+0000 7fd291581640 1 -- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 msgr2=0x7fd27803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:50.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.891+0000 7fd291581640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 0x7fd27803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:49.895+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd28803ace0 con 0x7fd28c107f80 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.092+0000 7fd291581640 1 -- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 msgr2=0x7fd27803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.092+0000 7fd291581640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 0x7fd27803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.124+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd28c194f60 con 0x7fd28c107f80 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.124+0000 7fd282ffd640 1 -- 172.21.15.1:0/2315824389 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd28802fd40 con 0x7fd28c107f80 2024-09-12T02:21:50.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 msgr2=0x7fd27803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 0x7fd27803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 msgr2=0x7fd28c107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097f0 tx=0x7fd2880327b0 comp rx=0 tx=0).stop 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 shutdown_connections 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7fd278038fc0 0x7fd27803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 --2- 172.21.15.1:0/2315824389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd28c107f80 0x7fd28c107800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:50.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 >> 172.21.15.1:0/2315824389 conn(0x7fd28c101b80 msgr2=0x7fd28c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:50.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 shutdown_connections 2024-09-12T02:21:50.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:50.127+0000 7fd293fe6640 1 -- 172.21.15.1:0/2315824389 wait complete. 2024-09-12T02:21:50.748 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-12T02:21:50.748 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-12T02:21:51.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:50 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2315824389' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:21:51.336 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:51.077+0000 7fd1ea219040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:21:51.336 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:51.150+0000 7fd1ea219040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:21:52.021 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:51.900+0000 7fd1ea219040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:21:52.021 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.021+0000 7fd1ea219040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:21:52.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.170+0000 7fd1ea219040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:21:52.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.234+0000 7fd1ea219040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:21:52.691 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.391+0000 7fd1ea219040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:21:52.691 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.462+0000 7fd1ea219040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:21:52.691 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.524+0000 7fd1ea219040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:21:52.691 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.691+0000 7fd1ea219040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:21:52.978 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.759+0000 7fd1ea219040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:21:52.978 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.828+0000 7fd1ea219040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:21:52.978 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.915+0000 7fd1ea219040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:21:52.978 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:52.977+0000 7fd1ea219040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:21:53.376 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:53.039+0000 7fd1ea219040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:21:54.125 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:53.868+0000 7fd1ea219040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: Active manager daemon x restarted 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: Activating manager daemon x 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: mgrmap e10: x(active, starting, since 0.00340672s) 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:21:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:21:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:21:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: Manager daemon x is now available 2024-09-12T02:21:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:21:54.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:21:55.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:21:55.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T02:21:55.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:21:55.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f48a5a8f640 1 Processor -- start 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f48a5a8f640 1 -- start start 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f48a5a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f48a5a8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48a007be20 con 0x7f48a0107ff0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f489f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f489f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50854/0 (socket says 172.21.15.1:50854) 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.129+0000 7f489f7fe640 1 -- 172.21.15.1:0/1669366251 learned_addr learned my addr 172.21.15.1:0/1669366251 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.130+0000 7f489f7fe640 1 -- 172.21.15.1:0/1669366251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a010a920 con 0x7f48a0107ff0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.130+0000 7f489f7fe640 1 --2- 172.21.15.1:0/1669366251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4890009820 tx=0x7f489002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e298b43fa4e616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f489e7fc640 1 -- 172.21.15.1:0/1669366251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4890037070 con 0x7f48a0107ff0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f489e7fc640 1 -- 172.21.15.1:0/1669366251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4890032920 con 0x7f48a0107ff0 2024-09-12T02:21:55.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f489e7fc640 1 -- 172.21.15.1:0/1669366251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4890030810 con 0x7f48a0107ff0 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 -- 172.21.15.1:0/1669366251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 msgr2=0x7f48a010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/1669366251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4890009820 tx=0x7f489002a270 comp rx=0 tx=0).stop 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 -- 172.21.15.1:0/1669366251 shutdown_connections 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/1669366251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a010a3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 -- 172.21.15.1:0/1669366251 >> 172.21.15.1:0/1669366251 conn(0x7f48a0101b90 msgr2=0x7f48a0104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 -- 172.21.15.1:0/1669366251 shutdown_connections 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.131+0000 7f48a5a8f640 1 -- 172.21.15.1:0/1669366251 wait complete. 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.132+0000 7f48a5a8f640 1 Processor -- start 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.132+0000 7f48a5a8f640 1 -- start start 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.132+0000 7f48a5a8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.132+0000 7f48a5a8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010b9a0 con 0x7f48a0107ff0 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:55.688 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50866/0 (socket says 172.21.15.1:50866) 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489f7fe640 1 -- 172.21.15.1:0/890642607 learned_addr learned my addr 172.21.15.1:0/890642607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489f7fe640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a0107db0 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489f7fe640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4890030380 tx=0x7f4890032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4890037040 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4890040070 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a0105fa0 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489003a7b0 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.133+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a01064e0 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.134+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f489003aa30 con 0x7f48a0107ff0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.134+0000 7f489cff9640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.134+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f488803bb90 con 0x7f4888038fc0 2024-09-12T02:21:55.689 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.135+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f489006c6e0 con 0x7f48a0107ff0 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.135+0000 7f489effd640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 msgr2=0x7f488803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.135+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.336+0000 7f489effd640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 msgr2=0x7f488803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.336+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.737+0000 7f489effd640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 msgr2=0x7f488803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:51.737+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:52.538+0000 7f489effd640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 msgr2=0x7f488803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/556592053 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:52.538+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:53.872+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f489006b190 con 0x7f48a0107ff0 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:53.872+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 msgr2=0x7f488803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:21:55.690 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:53.872+0000 7f489cff9640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.874+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f4890045460 con 0x7f48a0107ff0 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.874+0000 7f489cff9640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 0x7f488803ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.874+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f489003cec0 con 0x7f488803ca80 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.874+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 0x7f488803ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.875+0000 7f489effd640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 0x7f488803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4894003980 tx=0x7f4894006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.876+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f489003cec0 con 0x7f488803ca80 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f48a0108450 con 0x7f488803ca80 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f489cff9640 1 -- 172.21.15.1:0/890642607 <== mgr.14150 v2:172.21.15.1:6800/3015676599 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f48a0108450 con 0x7f488803ca80 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 msgr2=0x7f488803ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 0x7f488803ee70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4894003980 tx=0x7f4894006e10 comp rx=0 tx=0).stop 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 msgr2=0x7f48a0107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4890030380 tx=0x7f4890032670 comp rx=0 tx=0).stop 2024-09-12T02:21:55.691 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 shutdown_connections 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f488803ca80 0x7f488803ee70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:6800/556592053,v1:172.21.15.1:6801/556592053] conn(0x7f4888038fc0 0x7f488803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 --2- 172.21.15.1:0/890642607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48a0107ff0 0x7f48a0107870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 >> 172.21.15.1:0/890642607 conn(0x7f48a0101b90 msgr2=0x7f48a01029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 shutdown_connections 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:54.883+0000 7f48a5a8f640 1 -- 172.21.15.1:0/890642607 wait complete. 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-12T02:21:55.692 INFO:teuthology.orchestra.run.smithi001.stdout:Generating a dashboard self-signed certificate... 2024-09-12T02:21:56.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:55 smithi001 ceph-mon[31252]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:21:56.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:55 smithi001 ceph-mon[31252]: mgrmap e11: x(active, since 1.00601s) 2024-09-12T02:21:56.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:55 smithi001 ceph-mon[31252]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:21:56.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:56.002+0000 7fd15552d640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:21:56] ENGINE Error in HTTPServer.serve 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: Traceback (most recent call last): 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._connections.run(self.expiration_interval) 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._run(expiration_interval) 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:21:56.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: s = self.context.wrap_socket( 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: return self.sslsocket_class._create( 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self.do_handshake() 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: self._sslobj.do_handshake() 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:21:56.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:21:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.089+0000 7fb1fe3a2640 1 Processor -- start 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fe3a2640 1 -- start start 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fe3a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fe3a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f807bd80 con 0x7fb1f8107f00 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fd3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fd3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50930/0 (socket says 172.21.15.1:50930) 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fd3a0640 1 -- 172.21.15.1:0/4253719434 learned_addr learned my addr 172.21.15.1:0/4253719434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.090+0000 7fb1fd3a0640 1 -- 172.21.15.1:0/4253719434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f810a830 con 0x7fb1f8107f00 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.091+0000 7fb1fd3a0640 1 --2- 172.21.15.1:0/4253719434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009820 tx=0x7fb1f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4774258b16ca4b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.091+0000 7fb1effff640 1 -- 172.21.15.1:0/4253719434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4037070 con 0x7fb1f8107f00 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1effff640 1 -- 172.21.15.1:0/4253719434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f4032920 con 0x7fb1f8107f00 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1effff640 1 -- 172.21.15.1:0/4253719434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4030810 con 0x7fb1f8107f00 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/4253719434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 msgr2=0x7fb1f810a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/4253719434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009820 tx=0x7fb1f402a270 comp rx=0 tx=0).stop 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/4253719434 shutdown_connections 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/4253719434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f810a2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/4253719434 >> 172.21.15.1:0/4253719434 conn(0x7fb1f8101ae0 msgr2=0x7fb1f8103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/4253719434 shutdown_connections 2024-09-12T02:21:56.931 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.092+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/4253719434 wait complete. 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.093+0000 7fb1fe3a2640 1 Processor -- start 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.093+0000 7fb1fe3a2640 1 -- start start 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.093+0000 7fb1fe3a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.093+0000 7fb1fe3a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f810b7f0 con 0x7fb1f8107f00 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fd3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fd3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50946/0 (socket says 172.21.15.1:50946) 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fd3a0640 1 -- 172.21.15.1:0/2406823541 learned_addr learned my addr 172.21.15.1:0/2406823541 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fd3a0640 1 -- 172.21.15.1:0/2406823541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f819de20 con 0x7fb1f8107f00 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fd3a0640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40097f0 tx=0x7fb1f40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4037040 con 0x7fb1f8107f00 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1f4030cc0 con 0x7fb1f8107f00 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f819e0b0 con 0x7fb1f8107f00 2024-09-12T02:21:56.932 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f403a6b0 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.094+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f81a0da0 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.095+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fb1f403a8a0 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.095+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f8108360 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.095+0000 7fb1ee7fc640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 0x7fb1e403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.095+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb1f406c460 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.096+0000 7fb1fcb9f640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 0x7fb1e403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.096+0000 7fb1fcb9f640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 0x7fb1e403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80098c0 tx=0x7fb1e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.100+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1f402fd40 con 0x7fb1f8107f00 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.285+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb1f8102e10 con 0x7fb1e4038eb0 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.333+0000 7fb1ee7fc640 1 -- 172.21.15.1:0/2406823541 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb1f8102e10 con 0x7fb1e4038eb0 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 msgr2=0x7fb1e403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 0x7fb1e403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80098c0 tx=0x7fb1e8006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:56.933 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 msgr2=0x7fb1f819d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40097f0 tx=0x7fb1f40327b0 comp rx=0 tx=0).stop 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 shutdown_connections 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1e4038eb0 0x7fb1e403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 --2- 172.21.15.1:0/2406823541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1f8107f00 0x7fb1f819d8e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 >> 172.21.15.1:0/2406823541 conn(0x7fb1f8101ae0 msgr2=0x7fb1f8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 shutdown_connections 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:56.336+0000 7fb1fe3a2640 1 -- 172.21.15.1:0/2406823541 wait complete. 2024-09-12T02:21:56.934 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-12T02:21:57.555 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:55] ENGINE Bus STARTING 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:56] ENGINE Serving on https://172.21.15.1:7150 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:56] ENGINE Error in HTTPServer.serve 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:21:57.556 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:56] ENGINE Serving on http://172.21.15.1:8765 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: [12/Sep/2024:02:21:56] ENGINE Bus STARTED 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:21:57.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:57 smithi001 ceph-mon[31252]: mgrmap e12: x(active, since 2s) 2024-09-12T02:21:58.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:21:58.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:58 smithi001 ceph-mon[31252]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:21:58.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:21:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$vdLAHhm69lwjCE2ChfaSqeZRIL7E0fau5ThwkTz0VVUzfCBL8Y7j.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726107717, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e6e641640 1 Processor -- start 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e6e641640 1 -- start start 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e6e641640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e6e641640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68106ea0 con 0x7f8e681064d0 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50952/0 (socket says 172.21.15.1:50952) 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.355+0000 7f8e67fff640 1 -- 172.21.15.1:0/1789564051 learned_addr learned my addr 172.21.15.1:0/1789564051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.356+0000 7f8e67fff640 1 -- 172.21.15.1:0/1789564051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68107680 con 0x7f8e681064d0 2024-09-12T02:21:59.039 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.356+0000 7f8e67fff640 1 --2- 172.21.15.1:0/1789564051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009820 tx=0x7f8e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25bdd5df0d78941 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e66ffd640 1 -- 172.21.15.1:0/1789564051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e681064d0 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e66ffd640 1 -- 172.21.15.1:0/1789564051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e58032920 con 0x7f8e681064d0 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e66ffd640 1 -- 172.21.15.1:0/1789564051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e58030810 con 0x7f8e681064d0 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 -- 172.21.15.1:0/1789564051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 msgr2=0x7f8e681068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1789564051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009820 tx=0x7f8e5802a270 comp rx=0 tx=0).stop 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 -- 172.21.15.1:0/1789564051 shutdown_connections 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1789564051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e681068d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 -- 172.21.15.1:0/1789564051 >> 172.21.15.1:0/1789564051 conn(0x7f8e68101cc0 msgr2=0x7f8e681040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 -- 172.21.15.1:0/1789564051 shutdown_connections 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.357+0000 7f8e6e641640 1 -- 172.21.15.1:0/1789564051 wait complete. 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.358+0000 7f8e6e641640 1 Processor -- start 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.358+0000 7f8e6e641640 1 -- start start 2024-09-12T02:21:59.040 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.358+0000 7f8e6e641640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.358+0000 7f8e6e641640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6810aa30 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50960/0 (socket says 172.21.15.1:50960) 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e67fff640 1 -- 172.21.15.1:0/1645035546 learned_addr learned my addr 172.21.15.1:0/1645035546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e67fff640 1 -- 172.21.15.1:0/1645035546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6819bda0 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e67fff640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e58030560 tx=0x7f8e58032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e58037040 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e58040070 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6819c030 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5803a740 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.359+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6819ed20 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.360+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f8e5803a9b0 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.360+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6810abb0 con 0x7f8e681064d0 2024-09-12T02:21:59.041 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.360+0000 7f8e657fa640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 0x7f8e5003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.360+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8e5806c800 con 0x7f8e681064d0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.360+0000 7f8e677fe640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 0x7f8e5003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.361+0000 7f8e677fe640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 0x7f8e5003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098c0 tx=0x7f8e5c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.365+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e58042e30 con 0x7f8e681064d0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.555+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f8e68106950 con 0x7f8e50038fc0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.805+0000 7f8e657fa640 1 -- 172.21.15.1:0/1645035546 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f8e68106950 con 0x7f8e50038fc0 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 msgr2=0x7f8e5003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 0x7f8e5003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098c0 tx=0x7f8e5c006db0 comp rx=0 tx=0).stop 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 msgr2=0x7f8e6819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e58030560 tx=0x7f8e58032670 comp rx=0 tx=0).stop 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 shutdown_connections 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8e50038fc0 0x7f8e5003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 --2- 172.21.15.1:0/1645035546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e681064d0 0x7f8e6819b860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:21:59.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 >> 172.21.15.1:0/1645035546 conn(0x7f8e68101cc0 msgr2=0x7f8e68102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:21:59.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 shutdown_connections 2024-09-12T02:21:59.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:57.808+0000 7f8e6e641640 1 -- 172.21.15.1:0/1645035546 wait complete. 2024-09-12T02:21:59.043 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dc5f27640 1 Processor -- start 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dc5f27640 1 -- start start 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dc5f27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dc5f27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0106ea0 con 0x7f2dc01064d0 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:00.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50972/0 (socket says 172.21.15.1:50972) 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dbf7fe640 1 -- 172.21.15.1:0/3944017314 learned_addr learned my addr 172.21.15.1:0/3944017314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.906+0000 7f2dbf7fe640 1 -- 172.21.15.1:0/3944017314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0107680 con 0x7f2dc01064d0 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.907+0000 7f2dbf7fe640 1 --2- 172.21.15.1:0/3944017314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009820 tx=0x7f2db002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85647ecefc2e260 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.907+0000 7f2dbe7fc640 1 -- 172.21.15.1:0/3944017314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db0037070 con 0x7f2dc01064d0 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.907+0000 7f2dbe7fc640 1 -- 172.21.15.1:0/3944017314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db0032920 con 0x7f2dc01064d0 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.907+0000 7f2dbe7fc640 1 -- 172.21.15.1:0/3944017314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db0030810 con 0x7f2dc01064d0 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 -- 172.21.15.1:0/3944017314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 msgr2=0x7f2dc01068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/3944017314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009820 tx=0x7f2db002a270 comp rx=0 tx=0).stop 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 -- 172.21.15.1:0/3944017314 shutdown_connections 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/3944017314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc01068d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 -- 172.21.15.1:0/3944017314 >> 172.21.15.1:0/3944017314 conn(0x7f2dc0101cc0 msgr2=0x7f2dc01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 -- 172.21.15.1:0/3944017314 shutdown_connections 2024-09-12T02:22:00.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 -- 172.21.15.1:0/3944017314 wait complete. 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.908+0000 7f2dc5f27640 1 Processor -- start 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dc5f27640 1 -- start start 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dc5f27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dc5f27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc010aa30 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50974/0 (socket says 172.21.15.1:50974) 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbf7fe640 1 -- 172.21.15.1:0/425361497 learned_addr learned my addr 172.21.15.1:0/425361497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbf7fe640 1 -- 172.21.15.1:0/425361497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc019be10 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbf7fe640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2db00097f0 tx=0x7f2db00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.909+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db0037040 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.910+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc019c0a0 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.910+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db0030cc0 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.910+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db003a640 con 0x7f2dc01064d0 2024-09-12T02:22:00.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.910+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc019ed90 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.910+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f2db003a940 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.911+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc010abb0 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.911+0000 7f2dbcff9640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 0x7f2dac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.911+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2db006c630 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.911+0000 7f2dbeffd640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 0x7f2dac03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.911+0000 7f2dbeffd640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 0x7f2dac03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2da80098c0 tx=0x7f2da8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.916+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2db003ba40 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:21:59.925+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2db0044920 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.093+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2dc0106950 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.094+0000 7f2dbcff9640 1 -- 172.21.15.1:0/425361497 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2db003ad80 con 0x7f2dc01064d0 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.096+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 msgr2=0x7f2dac03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:00.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.096+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 0x7f2dac03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2da80098c0 tx=0x7f2da8006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.096+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 msgr2=0x7f2dc019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.096+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2db00097f0 tx=0x7f2db00327b0 comp rx=0 tx=0).stop 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 shutdown_connections 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2dac038fc0 0x7f2dac03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 --2- 172.21.15.1:0/425361497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2dc01064d0 0x7f2dc019b8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 >> 172.21.15.1:0/425361497 conn(0x7f2dc0101cc0 msgr2=0x7f2dc0102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 shutdown_connections 2024-09-12T02:22:00.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:00.097+0000 7f2dc5f27640 1 -- 172.21.15.1:0/425361497 wait complete. 2024-09-12T02:22:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:22:00.681 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-12T02:22:00.689 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:22:00.689 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-12T02:22:00.689 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-12T02:22:00.690 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T02:22:00.691 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-12T02:22:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-12T02:22:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-12T02:22:00.691 INFO:teuthology.orchestra.run.smithi001.stdout: Password: y6i9bzli5f 2024-09-12T02:22:00.692 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:00.692 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config directory 2024-09-12T02:22:01.331 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:00 smithi001 ceph-mon[31252]: mgrmap e13: x(active, since 6s) 2024-09-12T02:22:01.332 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:00 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/425361497' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d7a88640 1 Processor -- start 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d7a88640 1 -- start start 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d7a88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d7a88640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0107fc0 con 0x7fb2d01075f0 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d5824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d5824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45690/0 (socket says 172.21.15.1:45690) 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.053+0000 7fb2d5824640 1 -- 172.21.15.1:0/228338575 learned_addr learned my addr 172.21.15.1:0/228338575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.054+0000 7fb2d5824640 1 -- 172.21.15.1:0/228338575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d01087a0 con 0x7fb2d01075f0 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.054+0000 7fb2d5824640 1 --2- 172.21.15.1:0/228338575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009820 tx=0x7fb2c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6dab934c81d9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:01.922 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d4822640 1 -- 172.21.15.1:0/228338575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c0037070 con 0x7fb2d01075f0 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d4822640 1 -- 172.21.15.1:0/228338575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2c0032920 con 0x7fb2d01075f0 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d4822640 1 -- 172.21.15.1:0/228338575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c0030810 con 0x7fb2d01075f0 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 -- 172.21.15.1:0/228338575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 msgr2=0x7fb2d01079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/228338575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009820 tx=0x7fb2c002a270 comp rx=0 tx=0).stop 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 -- 172.21.15.1:0/228338575 shutdown_connections 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/228338575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d01079f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 -- 172.21.15.1:0/228338575 >> 172.21.15.1:0/228338575 conn(0x7fb2d0102dc0 msgr2=0x7fb2d01051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 -- 172.21.15.1:0/228338575 shutdown_connections 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.055+0000 7fb2d7a88640 1 -- 172.21.15.1:0/228338575 wait complete. 2024-09-12T02:22:01.923 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d7a88640 1 Processor -- start 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d7a88640 1 -- start start 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d7a88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d7a88640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d010bb50 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d5824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d5824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45706/0 (socket says 172.21.15.1:45706) 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.056+0000 7fb2d5824640 1 -- 172.21.15.1:0/3719402732 learned_addr learned my addr 172.21.15.1:0/3719402732 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2d5824640 1 -- 172.21.15.1:0/3719402732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d019bde0 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2d5824640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097f0 tx=0x7fb2c00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c0037040 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2c0030cc0 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d019c070 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c003a640 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.057+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d019ed60 con 0x7fb2d01075f0 2024-09-12T02:22:01.924 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.058+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fb2c003b3f0 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.058+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d010bcd0 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.058+0000 7fb2ceffd640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 0x7fb2b803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.058+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb2c006c6a0 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.058+0000 7fb2d5023640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 0x7fb2b803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.059+0000 7fb2d5023640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 0x7fb2b803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098c0 tx=0x7fb2c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.063+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2c0041710 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.331+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fb2d0107a70 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.334+0000 7fb2ceffd640 1 -- 172.21.15.1:0/3719402732 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fb2c00328c0 con 0x7fb2d01075f0 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 msgr2=0x7fb2b803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 0x7fb2b803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098c0 tx=0x7fb2c4006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:01.925 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 msgr2=0x7fb2d019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097f0 tx=0x7fb2c00327b0 comp rx=0 tx=0).stop 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 shutdown_connections 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb2b80390c0 0x7fb2b803b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 --2- 172.21.15.1:0/3719402732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2d01075f0 0x7fb2d019b8a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 >> 172.21.15.1:0/3719402732 conn(0x7fb2d0102dc0 msgr2=0x7fb2d0103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 shutdown_connections 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-12T02:22:01.336+0000 7fb2d7a88640 1 -- 172.21.15.1:0/3719402732 wait complete. 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T02:22:01.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:01.927 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-12T02:22:01.966 INFO:tasks.cephadm:Fetching config... 2024-09-12T02:22:01.967 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:01.967 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T02:22:01.984 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T02:22:01.984 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:01.984 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T02:22:02.041 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T02:22:02.041 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:02.041 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T02:22:02.108 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T02:22:02.108 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:02.108 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T02:22:02.164 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T02:22:02.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:22:02.239 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:02.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:22:02.294 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:02.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:22:02.349 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3fTiHEXlbBEnuO9kjgJNJFEbeLS68r4hjmC05e5QZqugQUiwa5AkNESrxRstpyPA2trRi+jsZCn5oRfUNCMiXIA0+ffYpEHx1XX9oRLAKDQLxkw1p7hEk3EQBSZV4epNdvjs1JZN+XdPU1HcDnq37yV/X8fB/c4ztkpPpMvMoYvQJk4evswSryjMSNgu1Ft67Jj4qJdL0bx9qLdrVrivKkMUsLQd2HW9fRT+vUsUxffOSiXxPcxAFtIWragmAbJe55QWYLSUVc5kQaSOCMPhFcHnMHBUJ+F4oqByizyQkQHJ2Ju/W2eBwn4RAVJd98tEIAFvhMMdbAUOCmuwFZC4X6gJ9xmCJzBaAUolRnbQLEIPZiLbr121nwg1dzOgDCRVpDUoresqAoPNGyxLfy7gUkMd1Rj9FFStkoYyEQ1/LEJXQoMotR/MTaaXFmWPLML4K3tfr6l0BUvNbBTwd+MNHvqXsHIfUMSk4Gs3jmdJygi2+8roEqfKtuRhbxyYdq8= ceph-877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:02.363 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T02:22:02.615 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:02.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:02 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3719402732' entity='client.admin' 2024-09-12T02:22:03.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 -- 172.21.15.1:0/193151069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 msgr2=0x7fb9bc104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:03.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/193151069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009880 tx=0x7fb9ac02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 -- 172.21.15.1:0/193151069 shutdown_connections 2024-09-12T02:22:03.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/193151069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 -- 172.21.15.1:0/193151069 >> 172.21.15.1:0/193151069 conn(0x7fb9bc0fbc80 msgr2=0x7fb9bc0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 -- 172.21.15.1:0/193151069 shutdown_connections 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.124+0000 7fb9c29ac640 1 -- 172.21.15.1:0/193151069 wait complete. 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9c29ac640 1 Processor -- start 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9c29ac640 1 -- start start 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9c29ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:03.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9c29ac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1076b0 con 0x7fb9bc1020a0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45728/0 (socket says 172.21.15.1:45728) 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.125+0000 7fb9bbfff640 1 -- 172.21.15.1:0/4179075097 learned_addr learned my addr 172.21.15.1:0/4179075097 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9bbfff640 1 -- 172.21.15.1:0/4179075097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc197240 con 0x7fb9bc1020a0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9bbfff640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac004f60 tx=0x7fb9ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac03f070 con 0x7fb9bc1020a0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9ac003ad0 con 0x7fb9bc1020a0 2024-09-12T02:22:03.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc197530 con 0x7fb9bc1020a0 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac035030 con 0x7fb9bc1020a0 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.126+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc19a1b0 con 0x7fb9bc1020a0 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.127+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fb9ac042070 con 0x7fb9bc1020a0 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.127+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc107e30 con 0x7fb9bc1020a0 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.128+0000 7fb9b97fa640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 0x7fb9a403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:03.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.128+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb9ac06cdd0 con 0x7fb9bc1020a0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.128+0000 7fb9bb7fe640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 0x7fb9a403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.128+0000 7fb9bb7fe640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 0x7fb9a403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00098c0 tx=0x7fb9b0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.133+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9ac02f300 con 0x7fb9bc1020a0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.310+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fb9bc02d8d0 con 0x7fb9bc1020a0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.312+0000 7fb9b97fa640 1 -- 172.21.15.1:0/4179075097 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fb9ac003c80 con 0x7fb9bc1020a0 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 msgr2=0x7fb9a403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:03.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 0x7fb9a403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00098c0 tx=0x7fb9b0006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 msgr2=0x7fb9bc196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac004f60 tx=0x7fb9ac0048f0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 shutdown_connections 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9a40390c0 0x7fb9a403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 --2- 172.21.15.1:0/4179075097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc1020a0 0x7fb9bc196d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 >> 172.21.15.1:0/4179075097 conn(0x7fb9bc0fbc80 msgr2=0x7fb9bc0fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 shutdown_connections 2024-09-12T02:22:03.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:03.315+0000 7fb9c29ac640 1 -- 172.21.15.1:0/4179075097 wait complete. 2024-09-12T02:22:03.899 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T02:22:03.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T02:22:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:04.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:04 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4179075097' entity='client.admin' 2024-09-12T02:22:04.616 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:04 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:04.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2445645654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 msgr2=0x7f8d301044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2445645654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d301044f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009880 tx=0x7f8d2002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2445645654 shutdown_connections 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2445645654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d301044f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2445645654 >> 172.21.15.1:0/2445645654 conn(0x7f8d300fbc80 msgr2=0x7f8d300fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2445645654 shutdown_connections 2024-09-12T02:22:04.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.836+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2445645654 wait complete. 2024-09-12T02:22:04.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d35b1b640 1 Processor -- start 2024-09-12T02:22:04.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d35b1b640 1 -- start start 2024-09-12T02:22:04.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d35b1b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d35b1b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d30107710 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45760/0 (socket says 172.21.15.1:45760) 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.837+0000 7f8d2f7fe640 1 -- 172.21.15.1:0/2311369931 learned_addr learned my addr 172.21.15.1:0/2311369931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d2f7fe640 1 -- 172.21.15.1:0/2311369931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d30199550 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d2f7fe640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d20004f60 tx=0x7f8d200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d2003f070 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20003ad0 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d301997e0 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d20035030 con 0x7f8d30102100 2024-09-12T02:22:04.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.838+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3019c4d0 con 0x7f8d30102100 2024-09-12T02:22:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.839+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8d20042070 con 0x7f8d30102100 2024-09-12T02:22:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.839+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d30107e90 con 0x7f8d30102100 2024-09-12T02:22:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.839+0000 7f8d2cff9640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 0x7f8d1803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.839+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8d2006ce10 con 0x7f8d30102100 2024-09-12T02:22:04.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.839+0000 7f8d2effd640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 0x7f8d1803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:04.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.840+0000 7f8d2effd640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 0x7f8d1803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d240098c0 tx=0x7f8d24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:04.844+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d20039350 con 0x7f8d30102100 2024-09-12T02:22:05.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.023+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f8d30062630 con 0x7f8d18039060 2024-09-12T02:22:05.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.026+0000 7f8d2cff9640 1 -- 172.21.15.1:0/2311369931 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8d30062630 con 0x7f8d18039060 2024-09-12T02:22:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 msgr2=0x7f8d1803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 0x7f8d1803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d240098c0 tx=0x7f8d24006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 msgr2=0x7f8d30199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d20004f60 tx=0x7f8d200048f0 comp rx=0 tx=0).stop 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 shutdown_connections 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8d18039060 0x7f8d1803b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 --2- 172.21.15.1:0/2311369931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d30102100 0x7f8d30199010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 >> 172.21.15.1:0/2311369931 conn(0x7f8d300fbc80 msgr2=0x7f8d300fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 shutdown_connections 2024-09-12T02:22:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:05.028+0000 7f8d35b1b640 1 -- 172.21.15.1:0/2311369931 wait complete. 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:05.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:05.811 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-09-12T02:22:05.812 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:22:05.812 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:22:05.831 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:22:05.831 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:05.889 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-09-12T02:22:05.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch host add smithi134 2024-09-12T02:22:06.140 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: Updating smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: Updating smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:06.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:06.568 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:06.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2854750798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 msgr2=0x7fcaa8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:06.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2854750798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa8106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca98009c20 tx=0x7fca9802aa90 comp rx=0 tx=0).stop 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2854750798 shutdown_connections 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2854750798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa8106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2854750798 >> 172.21.15.1:0/2854750798 conn(0x7fcaa80fc1b0 msgr2=0x7fcaa80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2854750798 shutdown_connections 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.575+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2854750798 wait complete. 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaae1a4640 1 Processor -- start 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaae1a4640 1 -- start start 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaae1a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaae1a4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810ab90 con 0x7fcaa8106560 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45768/0 (socket says 172.21.15.1:45768) 2024-09-12T02:22:06.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.576+0000 7fcaa77fe640 1 -- 172.21.15.1:0/2143419700 learned_addr learned my addr 172.21.15.1:0/2143419700 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaa77fe640 1 -- 172.21.15.1:0/2143419700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa80fe550 con 0x7fcaa8106560 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaa77fe640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca98005e30 tx=0x7fca9802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98047070 con 0x7fcaa8106560 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa80fcba0 con 0x7fcaa8106560 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca98003df0 con 0x7fcaa8106560 2024-09-12T02:22:06.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98033050 con 0x7fcaa8106560 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.577+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa80fd060 con 0x7fcaa8106560 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.578+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fca9804a070 con 0x7fcaa8106560 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.578+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa8101bd0 con 0x7fcaa8106560 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.579+0000 7fcaa4ff9640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 0x7fca9003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.579+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fca9803e030 con 0x7fcaa8106560 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.579+0000 7fcaa6ffd640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 0x7fca9003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:06.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.579+0000 7fcaa6ffd640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 0x7fca9003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0098c0 tx=0x7fca9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:06.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.583+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca9804a360 con 0x7fcaa8106560 2024-09-12T02:22:06.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:06.762+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) -- 0x7fcaa80fdb90 con 0x7fca90039060 2024-09-12T02:22:07.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:07 smithi001 ceph-mon[31252]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:09.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:08 smithi001 ceph-mon[31252]: Deploying cephadm binary to smithi134 2024-09-12T02:22:10.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.624+0000 7fcaa4ff9640 1 -- 172.21.15.1:0/2143419700 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fcaa80fdb90 con 0x7fca90039060 2024-09-12T02:22:10.624 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-09-12T02:22:10.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 msgr2=0x7fca9003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 0x7fca9003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0098c0 tx=0x7fca9c006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 msgr2=0x7fcaa80fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca98005e30 tx=0x7fca9802fc10 comp rx=0 tx=0).stop 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 shutdown_connections 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca90039060 0x7fca9003b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 --2- 172.21.15.1:0/2143419700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcaa8106560 0x7fcaa80fc660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 >> 172.21.15.1:0/2143419700 conn(0x7fcaa80fc1b0 msgr2=0x7fcaa8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.626+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 shutdown_connections 2024-09-12T02:22:10.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:10.627+0000 7fcaae1a4640 1 -- 172.21.15.1:0/2143419700 wait complete. 2024-09-12T02:22:11.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:22:11.488 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:11.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:11.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:11 smithi001 ceph-mon[31252]: Added host smithi134 2024-09-12T02:22:11.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:11.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:11.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 -- 172.21.15.1:0/2646171724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 msgr2=0x7facac106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 --2- 172.21.15.1:0/2646171724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009880 tx=0x7fac9c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 -- 172.21.15.1:0/2646171724 shutdown_connections 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 --2- 172.21.15.1:0/2646171724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 -- 172.21.15.1:0/2646171724 >> 172.21.15.1:0/2646171724 conn(0x7facac0fc1b0 msgr2=0x7facac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 -- 172.21.15.1:0/2646171724 shutdown_connections 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.940+0000 7facb3d8e640 1 -- 172.21.15.1:0/2646171724 wait complete. 2024-09-12T02:22:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb3d8e640 1 Processor -- start 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb3d8e640 1 -- start start 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb3d8e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb3d8e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7facac10ab90 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb1b2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb1b2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33088/0 (socket says 172.21.15.1:33088) 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb1b2a640 1 -- 172.21.15.1:0/3307883567 learned_addr learned my addr 172.21.15.1:0/3307883567 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb1b2a640 1 -- 172.21.15.1:0/3307883567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac1976a0 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.941+0000 7facb1b2a640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009230 tx=0x7fac9c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c03f070 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac9c03bd40 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facac197930 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c035030 con 0x7facac106560 2024-09-12T02:22:11.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facac19ba30 con 0x7facac106560 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.942+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fac9c042070 con 0x7facac106560 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.943+0000 7facaaffd640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 0x7fac9403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.943+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facac101bd0 con 0x7facac106560 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.943+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fac9c06ccb0 con 0x7facac106560 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.943+0000 7facb1329640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 0x7fac9403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.943+0000 7facb1329640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 0x7fac9403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faca00098c0 tx=0x7faca0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:11.948+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac9c031d90 con 0x7facac106560 2024-09-12T02:22:12.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.144+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facac1069c0 con 0x7fac940390c0 2024-09-12T02:22:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.145+0000 7facaaffd640 1 -- 172.21.15.1:0/3307883567 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7facac1069c0 con 0x7fac940390c0 2024-09-12T02:22:12.145 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:12.145 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.147+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 msgr2=0x7fac9403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.147+0000 7facb3d8e640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 0x7fac9403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faca00098c0 tx=0x7faca0006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.147+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 msgr2=0x7facac197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.147+0000 7facb3d8e640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009230 tx=0x7fac9c003d80 comp rx=0 tx=0).stop 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.147+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 shutdown_connections 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.148+0000 7facb3d8e640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac940390c0 0x7fac9403b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.148+0000 7facb3d8e640 1 --2- 172.21.15.1:0/3307883567 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facac106560 0x7facac197160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.148+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 >> 172.21.15.1:0/3307883567 conn(0x7facac0fc1b0 msgr2=0x7facac069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.148+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 shutdown_connections 2024-09-12T02:22:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:12.148+0000 7facb3d8e640 1 -- 172.21.15.1:0/3307883567 wait complete. 2024-09-12T02:22:12.808 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-09-12T02:22:12.808 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:22:12.808 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:22:12.828 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:22:12.829 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:12.887 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-09-12T02:22:12.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch host add smithi173 2024-09-12T02:22:13.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:12 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:12 smithi001 ceph-mon[31252]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:22:13.141 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:13.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- 172.21.15.1:0/107547433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 msgr2=0x7f83e0102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 --2- 172.21.15.1:0/107547433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e0102bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009c10 tx=0x7f83dc02aa10 comp rx=0 tx=0).stop 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- 172.21.15.1:0/107547433 shutdown_connections 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 --2- 172.21.15.1:0/107547433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e0102bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- 172.21.15.1:0/107547433 >> 172.21.15.1:0/107547433 conn(0x7f83e0077310 msgr2=0x7f83e00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- 172.21.15.1:0/107547433 shutdown_connections 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- 172.21.15.1:0/107547433 wait complete. 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 Processor -- start 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.554+0000 7f83e7a73640 1 -- start start 2024-09-12T02:22:13.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e7a73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e7a73640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83e010bc80 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e580f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e580f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33110/0 (socket says 172.21.15.1:33110) 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e580f640 1 -- 172.21.15.1:0/2375856027 learned_addr learned my addr 172.21.15.1:0/2375856027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e580f640 1 -- 172.21.15.1:0/2375856027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e01998e0 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e580f640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005dd0 tx=0x7f83dc030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83dc034070 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e0199b70 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83dc02f8c0 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83dc004520 con 0x7f83e01027d0 2024-09-12T02:22:13.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.555+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e0199f10 con 0x7f83e01027d0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.556+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f83dc037020 con 0x7f83e01027d0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.557+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e0069ef0 con 0x7f83e01027d0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.557+0000 7f83d6ffd640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 0x7f83cc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.557+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f83dc06cfb0 con 0x7f83e01027d0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.557+0000 7f83e500e640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 0x7f83cc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.557+0000 7f83e500e640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 0x7f83cc03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d00098c0 tx=0x7f83d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:13.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.562+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83dc03f070 con 0x7f83e01027d0 2024-09-12T02:22:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:13.740+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}) -- 0x7f83e019a770 con 0x7f83cc039060 2024-09-12T02:22:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:13 smithi001 ceph-mon[31252]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:15.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:22:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:15.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: Deploying cephadm binary to smithi173 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: Updating smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: Updating smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:17.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.562+0000 7f83d6ffd640 1 -- 172.21.15.1:0/2375856027 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f83e019a770 con 0x7f83cc039060 2024-09-12T02:22:17.563 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 msgr2=0x7f83cc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 0x7f83cc03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d00098c0 tx=0x7f83d0006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 msgr2=0x7f83e01993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005dd0 tx=0x7f83dc030c30 comp rx=0 tx=0).stop 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 shutdown_connections 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83cc039060 0x7f83cc03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 --2- 172.21.15.1:0/2375856027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83e01027d0 0x7f83e01993a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:17.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 >> 172.21.15.1:0/2375856027 conn(0x7f83e0077310 msgr2=0x7f83e0107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:17.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 shutdown_connections 2024-09-12T02:22:17.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:17.565+0000 7f83e7a73640 1 -- 172.21.15.1:0/2375856027 wait complete. 2024-09-12T02:22:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:17 smithi001 ceph-mon[31252]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:17 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:17 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:18.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:22:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:18.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 -- 172.21.15.1:0/2999803737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 msgr2=0x7f3368106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:18.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 --2- 172.21.15.1:0/2999803737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3364009880 tx=0x7f336402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:18.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 -- 172.21.15.1:0/2999803737 shutdown_connections 2024-09-12T02:22:18.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 --2- 172.21.15.1:0/2999803737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:18.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 -- 172.21.15.1:0/2999803737 >> 172.21.15.1:0/2999803737 conn(0x7f33680fc1b0 msgr2=0x7f33680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 -- 172.21.15.1:0/2999803737 shutdown_connections 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.880+0000 7f336f655640 1 -- 172.21.15.1:0/2999803737 wait complete. 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336f655640 1 Processor -- start 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336f655640 1 -- start start 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336f655640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336f655640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f336810ab90 con 0x7f3368106560 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336d3f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336d3f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33120/0 (socket says 172.21.15.1:33120) 2024-09-12T02:22:18.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.881+0000 7f336d3f1640 1 -- 172.21.15.1:0/2422500208 learned_addr learned my addr 172.21.15.1:0/2422500208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:18.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f336d3f1640 1 -- 172.21.15.1:0/2422500208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336806acd0 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f336d3f1640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3364009230 tx=0x7f3364003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336403f070 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336403bd40 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33681962d0 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3364035030 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.882+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3368196730 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.883+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f3364042070 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.883+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368101bd0 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.883+0000 7f335e7fc640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 0x7f335403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.883+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f336406cc10 con 0x7f3368106560 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.883+0000 7f336cbf0640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 0x7f335403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:18.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.884+0000 7f336cbf0640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 0x7f335403b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33580098c0 tx=0x7f3358006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:18.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:18.888+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f336403a8e0 con 0x7f3368106560 2024-09-12T02:22:19.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.069+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f336806a4c0 con 0x7f33540390c0 2024-09-12T02:22:19.070 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:18 smithi001 ceph-mon[31252]: Added host smithi173 2024-09-12T02:22:19.070 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:19.070 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:19.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.071+0000 7f335e7fc640 1 -- 172.21.15.1:0/2422500208 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f336806a4c0 con 0x7f33540390c0 2024-09-12T02:22:19.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:19.071 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 msgr2=0x7f335403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 0x7f335403b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33580098c0 tx=0x7f3358006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 msgr2=0x7f3368195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3364009230 tx=0x7f3364003d80 comp rx=0 tx=0).stop 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 shutdown_connections 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33540390c0 0x7f335403b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 --2- 172.21.15.1:0/2422500208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3368106560 0x7f3368195d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:19.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 >> 172.21.15.1:0/2422500208 conn(0x7f33680fc1b0 msgr2=0x7f33680fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:19.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 shutdown_connections 2024-09-12T02:22:19.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:19.073+0000 7f336f655640 1 -- 172.21.15.1:0/2422500208 wait complete. 2024-09-12T02:22:19.621 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T02:22:19.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T02:22:19.873 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:19.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:19 smithi001 ceph-mon[31252]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1162706621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c107660 msgr2=0x7f8c9c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1162706621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c107660 0x7f8c9c107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009880 tx=0x7f8c9002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1162706621 shutdown_connections 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1162706621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c107660 0x7f8c9c107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1162706621 >> 172.21.15.1:0/1162706621 conn(0x7f8c9c0fd290 msgr2=0x7f8c9c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1162706621 shutdown_connections 2024-09-12T02:22:20.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.319+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1162706621 wait complete. 2024-09-12T02:22:20.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca2ead640 1 Processor -- start 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca2ead640 1 -- start start 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca2ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca2ead640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c10bc90 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca0c49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca0c49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33132/0 (socket says 172.21.15.1:33132) 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.320+0000 7f8ca0c49640 1 -- 172.21.15.1:0/1004577277 learned_addr learned my addr 172.21.15.1:0/1004577277 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8ca0c49640 1 -- 172.21.15.1:0/1004577277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c192160 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8ca0c49640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009230 tx=0x7f8c90003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c9003f070 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c9003bc80 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c1923f0 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c90035030 con 0x7f8c9c195b30 2024-09-12T02:22:20.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.321+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c192850 con 0x7f8c9c195b30 2024-09-12T02:22:20.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.322+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8c90042070 con 0x7f8c9c195b30 2024-09-12T02:22:20.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.322+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9c102cd0 con 0x7f8c9c195b30 2024-09-12T02:22:20.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.322+0000 7f8c99ffb640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 0x7f8c8c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:20.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.322+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8c9006cc80 con 0x7f8c9c195b30 2024-09-12T02:22:20.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.323+0000 7f8c9bfff640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 0x7f8c8c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:20.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.323+0000 7f8c9bfff640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 0x7f8c8c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098c0 tx=0x7f8c88006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:20.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.327+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c90031e00 con 0x7f8c9c195b30 2024-09-12T02:22:20.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.505+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8c9c107a40 con 0x7f8c9c195b30 2024-09-12T02:22:20.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.721+0000 7f8c99ffb640 1 -- 172.21.15.1:0/1004577277 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8c9003f210 con 0x7f8c9c195b30 2024-09-12T02:22:20.722 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-12T02:22:20.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.723+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 msgr2=0x7f8c8c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.723+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 0x7f8c8c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098c0 tx=0x7f8c88006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.723+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 msgr2=0x7f8c9c191c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.723+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009230 tx=0x7f8c90003e10 comp rx=0 tx=0).stop 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 shutdown_connections 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8c8c039060 0x7f8c8c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:20.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 --2- 172.21.15.1:0/1004577277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c9c195b30 0x7f8c9c191c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 >> 172.21.15.1:0/1004577277 conn(0x7f8c9c0fd290 msgr2=0x7f8c9c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 shutdown_connections 2024-09-12T02:22:20.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:20.724+0000 7f8ca2ead640 1 -- 172.21.15.1:0/1004577277 wait complete. 2024-09-12T02:22:21.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:20 smithi001 ceph-mon[31252]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:22:21.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:20 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1004577277' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:22:21.357 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-12T02:22:21.357 INFO:tasks.cephadm:Adding mon.b on smithi134 2024-09-12T02:22:21.357 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-09-12T02:22:21.357 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c' 2024-09-12T02:22:21.945 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T02:22:22.002 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T02:22:22.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:21 smithi001 ceph-mon[31252]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:22.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1004577277' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:22:22.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:21 smithi001 ceph-mon[31252]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:22.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/2603970056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 msgr2=0x7f2df8100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:22.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/2603970056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df8100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009880 tx=0x7f2de802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/2603970056 shutdown_connections 2024-09-12T02:22:22.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/2603970056 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df8100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/2603970056 >> 172.21.15.173:0/2603970056 conn(0x7f2df80fbcd0 msgr2=0x7f2df80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/2603970056 shutdown_connections 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.485+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/2603970056 wait complete. 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.486+0000 7f2dfd0ee640 1 Processor -- start 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.486+0000 7f2dfd0ee640 1 -- start start 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.486+0000 7f2dfd0ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.486+0000 7f2dfd0ee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2df81065f0 con 0x7f2df8100540 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2df6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2df6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.173:60612/0 (socket says 172.21.15.173:60612) 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2df6d9d640 1 -- 172.21.15.173:0/3519485335 learned_addr learned my addr 172.21.15.173:0/3519485335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2df6d9d640 1 -- 172.21.15.173:0/3519485335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df8199ab0 con 0x7f2df8100540 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2df6d9d640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2de8004f60 tx=0x7f2de80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de803f070 con 0x7f2df8100540 2024-09-12T02:22:22.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2de8004d40 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de8035030 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df8199c80 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.487+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df819a020 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.488+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2de8042070 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.488+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df8106d70 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.489+0000 7f2ddffff640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 0x7f2de003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.489+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2de806cf00 con 0x7f2df8100540 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.489+0000 7f2df659c640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 0x7f2de003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.489+0000 7f2df659c640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 0x7f2de003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0098c0 tx=0x7f2dec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:22.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.494+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2de8039350 con 0x7f2df8100540 2024-09-12T02:22:22.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.685+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}) -- 0x7f2df802db40 con 0x7f2de0039060 2024-09-12T02:22:22.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.690+0000 7f2ddffff640 1 -- 172.21.15.173:0/3519485335 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2df802db40 con 0x7f2de0039060 2024-09-12T02:22:22.690 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-09-12T02:22:22.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 msgr2=0x7f2de003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 0x7f2de003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0098c0 tx=0x7f2dec006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 msgr2=0x7f2df806a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2de8004f60 tx=0x7f2de80048f0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 shutdown_connections 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2de0039060 0x7f2de003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 --2- 172.21.15.173:0/3519485335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2df8100540 0x7f2df806a130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 >> 172.21.15.173:0/3519485335 conn(0x7f2df80fbcd0 msgr2=0x7f2df80fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 shutdown_connections 2024-09-12T02:22:22.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:22.692+0000 7f2dfd0ee640 1 -- 172.21.15.173:0/3519485335 wait complete. 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:22:23.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c;count:3 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:23.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:23.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:22 smithi001 ceph-mon[31252]: Deploying daemon mon.c on smithi173 2024-09-12T02:22:23.250 DEBUG:teuthology.orchestra.run.smithi134:mon.b> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T02:22:23.253 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T02:22:23.256 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:22:23.256 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:22:24.338 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:25.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:24 smithi001 ceph-mon[31252]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:25.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 -- 172.21.15.173:0/1207090596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 msgr2=0x7f2090106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 --2- 172.21.15.173:0/1207090596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f2090106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2080009880 tx=0x7f208002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 -- 172.21.15.173:0/1207090596 shutdown_connections 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 --2- 172.21.15.173:0/1207090596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f2090106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 -- 172.21.15.173:0/1207090596 >> 172.21.15.173:0/1207090596 conn(0x7f20900fc150 msgr2=0x7f20900fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 -- 172.21.15.173:0/1207090596 shutdown_connections 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.706+0000 7f20954f0640 1 -- 172.21.15.173:0/1207090596 wait complete. 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f20954f0640 1 Processor -- start 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f20954f0640 1 -- start start 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f20954f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f20954f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f209010ab70 con 0x7f2090106540 2024-09-12T02:22:25.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f208effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f208effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.173:60644/0 (socket says 172.21.15.173:60644) 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.707+0000 7f208effd640 1 -- 172.21.15.173:0/4195258278 learned_addr learned my addr 172.21.15.173:0/4195258278 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f208effd640 1 -- 172.21.15.173:0/4195258278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900fe4f0 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f208effd640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2080009230 tx=0x7f2080003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208003f070 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208003bc80 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20900fcb40 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2080035030 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.708+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20900fd000 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.709+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2090101bb0 con 0x7f2090106540 2024-09-12T02:22:25.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.710+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2080042070 con 0x7f2090106540 2024-09-12T02:22:25.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.710+0000 7f2077fff640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 0x7f207803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:25.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.710+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f208006cd00 con 0x7f2090106540 2024-09-12T02:22:25.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.710+0000 7f208e7fc640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 0x7f207803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:25.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.710+0000 7f208e7fc640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 0x7f207803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20840098c0 tx=0x7f2084006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:25.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.715+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2080031e20 con 0x7f2090106540 2024-09-12T02:22:25.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.979+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f20900fdb30 con 0x7f2090106540 2024-09-12T02:22:25.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.980+0000 7f2077fff640 1 -- 172.21.15.173:0/4195258278 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f2080031570 con 0x7f2090106540 2024-09-12T02:22:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:22:25.981 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","modified":"2024-09-12T02:21:02.319189Z","created":"2024-09-12T02:21:02.319189Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:22:25.982 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 msgr2=0x7f207803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 0x7f207803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20840098c0 tx=0x7f2084006db0 comp rx=0 tx=0).stop 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 msgr2=0x7f20900fc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2080009230 tx=0x7f2080003d40 comp rx=0 tx=0).stop 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 shutdown_connections 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2078039060 0x7f207803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 --2- 172.21.15.173:0/4195258278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2090106540 0x7f20900fc600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 >> 172.21.15.173:0/4195258278 conn(0x7f20900fc150 msgr2=0x7f2090069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:25.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 shutdown_connections 2024-09-12T02:22:25.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:25.983+0000 7f20954f0640 1 -- 172.21.15.173:0/4195258278 wait complete. 2024-09-12T02:22:26.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:26 smithi173 systemd[1]: Starting Ceph mon.c for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:22:27.070 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:26 smithi173 podman[35016]: 2024-09-12 02:22:26.955058341 +0000 UTC m=+0.107596611 container create 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:22:27.070 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:26 smithi173 podman[35016]: 2024-09-12 02:22:26.864979383 +0000 UTC m=+0.017517680 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:22:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:26 smithi001 ceph-mon[31252]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:26 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/4195258278' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:27.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 podman[35016]: 2024-09-12 02:22:27.165987095 +0000 UTC m=+0.318525368 container init 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 podman[35016]: 2024-09-12 02:22:27.16922073 +0000 UTC m=+0.321759006 container start 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pidfile_write: ignore empty --pid-file 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: load: jerasure load: lrc 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Git sha 0 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: DB SUMMARY 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: DB Session ID: 76AYBL15L9HZMEU2N7Z1 2024-09-12T02:22:27.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.env: 0x55d330659940 2024-09-12T02:22:27.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.info_log: 0x55d3313d96e0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.statistics: (nil) 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.use_fsync: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:22:27.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.db_log_dir: 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.wal_dir: 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.write_buffer_manager: 0x55d3313e8dc0 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:22:27.451 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.unordered_write: 0 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.row_cache: None 2024-09-12T02:22:27.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.wal_filter: None 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.wal_compression: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:22:27.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:22:27.455 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:22:27.456 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:22:27.456 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:22:27.456 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:22:27.456 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:22:27.456 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_open_files: -1 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:22:27.457 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Compression algorithms supported: 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kZSTD supported: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:22:27.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.merge_operator: 2024-09-12T02:22:27.459 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_filter: None 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d3313d9320) 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:22:27.460 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 4 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x55d3313cd1f0 2024-09-12T02:22:27.461 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2024-09-12T02:22:27.462 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: bloomfilter 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2024-09-12T02:22:27.463 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 5 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: max_auto_readahead_size: 262144 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: prepopulate_block_cache: 0 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:22:27.464 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression: NoCompression 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.num_levels: 7 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:22:27.465 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:22:27.466 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:22:27.467 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:22:27.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:22:27.469 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:22:27.470 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:22:27.471 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:22:27.472 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.ttl: 2592000 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:22:27.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0b57f6b4-08cb-4be2-8fff-8d3dd3c717b7 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107747195985, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107747196382, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726107747, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0b57f6b4-08cb-4be2-8fff-8d3dd3c717b7", "db_session_id": "76AYBL15L9HZMEU2N7Z1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726107747196507, "job": 1, "event": "recovery_finished"} 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:22:27.474 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d3313fae00 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: DB pointer 0x55d3314f6000 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:22:27.475 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-12T02:22:27.476 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:22:27.477 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache BinnedLRUCache@0x55d3313cd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: using public_addr v2:172.21.15.173:0/0 -> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(???) e0 preinit fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: btime 2024-09-12T02:21:05:451625+0000 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:22:27.478 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:22:27.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1004577277' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1004577277' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:27.481 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c;count:3 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:27.482 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: Deploying daemon mon.c on smithi173 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/4195258278' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 ceph-mon[35036]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 bash[35016]: 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a 2024-09-12T02:22:27.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:27 smithi173 systemd[1]: Started Ceph mon.c for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:22:27.767 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:22:27.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:22:28.016 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:22:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:22:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: mon.a calling monitor election 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: mon.c calling monitor election 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: monmap epoch 2 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: last_changed 2024-09-12T02:22:27.221273+0000 2024-09-12T02:22:32.627 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: min_mon_release 19 (squid) 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: election_strategy: 1 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: fsmap 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: mgrmap e13: x(active, since 38s) 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: overall HEALTH_OK 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:32.628 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:32.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: mon.a calling monitor election 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: mon.c calling monitor election 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: monmap epoch 2 2024-09-12T02:22:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: last_changed 2024-09-12T02:22:27.221273+0000 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: min_mon_release 19 (squid) 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: election_strategy: 1 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: fsmap 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: mgrmap e13: x(active, since 38s) 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: overall HEALTH_OK 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:32.699 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:32.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.827+0000 7fc7f830f640 1 -- 172.21.15.173:0/766443859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 msgr2=0x7fc7dc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.827+0000 7fc7f830f640 1 --2- 172.21.15.173:0/766443859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7dc0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7f01016a0 tx=0x7fc7ec02c490 comp rx=0 tx=0).stop 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.828+0000 7fc7f830f640 1 -- 172.21.15.173:0/766443859 shutdown_connections 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.828+0000 7fc7f830f640 1 --2- 172.21.15.173:0/766443859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7dc0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.828+0000 7fc7f830f640 1 -- 172.21.15.173:0/766443859 >> 172.21.15.173:0/766443859 conn(0x7fc7f00fc220 msgr2=0x7fc7f00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:32.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.828+0000 7fc7f830f640 1 -- 172.21.15.173:0/766443859 shutdown_connections 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.828+0000 7fc7f830f640 1 -- 172.21.15.173:0/766443859 wait complete. 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 Processor -- start 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 -- start start 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7f0198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0108670 con 0x7fc7dc003530 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f830f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f01084f0 con 0x7fc7f0198640 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:32.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46066/0 (socket says 172.21.15.173:46066) 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 -- 172.21.15.173:0/3677439212 learned_addr learned my addr 172.21.15.173:0/3677439212 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f60ab640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7f0198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 -- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 msgr2=0x7fc7f0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 -- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 msgr2=0x7fc7f0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.829+0000 7fc7f58aa640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f58aa640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f60ab640 1 -- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 msgr2=0x7fc7f0198aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f60ab640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f60ab640 1 -- 172.21.15.173:0/3677439212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f01a1170 con 0x7fc7dc003530 2024-09-12T02:22:32.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f60ab640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7f0198100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec036040 tx=0x7fc7ec033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:32.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc7ec032920 con 0x7fc7dc003530 2024-09-12T02:22:32.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ec041070 con 0x7fc7dc003530 2024-09-12T02:22:32.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01a1340 con 0x7fc7dc003530 2024-09-12T02:22:32.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc7ec004970 con 0x7fc7dc003530 2024-09-12T02:22:32.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.830+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a1840 con 0x7fc7dc003530 2024-09-12T02:22:32.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.831+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc7ec004c20 con 0x7fc7dc003530 2024-09-12T02:22:32.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.832+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f0101ca0 con 0x7fc7dc003530 2024-09-12T02:22:32.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.832+0000 7fc7e77fe640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 0x7fc7d403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.832+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc7ec06e370 con 0x7fc7dc003530 2024-09-12T02:22:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.832+0000 7fc7f58aa640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 0x7fc7d403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:32.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.833+0000 7fc7f58aa640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 0x7fc7d403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009100 tx=0x7fc7e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:32.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:32.837+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7ec03a550 con 0x7fc7dc003530 2024-09-12T02:22:33.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.069+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc7f002d7c0 con 0x7fc7dc003530 2024-09-12T02:22:33.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.070+0000 7fc7e77fe640 1 -- 172.21.15.173:0/3677439212 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fc7ec03a2f0 con 0x7fc7dc003530 2024-09-12T02:22:33.115 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:22:33.115 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","modified":"2024-09-12T02:22:27.221273Z","created":"2024-09-12T02:21:02.319189Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 msgr2=0x7fc7d403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 0x7fc7d403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009100 tx=0x7fc7e0008040 comp rx=0 tx=0).stop 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 msgr2=0x7fc7f0198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7f0198100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec036040 tx=0x7fc7ec033680 comp rx=0 tx=0).stop 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 shutdown_connections 2024-09-12T02:22:33.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d4038e50 0x7fc7d403b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:33.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7f0198640 0x7fc7f0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:33.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 --2- 172.21.15.173:0/3677439212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7dc003530 0x7fc7f0198100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:33.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 >> 172.21.15.173:0/3677439212 conn(0x7fc7f00fc220 msgr2=0x7fc7f00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:33.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 shutdown_connections 2024-09-12T02:22:33.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:33.072+0000 7fc7f830f640 1 -- 172.21.15.173:0/3677439212 wait complete. 2024-09-12T02:22:33.413 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:33 smithi173 ceph-mon[35036]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:33.413 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:33 smithi173 ceph-mon[35036]: Deploying daemon mon.b on smithi134 2024-09-12T02:22:33.413 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:33 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/3677439212' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:33.414 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:33 smithi001 ceph-mon[31252]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:33 smithi001 ceph-mon[31252]: Deploying daemon mon.b on smithi134 2024-09-12T02:22:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:33 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/3677439212' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:33.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:34.718 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:22:34.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:22:34.983 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:22:35.401 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:35 smithi173 ceph-mon[35036]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 -- 172.21.15.173:0/262303104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 msgr2=0x7f8218107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 --2- 172.21.15.173:0/262303104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f8218107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8200009880 tx=0x7f820002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 -- 172.21.15.173:0/262303104 shutdown_connections 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 --2- 172.21.15.173:0/262303104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f8218107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 -- 172.21.15.173:0/262303104 >> 172.21.15.173:0/262303104 conn(0x7f82180fd320 msgr2=0x7f82180ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 -- 172.21.15.173:0/262303104 shutdown_connections 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.414+0000 7f821d9ae640 1 -- 172.21.15.173:0/262303104 wait complete. 2024-09-12T02:22:35.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 Processor -- start 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 -- start start 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f82180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f821810bd20 con 0x7f8218107660 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f821d9ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f821810bba0 con 0x7f8218074a30 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.415+0000 7f82167fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f8216ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f82180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:46078/0 (socket says 172.21.15.173:46078) 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 -- 172.21.15.173:0/477336874 learned_addr learned my addr 172.21.15.173:0/477336874 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 -- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 msgr2=0x7f8218074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 -- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 msgr2=0x7f8218074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:22:35.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f82167fc640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f8216ffd640 1 -- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 msgr2=0x7f8218074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f8216ffd640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f8216ffd640 1 -- 172.21.15.173:0/477336874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82180763e0 con 0x7f8218107660 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f8216ffd640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f82180744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f8200032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.416+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8200035070 con 0x7f8218107660 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8200032e40 con 0x7f8218107660 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f820003bc30 con 0x7f8218107660 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82181a35f0 con 0x7f8218107660 2024-09-12T02:22:35.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181a3b80 con 0x7f8218107660 2024-09-12T02:22:35.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8200042030 con 0x7f8218107660 2024-09-12T02:22:35.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.417+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8218102da0 con 0x7f8218107660 2024-09-12T02:22:35.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.418+0000 7f821c9ac640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 0x7f820403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:35.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.418+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8200040070 con 0x7f8218107660 2024-09-12T02:22:35.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.418+0000 7f82167fc640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 0x7f820403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:35.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.418+0000 7f82167fc640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 0x7f820403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8208009100 tx=0x7f8208008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.423+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f820004a260 con 0x7f8218107660 2024-09-12T02:22:35.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:35 smithi001 ceph-mon[31252]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:35.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.653+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f82181a3e30 con 0x7f8218107660 2024-09-12T02:22:35.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.654+0000 7f821c9ac640 1 -- 172.21.15.173:0/477336874 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f820003bdd0 con 0x7f8218107660 2024-09-12T02:22:35.654 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:22:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","modified":"2024-09-12T02:22:27.221273Z","created":"2024-09-12T02:21:02.319189Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:22:35.655 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-12T02:22:35.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 msgr2=0x7f820403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:35.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 0x7f820403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8208009100 tx=0x7f8208008040 comp rx=0 tx=0).stop 2024-09-12T02:22:35.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 msgr2=0x7f82180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f82180744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8200000c00 tx=0x7f8200032c50 comp rx=0 tx=0).stop 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 shutdown_connections 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8204038e00 0x7f820403b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8218074a30 0x7f8218074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 --2- 172.21.15.173:0/477336874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8218107660 0x7f82180744f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 >> 172.21.15.173:0/477336874 conn(0x7f82180fd320 msgr2=0x7f82180fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 shutdown_connections 2024-09-12T02:22:35.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:35.656+0000 7f821d9ae640 1 -- 172.21.15.173:0/477336874 wait complete. 2024-09-12T02:22:36.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:35 smithi134 systemd[1]: Started Ceph mon.b for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:22:37.199 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:22:37.199 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:22:37.447 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:22:41.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.054+0000 7f28025d4640 1 -- 172.21.15.173:0/1880405887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27e8003530 msgr2=0x7f27e80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.054+0000 7f28025d4640 1 --2- 172.21.15.173:0/1880405887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27e8003530 0x7f27e80059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27fc06a240 tx=0x7f27ec02c150 comp rx=0 tx=0).stop 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 -- 172.21.15.173:0/1880405887 shutdown_connections 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 --2- 172.21.15.173:0/1880405887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27e8003530 0x7f27e80059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 -- 172.21.15.173:0/1880405887 >> 172.21.15.173:0/1880405887 conn(0x7f27fc0fc280 msgr2=0x7f27fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 -- 172.21.15.173:0/1880405887 shutdown_connections 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 -- 172.21.15.173:0/1880405887 wait complete. 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.055+0000 7f28025d4640 1 Processor -- start 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 -- start start 2024-09-12T02:22:41.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc1097a0 con 0x7f27fc1978f0 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc109620 con 0x7f27e8003530 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f28025d4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc109920 con 0x7f27fc19c1c0 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f2800b71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.173:52556/0 (socket says 172.21.15.173:52556) 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 -- 172.21.15.173:0/3372494886 learned_addr learned my addr 172.21.15.173:0/3372494886 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f2800b71640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 msgr2=0x7f27fc19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f2800b71640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 msgr2=0x7f27fc19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:22:41.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f2800b71640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27fbfff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f2800b71640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27fbfff640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 msgr2=0x7f27fc1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27fbfff640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 msgr2=0x7f27fc1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27fbfff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27fbfff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 msgr2=0x7f27fc19c670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 msgr2=0x7f27fc1973b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.056+0000 7f27f3fff640 1 -- 172.21.15.173:0/3372494886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc1a3f30 con 0x7f27fc1978f0 2024-09-12T02:22:41.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f27f3fff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27e400b520 tx=0x7f27e400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004230 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e40043d0 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc1a4160 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4003d60 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.057+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc1a4670 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.058+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f27e400e070 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.058+0000 7f27f9ffb640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 0x7f27dc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.058+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc10a8d0 con 0x7f27fc1978f0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.059+0000 7f27fbfff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 0x7f27dc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.059+0000 7f27fbfff640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 0x7f27dc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005fd0 tx=0x7f27ec005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.062+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f27e404b2d0 con 0x7f27fc1978f0 2024-09-12T02:22:41.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.067+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27e4014020 con 0x7f27fc1978f0 2024-09-12T02:22:41.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.308+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f27fc1a4a20 con 0x7f27fc1978f0 2024-09-12T02:22:41.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.308+0000 7f27f9ffb640 1 -- 172.21.15.173:0/3372494886 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f27e400ed70 con 0x7f27fc1978f0 2024-09-12T02:22:41.309 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:22:41.309 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","modified":"2024-09-12T02:22:35.994364Z","created":"2024-09-12T02:21:02.319189Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-12T02:22:41.309 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2024-09-12T02:22:41.309 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: mon.a calling monitor election 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: mon.c calling monitor election 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: mon.b calling monitor election 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: monmap epoch 3 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: last_changed 2024-09-12T02:22:35.994364+0000 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: min_mon_release 19 (squid) 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: election_strategy: 1 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: fsmap 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:41.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: mgrmap e13: x(active, since 47s) 2024-09-12T02:22:41.312 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: overall HEALTH_OK 2024-09-12T02:22:41.312 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.312 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.312 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.312 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 msgr2=0x7f27dc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 0x7f27dc03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27ec005fd0 tx=0x7f27ec005d10 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 msgr2=0x7f27fc19bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27e400b520 tx=0x7f27e400b9e0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 shutdown_connections 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27dc0394f0 0x7f27dc03b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27fc1978f0 0x7f27fc19bc80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27fc19c1c0 0x7f27fc19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 --2- 172.21.15.173:0/3372494886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e8003530 0x7f27fc1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 >> 172.21.15.173:0/3372494886 conn(0x7f27fc0fc280 msgr2=0x7f27fc0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 shutdown_connections 2024-09-12T02:22:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:41.311+0000 7f28025d4640 1 -- 172.21.15.173:0/3372494886 wait complete. 2024-09-12T02:22:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: mon.a calling monitor election 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: mon.c calling monitor election 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: mon.b calling monitor election 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: monmap epoch 3 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: last_changed 2024-09-12T02:22:35.994364+0000 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: min_mon_release 19 (squid) 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: election_strategy: 1 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: fsmap 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: mgrmap e13: x(active, since 47s) 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: overall HEALTH_OK 2024-09-12T02:22:41.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: mon.a calling monitor election 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: mon.c calling monitor election 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: mon.b calling monitor election 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:22:41.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: monmap epoch 3 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: last_changed 2024-09-12T02:22:35.994364+0000 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: created 2024-09-12T02:21:02.319189+0000 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: min_mon_release 19 (squid) 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: election_strategy: 1 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: fsmap 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: mgrmap e13: x(active, since 47s) 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: overall HEALTH_OK 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.417 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.417 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:41.906 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T02:22:41.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T02:22:42.175 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:42 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/3372494886' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:42.296 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.296 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:42 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/3372494886' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.296 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:42.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:42 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/3372494886' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:22:42.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 -- 172.21.15.1:0/3182897565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b90102730 msgr2=0x7f4b90102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 --2- 172.21.15.1:0/3182897565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b90102730 0x7f4b90102b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009810 tx=0x7f4b8402a540 comp rx=0 tx=0).stop 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 -- 172.21.15.1:0/3182897565 shutdown_connections 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 --2- 172.21.15.1:0/3182897565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b90102730 0x7f4b90102b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 -- 172.21.15.1:0/3182897565 >> 172.21.15.1:0/3182897565 conn(0x7f4b90077310 msgr2=0x7f4b900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 -- 172.21.15.1:0/3182897565 shutdown_connections 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.645+0000 7f4b96c53640 1 -- 172.21.15.1:0/3182897565 wait complete. 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 Processor -- start 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 -- start start 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b90102730 0x7f4b90197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b90197890 0x7f4b9019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010bc30 con 0x7f4b9019c160 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010bab0 con 0x7f4b90197890 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b96c53640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010bdb0 con 0x7f4b90102730 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b951f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b951f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45830/0 (socket says 172.21.15.1:45830) 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b949ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b90102730 0x7f4b90197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b951f0640 1 -- 172.21.15.1:0/1201642721 learned_addr learned my addr 172.21.15.1:0/1201642721 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.646+0000 7f4b8ffff640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b90197890 0x7f4b9019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 -- 172.21.15.1:0/1201642721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b90102730 msgr2=0x7f4b90197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b90102730 0x7f4b90197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 -- 172.21.15.1:0/1201642721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b90197890 msgr2=0x7f4b9019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b90197890 0x7f4b9019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 -- 172.21.15.1:0/1201642721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b901a3ed0 con 0x7f4b9019c160 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b951f0640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ba50 tx=0x7f4b8800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88019070 con 0x7f4b9019c160 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8800cbe0 con 0x7f4b9019c160 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b901a4100 con 0x7f4b9019c160 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880076a0 con 0x7f4b9019c160 2024-09-12T02:22:42.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.647+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901a4610 con 0x7f4b9019c160 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.648+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f4b8801c070 con 0x7f4b9019c160 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.648+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90069f90 con 0x7f4b9019c160 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.649+0000 7f4b8dffb640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 0x7f4b8003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.649+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4b8804b9e0 con 0x7f4b9019c160 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.649+0000 7f4b949ef640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 0x7f4b8003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.650+0000 7f4b949ef640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 0x7f4b8003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097e0 tx=0x7f4b84005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.655+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b88012e50 con 0x7f4b9019c160 2024-09-12T02:22:42.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.861+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4b901a49b0 con 0x7f4b9019c160 2024-09-12T02:22:42.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.861+0000 7f4b8dffb640 1 -- 172.21.15.1:0/1201642721 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f4b8800cd90 con 0x7f4b9019c160 2024-09-12T02:22:42.861 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:42.861 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-12T02:22:42.862 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:22:42.862 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 msgr2=0x7f4b8003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 0x7f4b8003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097e0 tx=0x7f4b84005870 comp rx=0 tx=0).stop 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 msgr2=0x7f4b9019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ba50 tx=0x7f4b8800bf10 comp rx=0 tx=0).stop 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 shutdown_connections 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4b800394f0 0x7f4b8003b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b9019c160 0x7f4b9019c610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b90197890 0x7f4b9019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 --2- 172.21.15.1:0/1201642721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b90102730 0x7f4b90197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 >> 172.21.15.1:0/1201642721 conn(0x7f4b90077310 msgr2=0x7f4b901035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 shutdown_connections 2024-09-12T02:22:42.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:42.864+0000 7f4b96c53640 1 -- 172.21.15.1:0/1201642721 wait complete. 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T02:22:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:43 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1201642721' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.396 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T02:22:43.397 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:43 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1201642721' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T02:22:43.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:43 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1201642721' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:43.549 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T02:22:43.550 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:43.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:22:43.580 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:43.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:43.648 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:22:43.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:22:43.677 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:22:43.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:43.743 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:22:43.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:22:43.772 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:22:43.773 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:22:43.839 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-12T02:22:43.840 INFO:tasks.cephadm:Adding mgr.y on smithi134 2024-09-12T02:22:43.840 INFO:tasks.cephadm:Adding mgr.z on smithi173 2024-09-12T02:22:43.840 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi134=y;smithi173=z' 2024-09-12T02:22:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:22:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: Updating smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: Updating smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:44.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:44.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: Reconfiguring daemon mon.a on smithi001 2024-09-12T02:22:44.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: Updating smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: Updating smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: Reconfiguring daemon mon.a on smithi001 2024-09-12T02:22:44.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: Updating smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: Updating smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: Updating smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:22:44.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:44.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:44.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:44.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: Reconfiguring daemon mon.a on smithi001 2024-09-12T02:22:44.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:44.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 -- 172.21.15.173:0/907663553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 msgr2=0x7efd841009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 --2- 172.21.15.173:0/907663553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd841009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009880 tx=0x7efd7c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 -- 172.21.15.173:0/907663553 shutdown_connections 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 --2- 172.21.15.173:0/907663553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd841009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 -- 172.21.15.173:0/907663553 >> 172.21.15.173:0/907663553 conn(0x7efd840fbdb0 msgr2=0x7efd840fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 -- 172.21.15.173:0/907663553 shutdown_connections 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.717+0000 7efd8c083640 1 -- 172.21.15.173:0/907663553 wait complete. 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 Processor -- start 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 -- start start 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd8406a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84199d00 0x7efd8419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd841066f0 con 0x7efd841005e0 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd84106570 con 0x7efd84199d00 2024-09-12T02:22:44.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8c083640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd84106870 con 0x7efd8419c630 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8a620640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8a620640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39972/0 (socket says 172.21.15.173:39972) 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd89e1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd8406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8a620640 1 -- 172.21.15.173:0/1307400335 learned_addr learned my addr 172.21.15.173:0/1307400335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8961e640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84199d00 0x7efd8419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8a620640 1 -- 172.21.15.173:0/1307400335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84199d00 msgr2=0x7efd8419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.718+0000 7efd8a620640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84199d00 0x7efd8419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.719+0000 7efd8a620640 1 -- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 msgr2=0x7efd8406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.719+0000 7efd8a620640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd8406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.719+0000 7efd8a620640 1 -- 172.21.15.173:0/1307400335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8419f400 con 0x7efd8419c630 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.719+0000 7efd89e1f640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd8406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:44.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.719+0000 7efd8a620640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ba50 tx=0x7efd7400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.720+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74019070 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.720+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd7400cbe0 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.720+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740076a0 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.720+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8419f690 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.720+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8419fc50 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.721+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7efd7401c070 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.721+0000 7efd82ffd640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 0x7efd6c03ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.721+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd7404ba20 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.721+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd84100a60 con 0x7efd8419c630 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.721+0000 7efd89e1f640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 0x7efd6c03ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:44.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.722+0000 7efd89e1f640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 0x7efd6c03ba00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd7c005ab0 tx=0x7efd7c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:44.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.727+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd7400e0a0 con 0x7efd8419c630 2024-09-12T02:22:44.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.904+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi134=y;smithi173=z", "target": ["mon-mgr", ""]}) -- 0x7efd840626c0 con 0x7efd6c039540 2024-09-12T02:22:44.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.910+0000 7efd82ffd640 1 -- 172.21.15.173:0/1307400335 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efd840626c0 con 0x7efd6c039540 2024-09-12T02:22:44.910 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2024-09-12T02:22:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 msgr2=0x7efd6c03ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 0x7efd6c03ba00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd7c005ab0 tx=0x7efd7c0315d0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 msgr2=0x7efd8419eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ba50 tx=0x7efd7400bf10 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 shutdown_connections 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd6c039540 0x7efd6c03ba00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd8419c630 0x7efd8419eaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84199d00 0x7efd8419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 --2- 172.21.15.173:0/1307400335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd841005e0 0x7efd8406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 >> 172.21.15.173:0/1307400335 conn(0x7efd840fbdb0 msgr2=0x7efd840fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 shutdown_connections 2024-09-12T02:22:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:22:44.912+0000 7efd8c083640 1 -- 172.21.15.173:0/1307400335 wait complete. 2024-09-12T02:22:45.477 DEBUG:teuthology.orchestra.run.smithi134:mgr.y> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T02:22:45.480 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T02:22:45.483 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T02:22:45.483 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:22:45.483 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:22:45.503 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:22:45.503 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-12 02:22:02.798531442 +0000 2024-09-12T02:22:45.564 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-12 02:17:46.885316257 +0000 2024-09-12T02:22:45.565 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-12 02:17:46.885316257 +0000 2024-09-12T02:22:45.565 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-12 02:17:46.885316257 +0000 2024-09-12T02:22:45.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:22:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-12T02:22:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-12T02:22:45.635 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000134678 s, 3.8 MB/s 2024-09-12T02:22:45.636 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:22:45.696 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:45.755 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-12 02:22:02.833531008 +0000 2024-09-12T02:22:45.756 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-12 02:17:47.195312658 +0000 2024-09-12T02:22:45.756 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-12 02:17:47.195312658 +0000 2024-09-12T02:22:45.756 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-12 02:17:47.195312658 +0000 2024-09-12T02:22:45.756 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:22:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-12T02:22:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-12T02:22:45.823 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000123828 s, 4.1 MB/s 2024-09-12T02:22:45.824 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:22:45.884 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-12 02:22:02.869530561 +0000 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-12 02:17:47.538308676 +0000 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-12 02:17:47.538308676 +0000 2024-09-12T02:22:45.942 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-12 02:17:47.538308676 +0000 2024-09-12T02:22:45.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:22:46.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:46.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: Reconfiguring daemon mon.b on smithi134 2024-09-12T02:22:46.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-12T02:22:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-12T02:22:46.009 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000107195 s, 4.8 MB/s 2024-09-12T02:22:46.010 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:22:46.069 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-12T02:22:46.096 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: Reconfiguring daemon mon.b on smithi134 2024-09-12T02:22:46.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.127 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-12 02:22:02.907530088 +0000 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-12 02:17:47.857304972 +0000 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-12 02:17:47.857304972 +0000 2024-09-12T02:22:46.128 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-12 02:17:47.857304972 +0000 2024-09-12T02:22:46.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:22:46.193 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-12T02:22:46.194 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-12T02:22:46.194 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000111119 s, 4.6 MB/s 2024-09-12T02:22:46.195 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:46.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:46.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: Reconfiguring daemon mon.b on smithi134 2024-09-12T02:22:46.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:46.252 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-12T02:22:46.253 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:22:46.272 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:22:46.272 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-12 02:22:35.407197549 +0000 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-12 02:17:55.891035826 +0000 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-12 02:17:55.891035826 +0000 2024-09-12T02:22:46.330 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-12 02:17:55.891035826 +0000 2024-09-12T02:22:46.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:22:46.397 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-12T02:22:46.398 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-12T02:22:46.398 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000282979 s, 1.8 MB/s 2024-09-12T02:22:46.399 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:22:46.457 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-12T02:22:46.517 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:22:46.517 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:46.517 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:22:46.517 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:46.517 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:46.518 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-12 02:22:35.408197524 +0000 2024-09-12T02:22:46.518 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-12 02:17:56.223027344 +0000 2024-09-12T02:22:46.518 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-12 02:17:56.223027344 +0000 2024-09-12T02:22:46.518 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-12 02:17:56.223027344 +0000 2024-09-12T02:22:46.518 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:22:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-12T02:22:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-12T02:22:46.582 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000212819 s, 2.4 MB/s 2024-09-12T02:22:46.583 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:22:46.641 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-12T02:22:46.697 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-12 02:22:35.408197524 +0000 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-12 02:17:56.540019247 +0000 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-12 02:17:56.540019247 +0000 2024-09-12T02:22:46.698 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-12 02:17:56.540019247 +0000 2024-09-12T02:22:46.698 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:22:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-12T02:22:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-12T02:22:46.763 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000221871 s, 2.3 MB/s 2024-09-12T02:22:46.764 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:22:46.821 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-12T02:22:46.877 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-12 02:22:35.408197524 +0000 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-12 02:17:56.862011021 +0000 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-12 02:17:56.862011021 +0000 2024-09-12T02:22:46.880 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-12 02:17:56.862011021 +0000 2024-09-12T02:22:46.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:22:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-12T02:22:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-12T02:22:46.941 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.0001951 s, 2.6 MB/s 2024-09-12T02:22:46.942 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:22:46.999 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T02:22:46.999 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:22:47.016 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:22:47.016 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-12T02:22:47.071 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:22:47.071 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 02:22:26.480583023 +0000 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 02:18:05.868032214 +0000 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 02:18:05.868032214 +0000 2024-09-12T02:22:47.072 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 02:18:05.868032214 +0000 2024-09-12T02:22:47.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi134=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: Saving service mgr spec with placement smithi001=x;smithi134=y;smithi173=z;count:3 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:47.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi134=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: Saving service mgr spec with placement smithi001=x;smithi134=y;smithi173=z;count:3 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:47.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:47.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T02:22:47.137 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T02:22:47.137 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00026635 s, 1.9 MB/s 2024-09-12T02:22:47.138 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi134=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: Saving service mgr spec with placement smithi001=x;smithi134=y;smithi173=z;count:3 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:22:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:47.195 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 02:22:26.481583001 +0000 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 02:18:06.224024000 +0000 2024-09-12T02:22:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 02:18:06.224024000 +0000 2024-09-12T02:22:47.253 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 02:18:06.224024000 +0000 2024-09-12T02:22:47.253 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:22:47.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T02:22:47.316 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T02:22:47.316 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000198784 s, 2.6 MB/s 2024-09-12T02:22:47.317 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:22:47.373 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-12T02:22:47.429 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 02:22:26.481583001 +0000 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 02:18:06.551016455 +0000 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 02:18:06.551016455 +0000 2024-09-12T02:22:47.430 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 02:18:06.551016455 +0000 2024-09-12T02:22:47.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:22:47.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T02:22:47.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T02:22:47.494 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00022477 s, 2.3 MB/s 2024-09-12T02:22:47.495 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:22:47.552 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 02:22:26.482582978 +0000 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 02:18:06.878008909 +0000 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 02:18:06.878008909 +0000 2024-09-12T02:22:47.610 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 02:18:06.878008909 +0000 2024-09-12T02:22:47.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:22:47.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T02:22:47.673 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T02:22:47.674 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00019114 s, 2.7 MB/s 2024-09-12T02:22:47.675 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:22:47.731 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-12T02:22:47.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:22:47.996 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: Reconfiguring daemon mon.c on smithi173 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:48.042 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:48.043 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: Reconfiguring daemon mon.c on smithi173 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:48.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:48.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: Reconfiguring daemon mon.c on smithi173 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:48.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:48.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:48.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:48.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:48.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:49.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:48 smithi173 ceph-mon[35036]: Deploying daemon mgr.z on smithi173 2024-09-12T02:22:49.085 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 systemd[1]: Starting Ceph mgr.z for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:22:49.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:48 smithi001 ceph-mon[31252]: Deploying daemon mgr.z on smithi173 2024-09-12T02:22:49.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:48 smithi134 ceph-mon[35091]: Deploying daemon mgr.z on smithi173 2024-09-12T02:22:49.339 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 podman[36828]: 2024-09-12 02:22:49.20533243 +0000 UTC m=+0.015382415 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:22:49.339 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 podman[36828]: 2024-09-12 02:22:49.340091806 +0000 UTC m=+0.150141793 container create 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:22:49.654 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 podman[36828]: 2024-09-12 02:22:49.526334409 +0000 UTC m=+0.336384399 container init 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:22:49.654 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 podman[36828]: 2024-09-12 02:22:49.529034192 +0000 UTC m=+0.339084185 container start 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T02:22:49.654 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mgr[36847]: -- 172.21.15.173:0/1303360482 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc629170e0 con 0x55fc628f5000 2024-09-12T02:22:49.654 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 bash[36828]: 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c 2024-09-12T02:22:49.654 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 systemd[1]: Started Ceph mgr.z for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:49.653+0000 7fbefe730040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:49.711+0000 7fbefe730040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:49.861+0000 7fbefe730040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:49.927+0000 7fbefe730040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.928 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.929 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:49.929 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:49.929 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:49.929 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:49.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:50.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:50.097 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:50.098 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:50.198 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:50.075+0000 7fbefe730040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:50.527 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:50.215+0000 7fbefe730040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:22:50.528 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:50.527+0000 7fbefe730040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:22:50.562 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:22:50.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-12T02:22:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:22:50.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:50 smithi001 ceph-mon[31252]: Deploying daemon mgr.y on smithi134 2024-09-12T02:22:50.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-mon[35036]: Deploying daemon mgr.y on smithi134 2024-09-12T02:22:50.947 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:50.589+0000 7fbefe730040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:22:50.947 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:50.774+0000 7fbefe730040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:22:51.017 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:50 smithi134 ceph-mon[35091]: Deploying daemon mgr.y on smithi134 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 -- 172.21.15.1:0/755875434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b24104fd0 msgr2=0x7f7b241073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 --2- 172.21.15.1:0/755875434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b24104fd0 0x7f7b241073c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009900 tx=0x7f7b1802a410 comp rx=0 tx=0).stop 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 -- 172.21.15.1:0/755875434 shutdown_connections 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 --2- 172.21.15.1:0/755875434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b24104fd0 0x7f7b241073c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 --2- 172.21.15.1:0/755875434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 0x7f7b24109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 --2- 172.21.15.1:0/755875434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b241026a0 0x7f7b24104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 -- 172.21.15.1:0/755875434 >> 172.21.15.1:0/755875434 conn(0x7f7b240fc2a0 msgr2=0x7f7b240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 -- 172.21.15.1:0/755875434 shutdown_connections 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.264+0000 7f7b2991c640 1 -- 172.21.15.1:0/755875434 wait complete. 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 Processor -- start 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 -- start start 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b24104fd0 0x7f7b24198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 0x7f7b2419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2410d8f0 con 0x7f7b241026a0 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2410d770 con 0x7f7b24107900 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b2991c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2410da70 con 0x7f7b24104fd0 2024-09-12T02:22:51.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b22ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b22ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60340/0 (socket says 172.21.15.1:60340) 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b22ffd640 1 -- 172.21.15.1:0/672696338 learned_addr learned my addr 172.21.15.1:0/672696338 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b227fc640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b24104fd0 0x7f7b24198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.265+0000 7f7b237fe640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 0x7f7b2419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 -- 172.21.15.1:0/672696338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b24104fd0 msgr2=0x7f7b24198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b24104fd0 0x7f7b24198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 -- 172.21.15.1:0/672696338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 msgr2=0x7f7b2419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 0x7f7b2419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 -- 172.21.15.1:0/672696338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2419fb30 con 0x7f7b241026a0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b22ffd640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e9f0 tx=0x7f7b1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400cd80 con 0x7f7b241026a0 2024-09-12T02:22:51.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b14005500 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2419fe20 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14010690 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.266+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b241a0220 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.267+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f7b14010830 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.267+0000 7f7b2891a640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 0x7f7b0c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.267+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b240fdd90 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.267+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7b1404c860 con 0x7f7b241026a0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.267+0000 7f7b227fc640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 0x7f7b0c03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.268+0000 7f7b227fc640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 0x7f7b0c03b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b1802aa00 tx=0x7f7b180315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:51.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.272+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b140203a0 con 0x7f7b241026a0 2024-09-12T02:22:51.413 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 systemd[1]: Starting Ceph mgr.y for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:22:51.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:51.455+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7b24062630 con 0x7f7b0c0392c0 2024-09-12T02:22:51.726 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 podman[36442]: 2024-09-12 02:22:51.424248743 +0000 UTC m=+0.099048607 container create 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:22:51.726 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 podman[36442]: 2024-09-12 02:22:51.340838179 +0000 UTC m=+0.015638050 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:22:51.726 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 podman[36442]: 2024-09-12 02:22:51.726739508 +0000 UTC m=+0.401539376 container init 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-mon[35036]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:51.656+0000 7fbefe730040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:22:51.947 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:51.722+0000 7fbefe730040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:22:51.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:51 smithi001 ceph-mon[31252]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:51.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:22:51.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:22:51.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:52.076 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-mon[35091]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:52.076 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 podman[36442]: 2024-09-12 02:22:51.730203346 +0000 UTC m=+0.405003210 container start 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-mgr[36461]: -- 172.21.15.134:0/853768561 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d1c19ff0e0 con 0x55d1c19dd000 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 bash[36442]: 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 systemd[1]: Started Ceph mgr.y for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:51.859+0000 7fb19ee40040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:51.918+0000 7fb19ee40040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:52.077 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.075+0000 7fb19ee40040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:22:52.413 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.145+0000 7fb19ee40040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:22:52.413 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.313+0000 7fb19ee40040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:52.738 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.468+0000 7fb19ee40040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:22:52.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:52.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:52.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:52.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:52.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:52.745 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:52.745 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:52.489+0000 7fbefe730040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:22:52.745 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:52.608+0000 7fbefe730040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:22:53.064 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:52.767+0000 7fbefe730040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:52.828+0000 7fbefe730040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:52.982+0000 7fbefe730040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.061+0000 7fbefe730040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.065 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.066 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.066 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.066 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:53.066 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.797+0000 7fb19ee40040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:22:53.066 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:52.859+0000 7fb19ee40040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:22:53.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:22:53.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:53.353 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.124+0000 7fbefe730040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:22:53.353 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.287+0000 7fbefe730040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:22:53.353 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.352+0000 7fbefe730040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:22:53.413 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:53.064+0000 7fb19ee40040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:22:53.623 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.419+0000 7fbefe730040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:22:53.623 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.502+0000 7fbefe730040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:53.623 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.562+0000 7fbefe730040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:22:53.623 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:53.621+0000 7fbefe730040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:53.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:53.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:54.029 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:53.963+0000 7fb19ee40040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:54.029+0000 7fb19ee40040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:54.030 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:54.031 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:54.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:22:54.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:22:54.053 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:54.697 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z[36843]: 2024-09-12T02:22:54.410+0000 7fbefe730040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:22:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:54.917+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7f7b14007d10 con 0x7f7b241026a0 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:54.745+0000 7fb19ee40040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:54.863+0000 7fb19ee40040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: Reconfiguring daemon mgr.x on smithi001 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]: dispatch 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]': finished 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:22:55.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1743189085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: Standby manager daemon z started 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:22:55.009 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:54 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: Reconfiguring daemon mgr.x on smithi001 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]: dispatch 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]': finished 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1743189085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:22:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: Standby manager daemon z started 2024-09-12T02:22:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:22:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:22:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:54 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: Reconfiguring daemon mgr.x on smithi001 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]: dispatch 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1886726759' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91edd80-c796-47b3-a871-e6ebadc51a2a"}]': finished 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:22:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1743189085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: Standby manager daemon z started 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:22:55.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:54 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.173:0/1392957868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:55.287 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.007+0000 7fb19ee40040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:55.287 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.069+0000 7fb19ee40040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:22:55.287 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.218+0000 7fb19ee40040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:22:55.287 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.286+0000 7fb19ee40040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:22:55.572 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.347+0000 7fb19ee40040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:22:55.572 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.505+0000 7fb19ee40040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:22:55.572 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.571+0000 7fb19ee40040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:22:55.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-mon[35091]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:55.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-mon[35091]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T02:22:55.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:22:55.843 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.638+0000 7fb19ee40040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:22:55.843 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.720+0000 7fb19ee40040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:55.843 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.782+0000 7fb19ee40040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:22:55.843 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:55.842+0000 7fb19ee40040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:22:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:55 smithi001 ceph-mon[31252]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:55 smithi001 ceph-mon[31252]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T02:22:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:22:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:55 smithi173 ceph-mon[35036]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:55 smithi173 ceph-mon[35036]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T02:22:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:22:56.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:22:56.754+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f7b140046c0 con 0x7f7b241026a0 2024-09-12T02:22:56.913 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y[36457]: 2024-09-12T02:22:56.625+0000 7fb19ee40040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:22:56.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-mon[35091]: Standby manager daemon y started 2024-09-12T02:22:56.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:22:56.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:56.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:22:56.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:56 smithi134 ceph-mon[35091]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:56 smithi001 ceph-mon[31252]: Standby manager daemon y started 2024-09-12T02:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:56 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:56 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:56 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:22:57.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:56 smithi001 ceph-mon[31252]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:57.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:56 smithi173 ceph-mon[35036]: Standby manager daemon y started 2024-09-12T02:22:57.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:56 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:22:57.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:56 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:22:57.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:56 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:22:57.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:56 smithi173 ceph-mon[35036]: from='mgr.? 172.21.15.134:0/125287766' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:22:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:57 smithi001 ceph-mon[31252]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:57 smithi001 ceph-mon[31252]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T02:22:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:57 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:22:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:57 smithi134 ceph-mon[35091]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:57 smithi134 ceph-mon[35091]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T02:22:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:57 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:22:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:57 smithi173 ceph-mon[35036]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:22:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:57 smithi173 ceph-mon[35036]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-12T02:22:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:57 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:23:00.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:22:59 smithi001 ceph-mon[31252]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:22:59 smithi134 ceph-mon[35091]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:22:59 smithi173 ceph-mon[35036]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:02.009 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:01 smithi173 ceph-mon[35036]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:02.009 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.009 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.009 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:02.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:01 smithi001 ceph-mon[31252]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:02.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:01 smithi134 ceph-mon[35091]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:03.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:03.065 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:03.065 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:03.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:03.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:03.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:04.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:03 smithi001 ceph-mon[31252]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:04.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:23:04.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:03 smithi134 ceph-mon[35091]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:23:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:03 smithi173 ceph-mon[35036]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:23:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:04 smithi001 ceph-mon[31252]: Deploying daemon osd.0 on smithi001 2024-09-12T02:23:05.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:04 smithi134 ceph-mon[35091]: Deploying daemon osd.0 on smithi001 2024-09-12T02:23:05.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:04 smithi173 ceph-mon[35036]: Deploying daemon osd.0 on smithi001 2024-09-12T02:23:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:05 smithi001 ceph-mon[31252]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:05 smithi134 ceph-mon[35091]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:06.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:05 smithi173 ceph-mon[35036]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:08.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:07 smithi001 ceph-mon[31252]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:07 smithi134 ceph-mon[35091]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:07 smithi173 ceph-mon[35036]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:09 smithi001 ceph-mon[31252]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:09 smithi134 ceph-mon[35091]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:09 smithi173 ceph-mon[35036]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:12.116 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:11 smithi001 ceph-mon[31252]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:11 smithi134 ceph-mon[35091]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:11 smithi173 ceph-mon[35036]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:13.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:13.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.093 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-12T02:23:14.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.092+0000 7f7b2891a640 1 -- 172.21.15.1:0/672696338 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7b24062630 con 0x7f7b0c0392c0 2024-09-12T02:23:14.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 msgr2=0x7f7b0c03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 0x7f7b0c03b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b1802aa00 tx=0x7f7b180315b0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 msgr2=0x7f7b24197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400e9f0 tx=0x7f7b1400edf0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 shutdown_connections 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b0c0392c0 0x7f7b0c03b780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b24107900 0x7f7b2419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b24104fd0 0x7f7b24198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 --2- 172.21.15.1:0/672696338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b241026a0 0x7f7b24197f00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 >> 172.21.15.1:0/672696338 conn(0x7f7b240fc2a0 msgr2=0x7f7b24102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 shutdown_connections 2024-09-12T02:23:14.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:23:14.095+0000 7f7b2991c640 1 -- 172.21.15.1:0/672696338 wait complete. 2024-09-12T02:23:14.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:14 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:14.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:14 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:14 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:14 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:14.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:14 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:14 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:14.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:14 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:14.750 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T02:23:14.752 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_4... 2024-09-12T02:23:14.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:23:14.992 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:23:15.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:15 smithi001 ceph-mon[31252]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:15.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:15 smithi134 ceph-mon[35091]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:15.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:15 smithi173 ceph-mon[35036]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:15.997 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:23:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:23:15.677+0000 7fa8165fb640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:23:16.578 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:16 smithi134 ceph-mon[35091]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:23:16.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:16 smithi001 ceph-mon[31252]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:23:16.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:16 smithi173 ceph-mon[35036]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:23:17.295 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:23:17.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-09-12T02:23:17.576 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:23:17.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:17 smithi134 ceph-mon[35091]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:17.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:17 smithi134 ceph-mon[35091]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:23:17.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:17 smithi134 ceph-mon[35091]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:23:17.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:17 smithi134 ceph-mon[35091]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:23:17.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:17 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:17.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:17 smithi173 ceph-mon[35036]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:17.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:17 smithi173 ceph-mon[35036]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:23:17.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:17 smithi173 ceph-mon[35036]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:23:17.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:17 smithi173 ceph-mon[35036]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:23:17.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:17 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:17.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-mon[31252]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:17.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-mon[31252]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:23:17.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-mon[31252]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:23:17.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-mon[31252]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:23:17.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 -- 172.21.15.134:0/1521678207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc01078c0 msgr2=0x7fecc0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 --2- 172.21.15.134:0/1521678207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc01078c0 0x7fecc0109d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009ca0 tx=0x7fecb802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 -- 172.21.15.134:0/1521678207 shutdown_connections 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 --2- 172.21.15.134:0/1521678207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc01078c0 0x7fecc0109d10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 --2- 172.21.15.134:0/1521678207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc0104f90 0x7fecc0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 --2- 172.21.15.134:0/1521678207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 -- 172.21.15.134:0/1521678207 >> 172.21.15.134:0/1521678207 conn(0x7fecc00fc280 msgr2=0x7fecc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:18.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 -- 172.21.15.134:0/1521678207 shutdown_connections 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.022+0000 7fecc77ca640 1 -- 172.21.15.134:0/1521678207 wait complete. 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.023+0000 7fecc77ca640 1 Processor -- start 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.023+0000 7fecc77ca640 1 -- start start 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.023+0000 7fecc77ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.023+0000 7fecc77ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.023+0000 7fecc77ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 0x7fecc0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc77ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010d880 con 0x7fecc0102660 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc77ca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010d700 con 0x7fecc0104f90 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc77ca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecc010da00 con 0x7fecc01078c0 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc5566640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53218/0 (socket says 172.21.15.134:53218) 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc5566640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.134:37048/0 (socket says 172.21.15.134:37048) 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 -- 172.21.15.134:0/2837560876 learned_addr learned my addr 172.21.15.134:0/2837560876 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc5d67640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 0x7fecc0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 -- 172.21.15.134:0/2837560876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 msgr2=0x7fecc0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 0x7fecc0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 -- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 msgr2=0x7fecc0101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 -- 172.21.15.134:0/2837560876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0101410 con 0x7fecc0104f90 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc5d67640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 0x7fecc0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc4d65640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c970 tx=0x7fecb000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007bb0 con 0x7fecc0104f90 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb0007d50 con 0x7fecc0104f90 2024-09-12T02:23:18.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc01a2060 con 0x7fecc0104f90 2024-09-12T02:23:18.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb00187a0 con 0x7fecc0104f90 2024-09-12T02:23:18.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.024+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc01a2570 con 0x7fecc0104f90 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.025+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc00fdd70 con 0x7fecc0104f90 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.026+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fecb000f450 con 0x7fecc0104f90 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.027+0000 7fecb67fc640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 0x7fecac0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.028+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fecb00cd400 con 0x7fecc0104f90 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.028+0000 7fecc5566640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 0x7fecac0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.028+0000 7fecc5566640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 0x7fecac0a5030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0058c0 tx=0x7fecbc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:18.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.031+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fecb0014030 con 0x7fecc0104f90 2024-09-12T02:23:18.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:23:17.783+0000 7fa81257e640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:23:18.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:23:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:23:17.786+0000 7fa80a39e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:23:18.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:18.212+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fecc0062630 con 0x7fecac0a2b70 2024-09-12T02:23:18.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:23:18.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:23:18.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:18.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:18 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:18.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:23:18.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:23:18.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:18.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:18 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:23:18.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946]' entity='osd.0' 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:18.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:18.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:18.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:18.878 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:18 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:19.527 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:23:19.527 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:23:19.527 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi001 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] boot 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:23:19.528 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:23:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:23:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi001 2024-09-12T02:23:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] boot 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:23:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi001 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: osd.0 [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] boot 2024-09-12T02:23:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:23:19.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:23:21.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:21.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:23:21.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/932693351' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]': finished 2024-09-12T02:23:21.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:23:21.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:21.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:21 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/3458308893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/932693351' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]': finished 2024-09-12T02:23:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:23:21.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:21.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:21 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/3458308893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:23:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/932693351' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]: dispatch 2024-09-12T02:23:21.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32978f3c-0f78-4c37-97a5-9dbb4297a1fb"}]': finished 2024-09-12T02:23:21.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:23:21.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:21.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/3458308893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:23.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:23 smithi134 ceph-mon[35091]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:23.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:23 smithi173 ceph-mon[35036]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:23 smithi001 ceph-mon[31252]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:25.552 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:25 smithi134 ceph-mon[35091]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:25.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:25 smithi173 ceph-mon[35036]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:25 smithi001 ceph-mon[31252]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:27.533 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:27 smithi134 ceph-mon[35091]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:27.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:27 smithi173 ceph-mon[35036]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:27 smithi001 ceph-mon[31252]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:29.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:29 smithi134 ceph-mon[35091]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:29.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:23:29.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:29.426 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:29 smithi134 ceph-mon[35091]: Deploying daemon osd.1 on smithi134 2024-09-12T02:23:29.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:29 smithi173 ceph-mon[35036]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:29.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:23:29.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:29.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:29 smithi173 ceph-mon[35036]: Deploying daemon osd.1 on smithi134 2024-09-12T02:23:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:29 smithi001 ceph-mon[31252]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:23:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:29 smithi001 ceph-mon[31252]: Deploying daemon osd.1 on smithi134 2024-09-12T02:23:31.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:31 smithi173 ceph-mon[35036]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:31.850 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:31 smithi134 ceph-mon[35091]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:31 smithi001 ceph-mon[31252]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:33 smithi173 ceph-mon[35036]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:33.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:33 smithi134 ceph-mon[35091]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:33 smithi001 ceph-mon[31252]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:35.660 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:35 smithi134 ceph-mon[35091]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:35.660 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:35 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:35.661 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:35 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:35.661 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:35 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:35 smithi173 ceph-mon[35036]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:35 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:35 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:35 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:35 smithi001 ceph-mon[31252]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:35 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:35 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:35 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:37.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:37 smithi173 ceph-mon[35036]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:37.815 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:37 smithi134 ceph-mon[35091]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:37 smithi001 ceph-mon[31252]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:38.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.445+0000 7fecb67fc640 1 -- 172.21.15.134:0/2837560876 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fecc0062630 con 0x7fecac0a2b70 2024-09-12T02:23:38.446 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.447+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 msgr2=0x7fecac0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.447+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 0x7fecac0a5030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0058c0 tx=0x7fecbc00a2d0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.447+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 msgr2=0x7fecc0100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c970 tx=0x7fecb000ce30 comp rx=0 tx=0).stop 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 shutdown_connections 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fecac0a2b70 0x7fecac0a5030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01078c0 0x7fecc0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0104f90 0x7fecc0100610 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 --2- 172.21.15.134:0/2837560876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecc0102660 0x7fecc0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 >> 172.21.15.134:0/2837560876 conn(0x7fecc00fc280 msgr2=0x7fecc0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 shutdown_connections 2024-09-12T02:23:38.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:23:38.448+0000 7fecc77ca640 1 -- 172.21.15.134:0/2837560876 wait complete. 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:38.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:38.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:39.055 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:23:39.057 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2024-09-12T02:23:39.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:23:39.308 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:23:39.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:39 smithi173 ceph-mon[35036]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:39 smithi001 ceph-mon[31252]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:39.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:39 smithi134 ceph-mon[35091]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:41.380 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:23:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:23:40.953+0000 7f31cc3f0640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:23:41.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:41 smithi134 ceph-mon[35091]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:41.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:41 smithi134 ceph-mon[35091]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:41.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:41 smithi134 ceph-mon[35091]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:41.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:41 smithi173 ceph-mon[35036]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:41.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:41 smithi173 ceph-mon[35036]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:41.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:41 smithi173 ceph-mon[35036]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:41.745 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:23:41.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-09-12T02:23:41.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:41 smithi001 ceph-mon[31252]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:41.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:41 smithi001 ceph-mon[31252]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:41.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:41 smithi001 ceph-mon[31252]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:23:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:23:42.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 -- 172.21.15.173:0/240482980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644102690 msgr2=0x7f9644108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 --2- 172.21.15.173:0/240482980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644102690 0x7f9644108f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f963c009ca0 tx=0x7f963c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 -- 172.21.15.173:0/240482980 shutdown_connections 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 --2- 172.21.15.173:0/240482980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644102690 0x7f9644108f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 --2- 172.21.15.173:0/240482980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644101cd0 0x7f9644102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 --2- 172.21.15.173:0/240482980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f9644100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 -- 172.21.15.173:0/240482980 >> 172.21.15.173:0/240482980 conn(0x7f96440fc280 msgr2=0x7f96440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 -- 172.21.15.173:0/240482980 shutdown_connections 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 -- 172.21.15.173:0/240482980 wait complete. 2024-09-12T02:23:42.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.487+0000 7f9649b4d640 1 Processor -- start 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 -- start start 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f964406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644102690 0x7f964419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f964410c850 con 0x7f9644100ad0 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f964410c6d0 con 0x7f9644102690 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9649b4d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f964410c9d0 con 0x7f9644101cd0 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34442/0 (socket says 172.21.15.173:34442) 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 -- 172.21.15.173:0/62853652 learned_addr learned my addr 172.21.15.173:0/62853652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f96437fe640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f964406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:42.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9643fff640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644102690 0x7f964419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 -- 172.21.15.173:0/62853652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644102690 msgr2=0x7f964419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644102690 0x7f964419f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 -- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 msgr2=0x7f964406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f964406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 -- 172.21.15.173:0/62853652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964419fbb0 con 0x7f9644101cd0 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f96437fe640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f964406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.488+0000 7f9642ffd640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f963800d770 tx=0x7f963800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.489+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638017070 con 0x7f9644101cd0 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.489+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9638005500 con 0x7f9644101cd0 2024-09-12T02:23:42.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.489+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964419fe40 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.489+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638004e00 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.489+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96441a0320 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.490+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9644107e00 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.492+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f9638004fa0 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.492+0000 7f9640ff9640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 0x7f962c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.492+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f96380cd4d0 con 0x7f9644101cd0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.493+0000 7f96437fe640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 0x7f962c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.493+0000 7f96437fe640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 0x7f962c0a4fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9644101b30 tx=0x7f9634008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:42.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.496+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f963809be20 con 0x7f9644101cd0 2024-09-12T02:23:42.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:23:42.673+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9644062630 con 0x7f962c0a2af0 2024-09-12T02:23:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:23:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:23:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi134 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:42 smithi001 ceph-mon[31252]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi134 2024-09-12T02:23:42.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-mon[35091]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi134 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:23:42.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-12T02:23:42.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:42.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:42.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:42.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:42 smithi173 ceph-mon[35036]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:23:43.413 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:23:42.991+0000 7f31c8373640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:23:43.413 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:23:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:23:42.995+0000 7f31c0193640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:43.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:43 smithi173 ceph-mon[35036]: from='osd.1 ' entity='osd.1' 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:43.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:43.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:43 smithi001 ceph-mon[31252]: from='osd.1 ' entity='osd.1' 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:43 smithi134 ceph-mon[35091]: from='osd.1 ' entity='osd.1' 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] boot 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:23:44.710 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] boot 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:23:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: osd.1 [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] boot 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:23:44.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/1619907249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]': finished 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:23:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:23:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/1619907249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]': finished 2024-09-12T02:23:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:23:45.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/1619907249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]: dispatch 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47693d9e-18db-46ef-9f0d-a712049351bc"}]': finished 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T02:23:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:23:46.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:46 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/658740950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:46.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:46 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/658740950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:46.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:46 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/658740950' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:23:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:47 smithi001 ceph-mon[31252]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:47.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:47 smithi134 ceph-mon[35091]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:47 smithi173 ceph-mon[35036]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:49.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:49 smithi001 ceph-mon[31252]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:49 smithi134 ceph-mon[35091]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:49.921 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:49 smithi173 ceph-mon[35036]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:51 smithi001 ceph-mon[31252]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:51.876 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:51 smithi173 ceph-mon[35036]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:51 smithi134 ceph-mon[35091]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:53 smithi001 ceph-mon[31252]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:23:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:53.896 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:53 smithi173 ceph-mon[35036]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:53.896 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:23:53.896 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:53 smithi134 ceph-mon[35091]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:23:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:54 smithi001 ceph-mon[31252]: Deploying daemon osd.2 on smithi173 2024-09-12T02:23:54.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:54 smithi173 ceph-mon[35036]: Deploying daemon osd.2 on smithi173 2024-09-12T02:23:54.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:54 smithi134 ceph-mon[35091]: Deploying daemon osd.2 on smithi173 2024-09-12T02:23:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:55 smithi001 ceph-mon[31252]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:55.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:55 smithi134 ceph-mon[35091]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:55 smithi173 ceph-mon[35036]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:57.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:57 smithi134 ceph-mon[35091]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:57 smithi173 ceph-mon[35036]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:57 smithi001 ceph-mon[31252]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:59 smithi134 ceph-mon[35091]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:23:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:59 smithi173 ceph-mon[35036]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:23:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:23:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:23:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:59 smithi001 ceph-mon[31252]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:23:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:01.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:01 smithi173 ceph-mon[35036]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:01 smithi134 ceph-mon[35091]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:02.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:01 smithi001 ceph-mon[31252]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:02.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:02.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:02.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:02.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:02.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:03.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:03.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.653 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-09-12T02:24:03.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.653+0000 7f9640ff9640 1 -- 172.21.15.173:0/62853652 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9644062630 con 0x7f962c0a2af0 2024-09-12T02:24:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 msgr2=0x7f962c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:03.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 0x7f962c0a4fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9644101b30 tx=0x7f9634008040 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 msgr2=0x7f964419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f963800d770 tx=0x7f963800dc30 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 shutdown_connections 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f962c0a2af0 0x7f962c0a4fb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9644102690 0x7f964419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9644101cd0 0x7f964419cc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 --2- 172.21.15.173:0/62853652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9644100ad0 0x7f964406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 >> 172.21.15.173:0/62853652 conn(0x7f96440fc280 msgr2=0x7f9644104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 shutdown_connections 2024-09-12T02:24:03.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:03.655+0000 7f9649b4d640 1 -- 172.21.15.173:0/62853652 wait complete. 2024-09-12T02:24:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:03 smithi173 ceph-mon[35036]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:04.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:03 smithi134 ceph-mon[35091]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:04.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:04.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:04.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:03 smithi001 ceph-mon[31252]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:04.275 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:24:04.278 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-12T02:24:04.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:24:04.530 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:24:05.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:05 smithi001 ceph-mon[31252]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:05.985 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:05 smithi173 ceph-mon[35036]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:05.986 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:24:05.820+0000 7f2af0718640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:24:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:05 smithi134 ceph-mon[35091]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:06 smithi001 ceph-mon[31252]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:06.727 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:06 smithi001 ceph-mon[31252]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:06.820 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:06 smithi173 ceph-mon[35036]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:06.820 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:06 smithi173 ceph-mon[35036]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:06 smithi134 ceph-mon[35091]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:06 smithi134 ceph-mon[35091]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:24:07.259 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:24:07.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-12T02:24:07.541 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:24:07.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:07.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:24:07.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:24:07.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:07.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:07.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 -- 172.21.15.1:0/2195236094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 msgr2=0x7fe308108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 --2- 172.21.15.1:0/2195236094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe308108f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe300009ca0 tx=0x7fe30002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 -- 172.21.15.1:0/2195236094 shutdown_connections 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 --2- 172.21.15.1:0/2195236094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe308108f60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 --2- 172.21.15.1:0/2195236094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308101d10 0x7fe308102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 --2- 172.21.15.1:0/2195236094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308100b10 0x7fe308100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 -- 172.21.15.1:0/2195236094 >> 172.21.15.1:0/2195236094 conn(0x7fe3080fc2a0 msgr2=0x7fe3080fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:08.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 -- 172.21.15.1:0/2195236094 shutdown_connections 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.011+0000 7fe30f793640 1 -- 172.21.15.1:0/2195236094 wait complete. 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 Processor -- start 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 -- start start 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 0x7fe30806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 0x7fe30819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe30819f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe30810c770 con 0x7fe3081026d0 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe30810c5f0 con 0x7fe308100b10 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30f793640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe30810c8f0 con 0x7fe308101d10 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30dd30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe30819f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30cd2e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 0x7fe30819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30cd2e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 0x7fe30819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:41752/0 (socket says 172.21.15.1:41752) 2024-09-12T02:24:08.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.012+0000 7fe30cd2e640 1 -- 172.21.15.1:0/1218491500 learned_addr learned my addr 172.21.15.1:0/1218491500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30d52f640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 0x7fe30806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 -- 172.21.15.1:0/1218491500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 msgr2=0x7fe30819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 0x7fe30819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 -- 172.21.15.1:0/1218491500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 msgr2=0x7fe30806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 0x7fe30806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 -- 172.21.15.1:0/1218491500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30819fb20 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30d52f640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 0x7fe30806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30dd30640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe30819f210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe300031ae0 tx=0x7fe300031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300003c30 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe300003dd0 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30819fd50 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30002fd40 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.013+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3081a02b0 con 0x7fe3081026d0 2024-09-12T02:24:08.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.014+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe308107f60 con 0x7fe3081026d0 2024-09-12T02:24:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.016+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fe300004050 con 0x7fe3081026d0 2024-09-12T02:24:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.016+0000 7fe2fe7fc640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 0x7fe2f40a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.016+0000 7fe30d52f640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 0x7fe2f40a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.016+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fe3000eec50 con 0x7fe3081026d0 2024-09-12T02:24:08.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.017+0000 7fe30d52f640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 0x7fe2f40a5030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe304005d00 tx=0x7fe304005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:08.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.020+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3000bd300 con 0x7fe3081026d0 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:08.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:08.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:08.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:24:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:24:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:08.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:08.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:08.205+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe308062630 con 0x7fe2f40a2b70 2024-09-12T02:24:08.447 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:24:08.074+0000 7f2aeceaf640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:24:08.447 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:24:08.078+0000 7f2ae44bb640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi173 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='osd.2 ' entity='osd.2' 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi173 2024-09-12T02:24:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T02:24:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:24:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:24:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:09.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:09.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='osd.2 ' entity='osd.2' 2024-09-12T02:24:09.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:09.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:09.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi173 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='osd.2 ' entity='osd.2' 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:09.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] boot 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:24:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:09 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] boot 2024-09-12T02:24:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:24:10.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:09 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: osd.2 [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] boot 2024-09-12T02:24:10.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T02:24:10.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:09 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:24:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]: dispatch 2024-09-12T02:24:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:10.977 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]': finished 2024-09-12T02:24:10.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: osdmap e18: 4 total, 3 up, 4 in 2024-09-12T02:24:10.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:10.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]: dispatch 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]': finished 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: osdmap e18: 4 total, 3 up, 4 in 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]: dispatch 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/686526420' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8878132e-22e5-4e0c-ab90-ea0d92368b07"}]': finished 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: osdmap e18: 4 total, 3 up, 4 in 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:24:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:11 smithi001 ceph-mon[31252]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:11 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/881737407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:11 smithi001 ceph-mon[31252]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T02:24:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:11 smithi134 ceph-mon[35091]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:11 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/881737407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:11 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:11 smithi134 ceph-mon[35091]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T02:24:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:11 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:11 smithi173 ceph-mon[35036]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:11 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/881737407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:11 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:24:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:11 smithi173 ceph-mon[35036]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T02:24:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:11 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:12.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[47790]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:12.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[47790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:12.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[47790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:12.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[47790]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:12.737+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe3000b9270 con 0x7fe3081026d0 2024-09-12T02:24:13.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[48159]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:13.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[48159]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:13.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[48159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:13.126 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:24:12 smithi001 sudo[48159]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:13.201 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:12 smithi134 sudo[43434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:13.201 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:12 smithi134 sudo[43434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:13.202 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:12 smithi134 sudo[43434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:13.202 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:12 smithi134 sudo[43434]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:13.663 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:13 smithi134 sudo[43437]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:13.663 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:13 smithi134 sudo[43437]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:13.663 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:13 smithi134 sudo[43437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:13.663 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:24:13 smithi134 sudo[43437]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:13.726 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44077]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:13.727 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44077]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:13.727 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:13.727 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44077]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:24:13.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:24:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:24:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:14.197 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44080]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:14.197 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:14.197 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:14.197 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:24:13 smithi173 sudo[44080]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:14.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48540]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:14.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48540]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:14.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:14.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48540]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:15.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:14 smithi001 sudo[48726]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:14 smithi173 sudo[44083]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:15.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:14 smithi173 sudo[44083]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:15.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:14 smithi173 sudo[44083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:15.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:14 smithi173 sudo[44083]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 sudo[44086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:15.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 sudo[44086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:15.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 sudo[44086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:15.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 sudo[44086]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43440]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:24:15.652 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:15.652 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:15.652 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43440]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:15.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:24:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:24:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 sudo[43443]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:15.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:15.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:15.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:16 smithi134 ceph-mon[35091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:16.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:16 smithi173 ceph-mon[35036]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:24:16.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:24:16.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:16 smithi001 ceph-mon[31252]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:24:17.859 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:17 smithi001 ceph-mon[31252]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:17 smithi173 ceph-mon[35036]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:17 smithi134 ceph-mon[35091]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:19 smithi134 ceph-mon[35091]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:24:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:19 smithi173 ceph-mon[35036]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:24:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:19 smithi001 ceph-mon[31252]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:24:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:20.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:20 smithi173 ceph-mon[35036]: Deploying daemon osd.3 on smithi001 2024-09-12T02:24:21.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:20 smithi001 ceph-mon[31252]: Deploying daemon osd.3 on smithi001 2024-09-12T02:24:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:20 smithi134 ceph-mon[35091]: Deploying daemon osd.3 on smithi001 2024-09-12T02:24:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:21 smithi173 ceph-mon[35036]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T02:24:22.015 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:21 smithi001 ceph-mon[31252]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T02:24:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:21 smithi134 ceph-mon[35091]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T02:24:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:23 smithi173 ceph-mon[35036]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T02:24:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:23 smithi001 ceph-mon[31252]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T02:24:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:23 smithi134 ceph-mon[35091]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T02:24:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:25 smithi173 ceph-mon[35036]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T02:24:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:25.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:25.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:25.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:25 smithi001 ceph-mon[31252]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T02:24:25.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:25.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:25.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:25 smithi134 ceph-mon[35091]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T02:24:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:27 smithi173 ceph-mon[35036]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:24:28.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:27 smithi001 ceph-mon[31252]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:24:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:27 smithi134 ceph-mon[35091]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:24:29.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:29.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.383+0000 7fe2fe7fc640 1 -- 172.21.15.1:0/1218491500 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe308062630 con 0x7fe2f40a2b70 2024-09-12T02:24:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-12T02:24:29.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 msgr2=0x7fe2f40a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:29.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 0x7fe2f40a5030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe304005d00 tx=0x7fe304005c90 comp rx=0 tx=0).stop 2024-09-12T02:24:29.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 msgr2=0x7fe30819f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:29.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe30819f210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe300031ae0 tx=0x7fe300031ee0 comp rx=0 tx=0).stop 2024-09-12T02:24:29.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 shutdown_connections 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe2f40a2b70 0x7fe2f40a5030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe3081026d0 0x7fe30819f210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe308101d10 0x7fe30819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 --2- 172.21.15.1:0/1218491500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe308100b10 0x7fe30806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 >> 172.21.15.1:0/1218491500 conn(0x7fe3080fc2a0 msgr2=0x7fe308105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 shutdown_connections 2024-09-12T02:24:29.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:24:29.385+0000 7fe30f793640 1 -- 172.21.15.1:0/1218491500 wait complete. 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.083 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:24:30.086 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-09-12T02:24:30.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:24:30.342 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:24:30.359 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:30 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:30.359 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:30 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.359 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:30 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:30 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:30 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:30 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:30 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:30.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:30 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:30.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:30 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:31.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:31 smithi001 ceph-mon[31252]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:31.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:31 smithi001 ceph-mon[31252]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:24:31.561 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:24:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:24:31.218+0000 7fb864c8f640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:24:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:31 smithi134 ceph-mon[35091]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:31 smithi134 ceph-mon[35091]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:24:31.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:31 smithi173 ceph-mon[35036]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T02:24:31.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:31 smithi173 ceph-mon[35036]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-mon[31252]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-mon[31252]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-mon[31252]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:32.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-mon[31252]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:24:32.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:32 smithi134 ceph-mon[35091]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:24:32.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:32 smithi134 ceph-mon[35091]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:24:32.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:32 smithi134 ceph-mon[35091]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:24:32.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:32.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:32 smithi134 ceph-mon[35091]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:24:32.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:32 smithi173 ceph-mon[35036]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:24:32.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:32 smithi173 ceph-mon[35036]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T02:24:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:32 smithi173 ceph-mon[35036]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:24:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:32.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:32 smithi173 ceph-mon[35036]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:24:32.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:24:32.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-09-12T02:24:33.046 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:24:32.819+0000 7fb860c12640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:24:33.046 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:24:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:24:32.825+0000 7fb858a32640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:24:33.105 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:24:33.479 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.480 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:33.481 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:33.481 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.562+0000 7fa20a7ca640 1 -- 172.21.15.134:0/1523634337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 msgr2=0x7fa204108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.562+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/1523634337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa204108f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009ca0 tx=0x7fa1fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 -- 172.21.15.134:0/1523634337 shutdown_connections 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/1523634337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204101d10 0x7fa204102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/1523634337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa204108f60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/1523634337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204100b10 0x7fa204100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 -- 172.21.15.134:0/1523634337 >> 172.21.15.134:0/1523634337 conn(0x7fa2040fc2a0 msgr2=0x7fa2040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 -- 172.21.15.134:0/1523634337 shutdown_connections 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 -- 172.21.15.134:0/1523634337 wait complete. 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 Processor -- start 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.563+0000 7fa20a7ca640 1 -- start start 2024-09-12T02:24:33.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 0x7fa204196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 0x7fa2041972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa20419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c790 con 0x7fa204100b10 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c610 con 0x7fa2041026d0 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c910 con 0x7fa204101d10 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa203fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 0x7fa204196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa20419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa203fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 0x7fa204196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.134:42658/0 (socket says 172.21.15.134:42658) 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa203fff640 1 -- 172.21.15.134:0/2777623322 learned_addr learned my addr 172.21.15.134:0/2777623322 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa2037fe640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 0x7fa2041972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 -- 172.21.15.134:0/2777623322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 msgr2=0x7fa2041972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 0x7fa2041972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 -- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 msgr2=0x7fa204196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 0x7fa204196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 -- 172.21.15.134:0/2777623322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20419e9e0 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa2037fe640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 0x7fa2041972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa208d67640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa20419e370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc031ae0 tx=0x7fa1fc031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003c30 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1fc003dd0 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20406a790 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc02fcc0 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.564+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20406aca0 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.565+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa204100f10 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.567+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa1fc004050 con 0x7fa2041026d0 2024-09-12T02:24:33.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.567+0000 7fa2017fa640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 0x7fa1ec0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.567+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7fa1fc0ef1d0 con 0x7fa2041026d0 2024-09-12T02:24:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.568+0000 7fa203fff640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 0x7fa1ec0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.568+0000 7fa203fff640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 0x7fa1ec0a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40058c0 tx=0x7fa1f4010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:33.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.571+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1fc0bd330 con 0x7fa2041026d0 2024-09-12T02:24:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:24:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:33.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:33.747+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa20406afc0 con 0x7fa1ec0a2bb0 2024-09-12T02:24:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:24:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465]' entity='osd.3' 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:33.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:34.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi001 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] boot 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:34.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:34.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:34.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi001 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] boot 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:24:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:34.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:34.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:34.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:24:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:24:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi001 2024-09-12T02:24:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-12T02:24:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: osd.3 [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] boot 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:34.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:35.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:35 smithi134 ceph-mon[35091]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:35.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:35 smithi134 ceph-mon[35091]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:24:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:35 smithi173 ceph-mon[35036]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:35 smithi173 ceph-mon[35036]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:24:35.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:35 smithi001 ceph-mon[31252]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:24:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:35 smithi001 ceph-mon[31252]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/2395946154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]': finished 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:24:36.656 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:36.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:24:36.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/2395946154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]': finished 2024-09-12T02:24:36.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:24:36.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/2395946154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]: dispatch 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5480c4ef-a2ee-44d0-8030-755ba1d6ffb1"}]': finished 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T02:24:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:37.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:37 smithi173 ceph-mon[35036]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:37.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:37 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/4115502339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:37.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:37 smithi173 ceph-mon[35036]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:24:37.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:37 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:37 smithi001 ceph-mon[31252]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:37 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/4115502339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:37 smithi001 ceph-mon[31252]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:24:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:37 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:37 smithi134 ceph-mon[35091]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:37 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/4115502339' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:24:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:37 smithi134 ceph-mon[35091]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:24:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:37 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:39.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:39 smithi173 ceph-mon[35036]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:39 smithi001 ceph-mon[31252]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:39.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:39 smithi134 ceph-mon[35091]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:41.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:41 smithi134 ceph-mon[35091]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:24:41.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:41 smithi173 ceph-mon[35036]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:24:41.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:41 smithi001 ceph-mon[31252]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:24:43.568 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:43 smithi134 ceph-mon[35091]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:24:43.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:43 smithi173 ceph-mon[35036]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:24:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:43 smithi001 ceph-mon[31252]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:24:45.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:45 smithi134 ceph-mon[35091]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:24:45.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:24:45.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:45.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:45 smithi134 ceph-mon[35091]: Deploying daemon osd.4 on smithi134 2024-09-12T02:24:45.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:45 smithi173 ceph-mon[35036]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:24:45.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:24:45.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:45.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:45 smithi173 ceph-mon[35036]: Deploying daemon osd.4 on smithi134 2024-09-12T02:24:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:45 smithi001 ceph-mon[31252]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:24:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:24:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:45.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:45 smithi001 ceph-mon[31252]: Deploying daemon osd.4 on smithi134 2024-09-12T02:24:47.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:47 smithi134 ceph-mon[35091]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:24:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:47 smithi001 ceph-mon[31252]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:24:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:47 smithi173 ceph-mon[35036]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:24:49.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:49 smithi134 ceph-mon[35091]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:24:49.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:49 smithi001 ceph-mon[31252]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:24:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:49 smithi173 ceph-mon[35036]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:24:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:51 smithi001 ceph-mon[31252]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:24:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:51 smithi134 ceph-mon[35091]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:24:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:51 smithi173 ceph-mon[35036]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:24:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:53.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:53 smithi134 ceph-mon[35091]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:53 smithi001 ceph-mon[31252]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:53 smithi173 ceph-mon[35036]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:54.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:54.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:54.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.754+0000 7fa2017fa640 1 -- 172.21.15.134:0/2777623322 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa20406afc0 con 0x7fa1ec0a2bb0 2024-09-12T02:24:54.755 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 msgr2=0x7fa1ec0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 0x7fa1ec0a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40058c0 tx=0x7fa1f4010040 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 msgr2=0x7fa20419e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa20419e370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc031ae0 tx=0x7fa1fc031ee0 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 shutdown_connections 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa1ec0a2bb0 0x7fa1ec0a5070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.756+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2041026d0 0x7fa20419e370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.757+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204101d10 0x7fa2041972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.757+0000 7fa20a7ca640 1 --2- 172.21.15.134:0/2777623322 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa204100b10 0x7fa204196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:54.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.757+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 >> 172.21.15.134:0/2777623322 conn(0x7fa2040fc2a0 msgr2=0x7fa2041050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:54.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.757+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 shutdown_connections 2024-09-12T02:24:54.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:24:54.757+0000 7fa20a7ca640 1 -- 172.21.15.134:0/2777623322 wait complete. 2024-09-12T02:24:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:54.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.509 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:24:55.511 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2024-09-12T02:24:55.511 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:24:55.764 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:24:55.799 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:55 smithi134 ceph-mon[35091]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:55.799 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:55.799 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.800 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:55 smithi001 ceph-mon[31252]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.884 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:55 smithi173 ceph-mon[35036]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:55.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:55.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:55.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:56.913 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:24:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:24:56.815+0000 7f0bce6e0640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:24:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:57 smithi001 ceph-mon[31252]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:57 smithi001 ceph-mon[31252]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:57 smithi001 ceph-mon[31252]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:57.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:57 smithi134 ceph-mon[35091]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:57.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:57 smithi134 ceph-mon[35091]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:57.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:57 smithi134 ceph-mon[35091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:57 smithi173 ceph-mon[35036]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:57 smithi173 ceph-mon[35036]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:57 smithi173 ceph-mon[35036]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:24:58.358 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:24:58.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-09-12T02:24:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:24:58.659 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:58.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:58.661 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:58.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:58.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:24:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:24:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:58.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 -- 172.21.15.173:0/2847224174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 msgr2=0x7f64a4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 --2- 172.21.15.173:0/2847224174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4100f10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6494009900 tx=0x7f649402a410 comp rx=0 tx=0).stop 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 -- 172.21.15.173:0/2847224174 shutdown_connections 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 --2- 172.21.15.173:0/2847224174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a4101d10 0x7f64a4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 --2- 172.21.15.173:0/2847224174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a41026d0 0x7f64a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 --2- 172.21.15.173:0/2847224174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4100f10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:59.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 -- 172.21.15.173:0/2847224174 >> 172.21.15.173:0/2847224174 conn(0x7f64a40fc2a0 msgr2=0x7f64a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 -- 172.21.15.173:0/2847224174 shutdown_connections 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.079+0000 7f64aa11a640 1 -- 172.21.15.173:0/2847224174 wait complete. 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 Processor -- start 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 -- start start 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a4101d10 0x7f64a4197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a41026d0 0x7f64a419e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f64a410c7a0 con 0x7f64a41026d0 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64a410c620 con 0x7f64a4101d10 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64aa11a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64a410c920 con 0x7f64a4100b10 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52534/0 (socket says 172.21.15.173:52534) 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 -- 172.21.15.173:0/48699592 learned_addr learned my addr 172.21.15.173:0/48699592 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a2ffd640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a4101d10 0x7f64a4197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a3fff640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a41026d0 0x7f64a419e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 -- 172.21.15.173:0/48699592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a4101d10 msgr2=0x7f64a4197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a4101d10 0x7f64a4197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 -- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a41026d0 msgr2=0x7f64a419e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.080+0000 7f64a37fe640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a41026d0 0x7f64a419e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64a37fe640 1 -- 172.21.15.173:0/48699592 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a419ea20 con 0x7f64a4100b10 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64a37fe640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6494031610 tx=0x7f6494004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649403f030 con 0x7f64a4100b10 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a419ecb0 con 0x7f64a4100b10 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6494003ad0 con 0x7f64a4100b10 2024-09-12T02:24:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494035070 con 0x7f64a4100b10 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.081+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a419f190 con 0x7f64a4100b10 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.082+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a4107f10 con 0x7f64a4100b10 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.083+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6494042030 con 0x7f64a4100b10 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.084+0000 7f64a0ff9640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 0x7f648c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.084+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f64940ee590 con 0x7f64a4100b10 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.084+0000 7f64a2ffd640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 0x7f648c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.085+0000 7f64a2ffd640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 0x7f648c0a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64a4198310 tx=0x7f649800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.093+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64940bc680 con 0x7f64a4100b10 2024-09-12T02:24:59.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:24:59.272+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f64a4062630 con 0x7f648c0a2bb0 2024-09-12T02:24:59.413 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:24:58.936+0000 7f0bca663640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:24:59.413 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:24:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:24:58.941+0000 7f0bc2483640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:24:59.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:59.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi134 2024-09-12T02:24:59.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='osd.4 ' entity='osd.4' 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:59.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:24:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi134 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='osd.4 ' entity='osd.4' 2024-09-12T02:24:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:59.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:59.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:24:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi134 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:24:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:24:59.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='osd.4 ' entity='osd.4' 2024-09-12T02:24:59.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:24:59.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:24:59.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:24:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:00.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:25:00.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:25:00.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:00.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:00.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] boot 2024-09-12T02:25:00.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:25:00.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:00 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] boot 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:25:00.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:00 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: osd.4 [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] boot 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T02:25:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:00 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:25:01.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:01 smithi173 ceph-mon[35036]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:25:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:01 smithi001 ceph-mon[31252]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:25:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:01 smithi134 ceph-mon[35091]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 131 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/4058563152' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]': finished 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:25:02.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:02.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:02 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/1165436861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/4058563152' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]': finished 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:02 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/1165436861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/4058563152' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]: dispatch 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d4ea8b6-b7b6-4658-8f9a-270ee7a34436"}]': finished 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:02 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/1165436861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:03 smithi001 ceph-mon[31252]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:03 smithi134 ceph-mon[35091]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:03 smithi173 ceph-mon[35036]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:05 smithi001 ceph-mon[31252]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:05 smithi134 ceph-mon[35091]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:06.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:05 smithi173 ceph-mon[35036]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:07 smithi173 ceph-mon[35036]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:08.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:07 smithi001 ceph-mon[31252]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:07 smithi134 ceph-mon[35091]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:09 smithi173 ceph-mon[35036]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:09 smithi001 ceph-mon[31252]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:10.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:09 smithi134 ceph-mon[35091]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:10.989 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:25:10.989 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:25:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:25:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:12.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:11 smithi173 ceph-mon[35036]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:12.050 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:11 smithi173 ceph-mon[35036]: Deploying daemon osd.5 on smithi173 2024-09-12T02:25:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:11 smithi001 ceph-mon[31252]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:11 smithi001 ceph-mon[31252]: Deploying daemon osd.5 on smithi173 2024-09-12T02:25:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:11 smithi134 ceph-mon[35091]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:11 smithi134 ceph-mon[35091]: Deploying daemon osd.5 on smithi173 2024-09-12T02:25:14.037 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:13 smithi173 ceph-mon[35036]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:13 smithi001 ceph-mon[31252]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:13 smithi134 ceph-mon[35091]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:16.041 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:15 smithi173 ceph-mon[35036]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:15 smithi001 ceph-mon[31252]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:16.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:15 smithi134 ceph-mon[35091]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:16.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:16.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:16.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:17.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:17.038 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:17.038 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:18.109 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:17 smithi173 ceph-mon[35036]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:17 smithi001 ceph-mon[31252]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:17 smithi134 ceph-mon[35091]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:20.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:20.751 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-09-12T02:25:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.750+0000 7f64a0ff9640 1 -- 172.21.15.173:0/48699592 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f64a4062630 con 0x7f648c0a2bb0 2024-09-12T02:25:20.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 msgr2=0x7f648c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:20.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 0x7f648c0a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64a4198310 tx=0x7f649800b410 comp rx=0 tx=0).stop 2024-09-12T02:25:20.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 msgr2=0x7f64a4196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6494031610 tx=0x7f6494004270 comp rx=0 tx=0).stop 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 shutdown_connections 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f648c0a2bb0 0x7f648c0a5070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64a41026d0 0x7f64a419e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64a4101d10 0x7f64a4197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 --2- 172.21.15.173:0/48699592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64a4100b10 0x7f64a4196df0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 >> 172.21.15.173:0/48699592 conn(0x7f64a40fc2a0 msgr2=0x7f64a41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 shutdown_connections 2024-09-12T02:25:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:25:20.753+0000 7f64aa11a640 1 -- 172.21.15.173:0/48699592 wait complete. 2024-09-12T02:25:21.106 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:21.106 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.106 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:21.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:21.416 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:25:21.419 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-12T02:25:21.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:25:21.685 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:25:22.085 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:21 smithi001 ceph-mon[31252]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:21 smithi134 ceph-mon[35091]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:21 smithi173 ceph-mon[35036]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:22.601 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:25:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:25:22.227+0000 7f08d0233640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:25:22.901 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:22 smithi173 ceph-mon[35036]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:22.901 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:22 smithi173 ceph-mon[35036]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:23.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:22 smithi001 ceph-mon[31252]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:23.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:22 smithi001 ceph-mon[31252]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:23.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:22 smithi134 ceph-mon[35091]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:23.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:22 smithi134 ceph-mon[35091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:23.895 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-mon[35036]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:23.895 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:25:23.816+0000 7f08cc1b6640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:25:23.896 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:25:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:25:23.823+0000 7f08c7fde640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:23 smithi001 ceph-mon[31252]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: from='osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:23 smithi134 ceph-mon[35091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:25:24.646 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:25:24.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-12T02:25:24.929 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:25.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:24 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:25.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:25.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:24 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:25:25.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:25:25.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:25.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:24 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:25.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.399+0000 7fad2c70b640 1 -- 172.21.15.1:0/2674903449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad241078c0 msgr2=0x7fad24109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:25.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.399+0000 7fad2c70b640 1 --2- 172.21.15.1:0/2674903449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad241078c0 0x7fad24109d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009ca0 tx=0x7fad1c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 -- 172.21.15.1:0/2674903449 shutdown_connections 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 --2- 172.21.15.1:0/2674903449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad241078c0 0x7fad24109d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 --2- 172.21.15.1:0/2674903449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad24104f90 0x7fad24107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 --2- 172.21.15.1:0/2674903449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24102660 0x7fad24104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 -- 172.21.15.1:0/2674903449 >> 172.21.15.1:0/2674903449 conn(0x7fad240fc280 msgr2=0x7fad240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 -- 172.21.15.1:0/2674903449 shutdown_connections 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 -- 172.21.15.1:0/2674903449 wait complete. 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 Processor -- start 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.400+0000 7fad2c70b640 1 -- start start 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24104f90 0x7fad241982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:25.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad241078c0 0x7fad2419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad2410d860 con 0x7fad24102660 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad2410d6e0 con 0x7fad24104f90 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2c70b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad2410d9e0 con 0x7fad241078c0 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54792/0 (socket says 172.21.15.1:54792) 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 -- 172.21.15.1:0/333793403 learned_addr learned my addr 172.21.15.1:0/333793403 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad29ca6640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24104f90 0x7fad241982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2aca8640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad241078c0 0x7fad2419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 -- 172.21.15.1:0/333793403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad241078c0 msgr2=0x7fad2419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad241078c0 0x7fad2419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 -- 172.21.15.1:0/333793403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24104f90 msgr2=0x7fad241982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:25.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24104f90 0x7fad241982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 -- 172.21.15.1:0/333793403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2419f9d0 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad2a4a7640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c920 tx=0x7fad2000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.401+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20007bb0 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.402+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20007d50 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.402+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2419fcc0 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.402+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200187d0 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.402+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad241a01a0 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.402+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad240fdd70 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.404+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fad2000f450 con 0x7fad24102660 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.405+0000 7fad1b7fe640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 0x7fad100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:25.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.405+0000 7fad29ca6640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 0x7fad100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:25.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.405+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7fad200ce510 con 0x7fad24102660 2024-09-12T02:25:25.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.405+0000 7fad29ca6640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 0x7fad100a50c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad2406aad0 tx=0x7fad1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:25.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.408+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad20014030 con 0x7fad24102660 2024-09-12T02:25:25.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:25.597+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fad24062630 con 0x7fad100a2c00 2024-09-12T02:25:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:25:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:25:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi173 2024-09-12T02:25:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] boot 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:25.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:25:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:25:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi173 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] boot 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:26.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi173 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T02:25:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: osd.5 [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] boot 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:26.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:27.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:26 smithi001 ceph-mon[31252]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:27.088 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:26 smithi001 ceph-mon[31252]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:25:27.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:26 smithi134 ceph-mon[35091]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:27.231 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:26 smithi134 ceph-mon[35091]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:25:27.232 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:26 smithi173 ceph-mon[35036]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:27.232 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:26 smithi173 ceph-mon[35036]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T02:25:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:27 smithi001 ceph-mon[31252]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:27 smithi001 ceph-mon[31252]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:25:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:27 smithi001 ceph-mon[31252]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:25:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:27 smithi134 ceph-mon[35091]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:27 smithi134 ceph-mon[35091]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:25:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:27 smithi134 ceph-mon[35091]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:25:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:27 smithi173 ceph-mon[35036]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:27 smithi173 ceph-mon[35036]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:25:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:27 smithi173 ceph-mon[35036]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:25:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]: dispatch 2024-09-12T02:25:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]': finished 2024-09-12T02:25:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:28 smithi001 ceph-mon[31252]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:25:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1488553269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]: dispatch 2024-09-12T02:25:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]': finished 2024-09-12T02:25:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:28 smithi134 ceph-mon[35091]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:25:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1488553269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]: dispatch 2024-09-12T02:25:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3648383635' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c293b2c-d037-45c2-968d-37a64f6a85cf"}]': finished 2024-09-12T02:25:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:28 smithi173 ceph-mon[35036]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T02:25:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1488553269' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:29 smithi001 ceph-mon[31252]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:30.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:29 smithi134 ceph-mon[35091]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:30.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:29 smithi173 ceph-mon[35036]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:31 smithi001 ceph-mon[31252]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-12T02:25:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:31 smithi134 ceph-mon[35091]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-12T02:25:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:31 smithi173 ceph-mon[35036]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-12T02:25:34.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:33 smithi001 ceph-mon[31252]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:25:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:33 smithi134 ceph-mon[35091]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:25:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:33 smithi173 ceph-mon[35036]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:25:36.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:35 smithi001 ceph-mon[31252]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T02:25:36.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:35 smithi134 ceph-mon[35091]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T02:25:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:35 smithi173 ceph-mon[35036]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T02:25:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:25:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:37.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:25:37.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:25:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:38.043 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:37 smithi001 ceph-mon[31252]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:25:38.043 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:37 smithi001 ceph-mon[31252]: Deploying daemon osd.6 on smithi001 2024-09-12T02:25:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:37 smithi134 ceph-mon[35091]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:25:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:37 smithi134 ceph-mon[35091]: Deploying daemon osd.6 on smithi001 2024-09-12T02:25:38.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:37 smithi173 ceph-mon[35036]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:25:38.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:37 smithi173 ceph-mon[35036]: Deploying daemon osd.6 on smithi001 2024-09-12T02:25:40.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:39 smithi001 ceph-mon[31252]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:25:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:39 smithi134 ceph-mon[35091]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:25:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:39 smithi173 ceph-mon[35036]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:25:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:41 smithi001 ceph-mon[31252]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T02:25:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:41 smithi134 ceph-mon[35091]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T02:25:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:41 smithi173 ceph-mon[35036]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T02:25:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:43 smithi001 ceph-mon[31252]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:43 smithi134 ceph-mon[35091]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:43 smithi173 ceph-mon[35036]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:44.927 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:44 smithi001 ceph-mon[31252]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:44 smithi134 ceph-mon[35091]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:44 smithi173 ceph-mon[35036]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:46.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.853+0000 7fad1b7fe640 1 -- 172.21.15.1:0/333793403 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fad24062630 con 0x7fad100a2c00 2024-09-12T02:25:46.854 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-12T02:25:46.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 msgr2=0x7fad100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 0x7fad100a50c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad2406aad0 tx=0x7fad1400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 msgr2=0x7fad24197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c920 tx=0x7fad2000cd20 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 shutdown_connections 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fad100a2c00 0x7fad100a50c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad241078c0 0x7fad2419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad24104f90 0x7fad241982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 --2- 172.21.15.1:0/333793403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad24102660 0x7fad24197db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 >> 172.21.15.1:0/333793403 conn(0x7fad240fc280 msgr2=0x7fad24102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 shutdown_connections 2024-09-12T02:25:46.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:25:46.855+0000 7fad2c70b640 1 -- 172.21.15.1:0/333793403 wait complete. 2024-09-12T02:25:47.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:47.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:47.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:47.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:47.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.653 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:25:47.655 INFO:tasks.cephadm:Deploying osd.7 on smithi134 with /dev/vg_nvme/lv_2... 2024-09-12T02:25:47.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:25:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:47 smithi001 ceph-mon[31252]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:47.911 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:25:48.032 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:47 smithi134 ceph-mon[35091]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:48.032 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:48.032 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:48.032 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:47 smithi173 ceph-mon[35036]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:49.025 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:25:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:25:48.764+0000 7f4506510640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:25:49.901 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:49 smithi134 ceph-mon[35091]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:49.901 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:49 smithi134 ceph-mon[35091]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:25:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:49 smithi001 ceph-mon[31252]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:49 smithi001 ceph-mon[31252]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:25:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:49 smithi173 ceph-mon[35036]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:49 smithi173 ceph-mon[35036]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:25:50.681 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:25:50.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-09-12T02:25:50.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:25:50.781+0000 7f4502493640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:25:50.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:25:50.790+0000 7f44fe2bb640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:25:50.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:25:50.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:25:50.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:50.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:50 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.081 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.082 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:51.082 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:51.082 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:50 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:25:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T02:25:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:25:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:50 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- 172.21.15.134:0/246121955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb541026e0 msgr2=0x7fdb54104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/246121955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb541026e0 0x7fdb54104ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb5002a410 comp rx=0 tx=0).stop 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- 172.21.15.134:0/246121955 shutdown_connections 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/246121955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54107940 0x7fdb54109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/246121955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb54105010 0x7fdb54107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/246121955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb541026e0 0x7fdb54104ad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- 172.21.15.134:0/246121955 >> 172.21.15.134:0/246121955 conn(0x7fdb540fc280 msgr2=0x7fdb540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- 172.21.15.134:0/246121955 shutdown_connections 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- 172.21.15.134:0/246121955 wait complete. 2024-09-12T02:25:51.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 Processor -- start 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.456+0000 7fdb5b96f640 1 -- start start 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb541026e0 0x7fdb54102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 0x7fdb54100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5410d880 con 0x7fdb54105010 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5410d700 con 0x7fdb54107940 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5410da00 con 0x7fdb541026e0 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39306/0 (socket says 172.21.15.134:39306) 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5970b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb541026e0 0x7fdb54102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 -- 172.21.15.134:0/706564776 learned_addr learned my addr 172.21.15.134:0/706564776 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb58f0a640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 0x7fdb54100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:51.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 -- 172.21.15.134:0/706564776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb541026e0 msgr2=0x7fdb54102040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb541026e0 0x7fdb54102040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 -- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 msgr2=0x7fdb54100690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 0x7fdb54100690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 -- 172.21.15.134:0/706564776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb54101490 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb58f0a640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 0x7fdb54100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb59f0c640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eaa0 tx=0x7fdb4c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00cdb0 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb541a20f0 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb4c005020 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0116b0 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.457+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541a2600 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.458+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb540fdd70 con 0x7fdb54107940 2024-09-12T02:25:51.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.459+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdb4c005560 con 0x7fdb54107940 2024-09-12T02:25:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.460+0000 7fdb4a7fc640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 0x7fdb400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.460+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7fdb4c0ce7c0 con 0x7fdb54107940 2024-09-12T02:25:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.460+0000 7fdb5970b640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 0x7fdb400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.461+0000 7fdb5970b640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 0x7fdb400a5040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb500314e0 tx=0x7fdb50000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.463+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb4c016030 con 0x7fdb54107940 2024-09-12T02:25:51.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:25:51.637+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdb54062630 con 0x7fdb400a2b80 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi001 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-12T02:25:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:51.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi001 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:25:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:25:52.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:52.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:52.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:52.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:52.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi001 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-12T02:25:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:25:52.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:52 smithi001 ceph-mon[31252]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:52 smithi001 ceph-mon[31252]: osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] boot 2024-09-12T02:25:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:52 smithi001 ceph-mon[31252]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:25:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:52 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:53.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:52 smithi134 ceph-mon[35091]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:53.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:52 smithi134 ceph-mon[35091]: osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] boot 2024-09-12T02:25:53.156 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:52 smithi134 ceph-mon[35091]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:25:53.156 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:52 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:53.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:52 smithi173 ceph-mon[35036]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:25:53.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:52 smithi173 ceph-mon[35036]: osd.6 [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] boot 2024-09-12T02:25:53.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:52 smithi173 ceph-mon[35036]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T02:25:53.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:52 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:25:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:53 smithi001 ceph-mon[31252]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:53 smithi001 ceph-mon[31252]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:25:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:53 smithi134 ceph-mon[35091]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:53 smithi134 ceph-mon[35091]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:25:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:53 smithi173 ceph-mon[35036]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:25:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:53 smithi173 ceph-mon[35036]: osdmap e44: 7 total, 7 up, 7 in 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/3410098593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]': finished 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:25:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/1868067334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/3410098593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]': finished 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:25:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/1868067334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/3410098593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]: dispatch 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92cb0e9b-e3fc-4825-8aa8-68673d91e7e9"}]': finished 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:25:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/1868067334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:25:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:55 smithi001 ceph-mon[31252]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:25:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:55 smithi134 ceph-mon[35091]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:25:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:55 smithi173 ceph-mon[35036]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:25:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:57 smithi001 ceph-mon[31252]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:25:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:57 smithi134 ceph-mon[35091]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:25:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:57 smithi173 ceph-mon[35036]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:25:59 smithi001 ceph-mon[31252]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:00.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:25:59 smithi134 ceph-mon[35091]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:25:59 smithi173 ceph-mon[35036]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:02.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:01 smithi001 ceph-mon[31252]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:01 smithi134 ceph-mon[35091]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:01 smithi173 ceph-mon[35036]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:03.013 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:26:03.013 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:02 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:26:03.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:02 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:03.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:26:03.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:02 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:04.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:03 smithi134 ceph-mon[35091]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:04.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:03 smithi134 ceph-mon[35091]: Deploying daemon osd.7 on smithi134 2024-09-12T02:26:04.098 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:03 smithi173 ceph-mon[35036]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:04.098 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:03 smithi173 ceph-mon[35036]: Deploying daemon osd.7 on smithi134 2024-09-12T02:26:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:03 smithi001 ceph-mon[31252]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:03 smithi001 ceph-mon[31252]: Deploying daemon osd.7 on smithi134 2024-09-12T02:26:06.048 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:05 smithi134 ceph-mon[35091]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:05 smithi001 ceph-mon[31252]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:06.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:05 smithi173 ceph-mon[35036]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:08.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:07 smithi134 ceph-mon[35091]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:08.160 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:07 smithi001 ceph-mon[31252]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:07 smithi173 ceph-mon[35036]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:09.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:09.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:09.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:09.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:10.021 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:09 smithi134 ceph-mon[35091]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:09 smithi001 ceph-mon[31252]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:09 smithi173 ceph-mon[35036]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.722+0000 7fdb4a7fc640 1 -- 172.21.15.134:0/706564776 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdb54062630 con 0x7fdb400a2b80 2024-09-12T02:26:11.723 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 7 on host 'smithi134' 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 msgr2=0x7fdb400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 0x7fdb400a5040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb500314e0 tx=0x7fdb50000bc0 comp rx=0 tx=0).stop 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 msgr2=0x7fdb54100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eaa0 tx=0x7fdb4c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 shutdown_connections 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdb400a2b80 0x7fdb400a5040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb54105010 0x7fdb54100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb54107940 0x7fdb54100bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:11.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 --2- 172.21.15.134:0/706564776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb541026e0 0x7fdb54102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:11.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.724+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 >> 172.21.15.134:0/706564776 conn(0x7fdb540fc280 msgr2=0x7fdb54103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:11.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.725+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 shutdown_connections 2024-09-12T02:26:11.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:26:11.725+0000 7fdb5b96f640 1 -- 172.21.15.134:0/706564776 wait complete. 2024-09-12T02:26:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:11 smithi001 ceph-mon[31252]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:11 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:11 smithi134 ceph-mon[35091]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:11 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:11 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:11 smithi173 ceph-mon[35036]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:11 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:11 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:12.571 DEBUG:teuthology.orchestra.run.smithi134:osd.7> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:26:12.573 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2024-09-12T02:26:12.573 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:26:12.829 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:26:14.091 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:13 smithi173 ceph-mon[35036]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:14.092 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.092 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:13 smithi001 ceph-mon[31252]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:13 smithi134 ceph-mon[35091]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:14.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:14.413 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:26:14 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:26:14.301+0000 7fde7a2f5640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:26:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:14 smithi001 ceph-mon[31252]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:14 smithi001 ceph-mon[31252]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:14 smithi173 ceph-mon[35036]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:14 smithi173 ceph-mon[35036]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:14 smithi134 ceph-mon[35091]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:14 smithi134 ceph-mon[35091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:26:15.460 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:26:15.488 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-09-12T02:26:15.741 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:26:15.913 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:26:15.732+0000 7fde76278640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:26:15.913 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:26:15.739+0000 7fde720a0640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:26:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:26:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:26:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:15.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:15 smithi134 ceph-mon[35091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:15.983 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:15.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:26:15.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:26:15.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:15.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:15.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:15 smithi173 ceph-mon[35036]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: from='osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:15 smithi001 ceph-mon[31252]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:26:16.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 -- 172.21.15.173:0/3363926529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced4102e90 msgr2=0x7fced4103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:16.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 --2- 172.21.15.173:0/3363926529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced4102e90 0x7fced4103310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009930 tx=0x7fcec802a420 comp rx=0 tx=0).stop 2024-09-12T02:26:16.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 -- 172.21.15.173:0/3363926529 shutdown_connections 2024-09-12T02:26:16.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 --2- 172.21.15.173:0/3363926529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4103850 0x7fced410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 --2- 172.21.15.173:0/3363926529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced4102e90 0x7fced4103310 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 --2- 172.21.15.173:0/3363926529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced40ffeb0 0x7fced41002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 -- 172.21.15.173:0/3363926529 >> 172.21.15.173:0/3363926529 conn(0x7fced40fba40 msgr2=0x7fced40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 -- 172.21.15.173:0/3363926529 shutdown_connections 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.205+0000 7fced9827640 1 -- 172.21.15.173:0/3363926529 wait complete. 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 Processor -- start 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 -- start start 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4102e90 0x7fced4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced4103850 0x7fced419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:16.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fced410d890 con 0x7fced4103850 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fced410d710 con 0x7fced4102e90 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.206+0000 7fced9827640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fced410da10 con 0x7fced40ffeb0 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39128/0 (socket says 172.21.15.173:39128) 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 -- 172.21.15.173:0/3737957729 learned_addr learned my addr 172.21.15.173:0/3737957729 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced27fc640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4102e90 0x7fced4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced37fe640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced4103850 0x7fced419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 -- 172.21.15.173:0/3737957729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4102e90 msgr2=0x7fced4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4102e90 0x7fced4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 -- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced4103850 msgr2=0x7fced419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced4103850 0x7fced419f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 -- 172.21.15.173:0/3737957729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced419fb30 con 0x7fced40ffeb0 2024-09-12T02:26:16.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced2ffd640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcec400e9c0 tx=0x7fcec400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec400cd80 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced419fe20 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcec40035f0 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4010690 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.207+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced41a0280 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.208+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced4109090 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.210+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcec40037a0 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.210+0000 7fced8825640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 0x7fcebc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.211+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7fcec40ce900 con 0x7fced40ffeb0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.211+0000 7fced27fc640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 0x7fcebc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.211+0000 7fced27fc640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 0x7fcebc0a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005ab0 tx=0x7fcec8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:16.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.214+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcec409c4d0 con 0x7fced40ffeb0 2024-09-12T02:26:16.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:16.397+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fced4062630 con 0x7fcebc0a2bb0 2024-09-12T02:26:17.000 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:26:17.000 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:26:17.000 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.000 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.001 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:17.002 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:17.002 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:17.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:26:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:26:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:17.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:17.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:17.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi134 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] boot 2024-09-12T02:26:17.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:26:17.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:17 smithi134 ceph-mon[35091]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:26:17.917 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:26:17.917 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi134 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] boot 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:17.918 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:17 smithi173 ceph-mon[35036]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: pgmap v168: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi134 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: osd.7 [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] boot 2024-09-12T02:26:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T02:26:18.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:26:18.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:17 smithi001 ceph-mon[31252]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T02:26:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:26:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/2503675275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]': finished 2024-09-12T02:26:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:26:19.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/2503675275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]': finished 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:26:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: pgmap v171: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:26:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/2503675275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]: dispatch 2024-09-12T02:26:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08fe1c54-4fe9-48b4-b42f-4adb8e930d23"}]': finished 2024-09-12T02:26:19.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T02:26:19.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:20.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:20 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/46904286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:20.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:20 smithi173 ceph-mon[35036]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:26:20.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:20 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/46904286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:20 smithi001 ceph-mon[31252]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:26:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:20.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:20 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/46904286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:20.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:20 smithi134 ceph-mon[35091]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:26:20.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:21.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:21 smithi173 ceph-mon[35036]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:21 smithi001 ceph-mon[31252]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:21 smithi134 ceph-mon[35091]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:23.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:23 smithi173 ceph-mon[35036]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:23 smithi001 ceph-mon[31252]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:23 smithi134 ceph-mon[35091]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:25.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:25 smithi173 ceph-mon[35036]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:25 smithi001 ceph-mon[31252]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:25 smithi134 ceph-mon[35091]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:27.814 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:27 smithi173 ceph-mon[35036]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:27.814 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:26:27.814 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:27 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:27.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:27 smithi001 ceph-mon[31252]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:27.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:27 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:26:27.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:27 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:27 smithi134 ceph-mon[35091]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:27 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:26:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:27 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:28.680 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:28 smithi173 ceph-mon[35036]: Deploying daemon osd.8 on smithi173 2024-09-12T02:26:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:28 smithi001 ceph-mon[31252]: Deploying daemon osd.8 on smithi173 2024-09-12T02:26:28.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:28 smithi134 ceph-mon[35091]: Deploying daemon osd.8 on smithi173 2024-09-12T02:26:29.685 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:29 smithi173 ceph-mon[35036]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:29 smithi001 ceph-mon[31252]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:29.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:29 smithi134 ceph-mon[35091]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:31.854 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:31 smithi173 ceph-mon[35036]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:31 smithi001 ceph-mon[31252]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:31.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:31 smithi134 ceph-mon[35091]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:33 smithi173 ceph-mon[35036]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:33 smithi001 ceph-mon[31252]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:33 smithi134 ceph-mon[35091]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:35.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:35 smithi134 ceph-mon[35091]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:35.848 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:35 smithi173 ceph-mon[35036]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:35 smithi001 ceph-mon[31252]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:36.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.823+0000 7fced8825640 1 -- 172.21.15.173:0/3737957729 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fced4062630 con 0x7fcebc0a2bb0 2024-09-12T02:26:36.825 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2024-09-12T02:26:36.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 msgr2=0x7fcebc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:36.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 0x7fcebc0a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005ab0 tx=0x7fcec8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:26:36.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 msgr2=0x7fced4197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:36.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcec400e9c0 tx=0x7fcec400ee80 comp rx=0 tx=0).stop 2024-09-12T02:26:36.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 shutdown_connections 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcebc0a2bb0 0x7fcebc0a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fced4103850 0x7fced419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced4102e90 0x7fced4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 --2- 172.21.15.173:0/3737957729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fced40ffeb0 0x7fced4197f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 >> 172.21.15.173:0/3737957729 conn(0x7fced40fba40 msgr2=0x7fced4106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 shutdown_connections 2024-09-12T02:26:36.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:26:36.826+0000 7fced9827640 1 -- 172.21.15.173:0/3737957729 wait complete. 2024-09-12T02:26:37.535 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:26:37.540 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-12T02:26:37.541 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:26:37.810 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:26:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:37 smithi001 ceph-mon[31252]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:37 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:37 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:37 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:37.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:37 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:37 smithi173 ceph-mon[35036]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:38.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:37 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:37 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:37 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:37 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:37 smithi134 ceph-mon[35091]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:37 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:37 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:37 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:37 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:40.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:39 smithi173 ceph-mon[35036]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:40.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:39 smithi173 ceph-mon[35036]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:39 smithi173 ceph-mon[35036]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.075 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:26:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:26:39.697+0000 7f213d6e7640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:26:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:39 smithi001 ceph-mon[31252]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:39 smithi001 ceph-mon[31252]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:39 smithi001 ceph-mon[31252]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:39 smithi134 ceph-mon[35091]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:39 smithi134 ceph-mon[35091]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:39 smithi134 ceph-mon[35091]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:26:40.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:26:40.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-12T02:26:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:41.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:41.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:41.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:41.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.197 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:26:40.843+0000 7f213966a640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:26:41.197 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:26:40.851+0000 7f2135492640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:41.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/1141443467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc8101490 msgr2=0x7fcdc8101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/1141443467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc8101490 0x7fcdc8101910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009ca0 tx=0x7fcdc002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/1141443467 shutdown_connections 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/1141443467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc8101490 0x7fcdc8101910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/1141443467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc806a390 0x7fcdc81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/1141443467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8069f00 0x7fcdc8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/1141443467 >> 172.21.15.1:0/1141443467 conn(0x7fcdc80fba40 msgr2=0x7fcdc80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/1141443467 shutdown_connections 2024-09-12T02:26:41.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.632+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/1141443467 wait complete. 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 Processor -- start 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 -- start start 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 0x7fcdc8105330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 0x7fcdc8103ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810c760 con 0x7fcdc806a390 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810c5e0 con 0x7fcdc8101490 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcf9ac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810c8e0 con 0x7fcdc8069f00 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdccf47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdccf47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54308/0 (socket says 172.21.15.1:54308) 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdccf47640 1 -- 172.21.15.1:0/2397276476 learned_addr learned my addr 172.21.15.1:0/2397276476 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.633+0000 7fcdcd748640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 0x7fcdc8105330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdcdf49640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 0x7fcdc8103ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 -- 172.21.15.1:0/2397276476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 msgr2=0x7fcdc8105330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 0x7fcdc8105330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 -- 172.21.15.1:0/2397276476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 msgr2=0x7fcdc8103ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 0x7fcdc8103ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 -- 172.21.15.1:0/2397276476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc8104780 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdcd748640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 0x7fcdc8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdcdf49640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 0x7fcdc8103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdccf47640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800e9f0 tx=0x7fcdb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800ccc0 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb8005500 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8010690 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc81a20c0 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.634+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc81a2580 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.635+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc81090f0 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.636+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcdb80046c0 con 0x7fcdc806a390 2024-09-12T02:26:41.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.637+0000 7fcdbe7fc640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 0x7fcdb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.637+0000 7fcdcd748640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 0x7fcdb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.637+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7fcdb80cea30 con 0x7fcdc806a390 2024-09-12T02:26:41.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.638+0000 7fcdcd748640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 0x7fcdb40a5040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40058c0 tx=0x7fcdc4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:41.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.642+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdb809c460 con 0x7fcdc806a390 2024-09-12T02:26:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:26:41.829+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcdc8062630 con 0x7fcdb40a2b80 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi173 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:42.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:42.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:41 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi173 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:41 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi173 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:42.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:42.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:26:42.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:41 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:26:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:26:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:26:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:42.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] boot 2024-09-12T02:26:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:26:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:42.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:42 smithi001 ceph-mon[31252]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] boot 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:43.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:42 smithi134 ceph-mon[35091]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: osd.8 [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] boot 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:26:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:42 smithi173 ceph-mon[35036]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T02:26:44.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:43 smithi001 ceph-mon[31252]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:44.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:43 smithi001 ceph-mon[31252]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:26:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:43 smithi134 ceph-mon[35091]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:43 smithi134 ceph-mon[35091]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:26:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:43 smithi173 ceph-mon[35036]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:43 smithi173 ceph-mon[35036]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:26:45.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:44 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]: dispatch 2024-09-12T02:26:45.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:44 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]': finished 2024-09-12T02:26:45.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:44 smithi001 ceph-mon[31252]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:26:45.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:44 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]: dispatch 2024-09-12T02:26:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:44 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]': finished 2024-09-12T02:26:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:44 smithi134 ceph-mon[35091]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:26:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:44 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]: dispatch 2024-09-12T02:26:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:44 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1696885915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65f975-c4d8-4fcd-bfbd-d4ecaa380371"}]': finished 2024-09-12T02:26:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:44 smithi173 ceph-mon[35036]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T02:26:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:45 smithi001 ceph-mon[31252]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:45 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1486416952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:45 smithi001 ceph-mon[31252]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:26:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:45 smithi134 ceph-mon[35091]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:45 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1486416952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:45 smithi134 ceph-mon[35091]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:26:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:45 smithi173 ceph-mon[35036]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:45 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1486416952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:26:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:45 smithi173 ceph-mon[35036]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T02:26:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:26:48.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:47 smithi001 ceph-mon[31252]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:47 smithi134 ceph-mon[35091]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:47 smithi173 ceph-mon[35036]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:26:50.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:49 smithi001 ceph-mon[31252]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:26:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:49 smithi134 ceph-mon[35091]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:26:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:49 smithi173 ceph-mon[35036]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-12T02:26:51.903 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:51 smithi001 ceph-mon[31252]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:26:52.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:51 smithi134 ceph-mon[35091]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:26:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:51 smithi173 ceph-mon[35036]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-12T02:26:54.003 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:53 smithi001 ceph-mon[31252]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:26:54.003 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:26:54.003 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:53 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:53 smithi134 ceph-mon[35091]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:26:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:26:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:53 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:53 smithi173 ceph-mon[35036]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:26:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:26:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:53 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:54 smithi001 ceph-mon[31252]: Deploying daemon osd.9 on smithi001 2024-09-12T02:26:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:54 smithi134 ceph-mon[35091]: Deploying daemon osd.9 on smithi001 2024-09-12T02:26:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:54 smithi173 ceph-mon[35036]: Deploying daemon osd.9 on smithi001 2024-09-12T02:26:56.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:55 smithi001 ceph-mon[31252]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:26:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:55 smithi134 ceph-mon[35091]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:26:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:55 smithi173 ceph-mon[35036]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-12T02:26:58.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:57 smithi001 ceph-mon[31252]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:26:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:57 smithi134 ceph-mon[35091]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:26:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:57 smithi173 ceph-mon[35036]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-12T02:26:59.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:58 smithi001 ceph-mon[31252]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:26:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:58 smithi134 ceph-mon[35091]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:26:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:58 smithi173 ceph-mon[35036]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:27:00.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:00.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:26:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:26:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:26:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:01.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:00 smithi001 ceph-mon[31252]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:00 smithi134 ceph-mon[35091]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:00 smithi173 ceph-mon[35036]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:03.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.285+0000 7fcdbe7fc640 1 -- 172.21.15.1:0/2397276476 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdc8062630 con 0x7fcdb40a2b80 2024-09-12T02:27:03.288 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.287+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 msgr2=0x7fcdb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.287+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 0x7fcdb40a5040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40058c0 tx=0x7fcdc4005850 comp rx=0 tx=0).stop 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.287+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 msgr2=0x7fcdc8103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.287+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800e9f0 tx=0x7fcdb800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 shutdown_connections 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcdb40a2b80 0x7fcdb40a5040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdc806a390 0x7fcdc8103980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:03.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdc8101490 0x7fcdc8103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:03.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 --2- 172.21.15.1:0/2397276476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc8069f00 0x7fcdc8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:03.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 >> 172.21.15.1:0/2397276476 conn(0x7fcdc80fba40 msgr2=0x7fcdc8102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:03.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 shutdown_connections 2024-09-12T02:27:03.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:03.288+0000 7fcdcf9ac640 1 -- 172.21.15.1:0/2397276476 wait complete. 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:03.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:03.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:04.066 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:27:04.068 INFO:tasks.cephadm:Deploying osd.10 on smithi134 with /dev/vg_nvme/lv_1... 2024-09-12T02:27:04.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:27:04.325 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:27:05.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:27:05 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:27:05.085+0000 7f2e086ea640 -1 osd.9 0 log_to_monitors true 2024-09-12T02:27:05.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:05 smithi134 ceph-mon[35091]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:05.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:05 smithi134 ceph-mon[35091]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:27:05.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:05 smithi001 ceph-mon[31252]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:05.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:05 smithi001 ceph-mon[31252]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:27:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:05 smithi173 ceph-mon[35036]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:05 smithi173 ceph-mon[35036]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:27:06.776 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:06 smithi001 ceph-mon[31252]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:06 smithi001 ceph-mon[31252]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:06 smithi001 ceph-mon[31252]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:06 smithi001 ceph-mon[31252]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:06 smithi134 ceph-mon[35091]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:06 smithi134 ceph-mon[35091]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:06 smithi134 ceph-mon[35091]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:27:06.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:06.778 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:06 smithi134 ceph-mon[35091]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:27:06.780 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-12T02:27:06.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-09-12T02:27:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:06 smithi173 ceph-mon[35036]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:27:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:06 smithi173 ceph-mon[35036]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T02:27:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:06 smithi173 ceph-mon[35036]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-12T02:27:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:06 smithi173 ceph-mon[35036]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-12T02:27:07.065 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:27:07.086 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:27:07.011+0000 7f2e0466d640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:27:07.086 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:27:07.021+0000 7f2dfc48d640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 -- 172.21.15.134:0/2830860513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5441026a0 msgr2=0x7fe544104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 --2- 172.21.15.134:0/2830860513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5441026a0 0x7fe544104a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe534009900 tx=0x7fe53402a410 comp rx=0 tx=0).stop 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 -- 172.21.15.134:0/2830860513 shutdown_connections 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 --2- 172.21.15.134:0/2830860513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe5441073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 --2- 172.21.15.134:0/2830860513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544107900 0x7fe544109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 --2- 172.21.15.134:0/2830860513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5441026a0 0x7fe544104a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 -- 172.21.15.134:0/2830860513 >> 172.21.15.134:0/2830860513 conn(0x7fe5440fc2a0 msgr2=0x7fe5440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 -- 172.21.15.134:0/2830860513 shutdown_connections 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.617+0000 7fe549062640 1 -- 172.21.15.134:0/2830860513 wait complete. 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 Processor -- start 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 -- start start 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 0x7fe544197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe544198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe54410d920 con 0x7fe544104fd0 2024-09-12T02:27:07.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe54410d7a0 con 0x7fe544107900 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.618+0000 7fe549062640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe54410daa0 con 0x7fe5441026a0 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe542d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 0x7fe544197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38008/0 (socket says 172.21.15.134:38008) 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe544198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 -- 172.21.15.134:0/3180273210 learned_addr learned my addr 172.21.15.134:0/3180273210 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 -- 172.21.15.134:0/3180273210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 msgr2=0x7fe544197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 0x7fe544197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 -- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 msgr2=0x7fe544198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe544198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 -- 172.21.15.134:0/3180273210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54419fb80 con 0x7fe544107900 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe542d9d640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 0x7fe544197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54259c640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe544198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe54359e640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00eaa0 tx=0x7fe53c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00cdb0 con 0x7fe544107900 2024-09-12T02:27:07.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe53c005020 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54419fe70 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0116b0 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.619+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441a0320 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.620+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5440fdd90 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.621+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe53c005560 con 0x7fe544107900 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.622+0000 7fe52bfff640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 0x7fe52c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.622+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7fe53c0ce820 con 0x7fe544107900 2024-09-12T02:27:07.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.622+0000 7fe542d9d640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 0x7fe52c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.623+0000 7fe542d9d640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 0x7fe52c0a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe534031440 tx=0x7fe5340315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:07.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.626+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe53c016030 con 0x7fe544107900 2024-09-12T02:27:07.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:07.802+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe544062630 con 0x7fe52c0a2bb0 2024-09-12T02:27:07.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:07.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:27:07.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:07.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:07.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T02:27:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152]' entity='osd.9' 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi001 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:08.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] boot 2024-09-12T02:27:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:27:08.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:08 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:08.904 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:27:08.904 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi001 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] boot 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:27:08.905 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:08 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:27:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:27:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi001 2024-09-12T02:27:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-12T02:27:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: osd.9 [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] boot 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T02:27:08.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:08 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:27:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:09 smithi001 ceph-mon[31252]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:09.910 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:09 smithi134 ceph-mon[35091]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:09 smithi173 ceph-mon[35036]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/2233847748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]': finished 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:27:10.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T02:27:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/2233847748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]': finished 2024-09-12T02:27:10.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:27:10.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/2233847748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]: dispatch 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19f01a8b-155b-4108-9167-20ebbc3d0e97"}]': finished 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T02:27:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:11 smithi001 ceph-mon[31252]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:11 smithi001 ceph-mon[31252]: from='client.? 172.21.15.134:0/1004778365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:11 smithi134 ceph-mon[35091]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:11 smithi134 ceph-mon[35091]: from='client.? 172.21.15.134:0/1004778365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:11 smithi173 ceph-mon[35036]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:11 smithi173 ceph-mon[35036]: from='client.? 172.21.15.134:0/1004778365' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:13.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:13 smithi001 ceph-mon[31252]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:13 smithi134 ceph-mon[35091]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:13.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:13 smithi173 ceph-mon[35036]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:15.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:15 smithi134 ceph-mon[35091]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:15 smithi001 ceph-mon[31252]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:15 smithi173 ceph-mon[35036]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:17.806 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:17 smithi134 ceph-mon[35091]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:17.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:17 smithi001 ceph-mon[31252]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:17 smithi173 ceph-mon[35036]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:19.852 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:19 smithi134 ceph-mon[35091]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:19.852 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:27:19.852 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:19 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:19 smithi001 ceph-mon[31252]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:27:19.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:19 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:19 smithi173 ceph-mon[35036]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:27:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:19 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:20 smithi001 ceph-mon[31252]: Deploying daemon osd.10 on smithi134 2024-09-12T02:27:20.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:20 smithi134 ceph-mon[35091]: Deploying daemon osd.10 on smithi134 2024-09-12T02:27:20.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:20 smithi173 ceph-mon[35036]: Deploying daemon osd.10 on smithi134 2024-09-12T02:27:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:21 smithi001 ceph-mon[31252]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:21.881 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:21 smithi134 ceph-mon[35091]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:21 smithi173 ceph-mon[35036]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:23.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:23 smithi134 ceph-mon[35091]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:23.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:23 smithi001 ceph-mon[31252]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:23 smithi173 ceph-mon[35036]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:25.822 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:25 smithi134 ceph-mon[35091]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:25.822 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:25.823 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:25.823 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:25 smithi001 ceph-mon[31252]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:25 smithi173 ceph-mon[35036]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:27.897 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:27 smithi134 ceph-mon[35091]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:27 smithi173 ceph-mon[35036]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:27 smithi001 ceph-mon[31252]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 10 on host 'smithi134' 2024-09-12T02:27:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.606+0000 7fe52bfff640 1 -- 172.21.15.134:0/3180273210 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe544062630 con 0x7fe52c0a2bb0 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 msgr2=0x7fe52c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 0x7fe52c0a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe534031440 tx=0x7fe5340315b0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 msgr2=0x7fe54419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00eaa0 tx=0x7fe53c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 shutdown_connections 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe52c0a2bb0 0x7fe52c0a5070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe544104fd0 0x7fe544198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe544107900 0x7fe54419f510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 --2- 172.21.15.134:0/3180273210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5441026a0 0x7fe544197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.609+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 >> 172.21.15.134:0/3180273210 conn(0x7fe5440fc2a0 msgr2=0x7fe544103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.610+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 shutdown_connections 2024-09-12T02:27:28.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-12T02:27:28.610+0000 7fe549062640 1 -- 172.21.15.134:0/3180273210 wait complete. 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:29.264 DEBUG:teuthology.orchestra.run.smithi134:osd.10> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:27:29.266 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2024-09-12T02:27:29.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:27:29.522 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:27:29.913 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:29 smithi173 ceph-mon[35036]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:30.125 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:29 smithi134 ceph-mon[35091]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:29 smithi001 ceph-mon[31252]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:31.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:27:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:27:31.106+0000 7f64335e3640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:27:32.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:31 smithi173 ceph-mon[35036]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:32.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:31 smithi173 ceph-mon[35036]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.013 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:31 smithi173 ceph-mon[35036]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:31 smithi001 ceph-mon[31252]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:32.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:31 smithi001 ceph-mon[31252]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:31 smithi001 ceph-mon[31252]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:31 smithi134 ceph-mon[35091]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:31 smithi134 ceph-mon[35091]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:31 smithi134 ceph-mon[35091]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:27:32.312 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T02:27:32.340 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-09-12T02:27:32.590 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:33.022 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:32 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2237624462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d98100b10 msgr2=0x7f5d98100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2237624462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d98100b10 0x7f5d98100f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009900 tx=0x7f5d8802a410 comp rx=0 tx=0).stop 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2237624462 shutdown_connections 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2237624462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d981026d0 0x7f5d98108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2237624462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 0x7f5d98102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2237624462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d98100b10 0x7f5d98100f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2237624462 >> 172.21.15.173:0/2237624462 conn(0x7f5d980fc2a0 msgr2=0x7f5d980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2237624462 shutdown_connections 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.104+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2237624462 wait complete. 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 Processor -- start 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 -- start start 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d98100b10 0x7f5d9806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 0x7f5d9819f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9810c770 con 0x7f5d98100b10 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9810c5f0 con 0x7f5d98101d10 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9c8f6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9810c8f0 con 0x7f5d981026d0 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48414/0 (socket says 172.21.15.173:48414) 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 -- 172.21.15.173:0/2682935804 learned_addr learned my addr 172.21.15.173:0/2682935804 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d95d9b640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 0x7f5d9819f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d9659c640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d98100b10 0x7f5d9806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 -- 172.21.15.173:0/2682935804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 msgr2=0x7f5d9819f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 0x7f5d9819f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 -- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d98100b10 msgr2=0x7f5d9806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d98100b10 0x7f5d9806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.105+0000 7f5d96d9d640 1 -- 172.21.15.173:0/2682935804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d981a1dd0 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d96d9d640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cad0 tx=0x7f5d9000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000ae20 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d90005020 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d981a2060 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f6f0 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.106+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d981a2550 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.107+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d98107f30 con 0x7f5d981026d0 2024-09-12T02:27:33.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.108+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5d900051d0 con 0x7f5d981026d0 2024-09-12T02:27:33.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.109+0000 7f5d877fe640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 0x7f5d800a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.109+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f5d900ceb60 con 0x7f5d981026d0 2024-09-12T02:27:33.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.109+0000 7f5d9659c640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 0x7f5d800a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.109+0000 7f5d9659c640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 0x7f5d800a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d88005ab0 tx=0x7f5d88000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:33.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.112+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d90014030 con 0x7f5d981026d0 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:33.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:32 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:33.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:32 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:33.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:33.288+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5d98062630 con 0x7f5d800a2bb0 2024-09-12T02:27:33.663 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:27:33.288+0000 7f642f566640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:27:33.663 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:27:33.299+0000 7f6427386640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi134 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='osd.10 ' entity='osd.10' 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:33.953 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi134 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='osd.10 ' entity='osd.10' 2024-09-12T02:27:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi134 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='osd.10 ' entity='osd.10' 2024-09-12T02:27:34.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:27:34.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:27:34.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] boot 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:27:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] boot 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:27:35.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: osd.10 [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] boot 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T02:27:35.164 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:27:36.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:35 smithi001 ceph-mon[31252]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:36.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:35 smithi001 ceph-mon[31252]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:27:36.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:35 smithi134 ceph-mon[35091]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:36.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:35 smithi134 ceph-mon[35091]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:27:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:35 smithi173 ceph-mon[35036]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:27:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:35 smithi173 ceph-mon[35036]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T02:27:37.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:27:37.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:37.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/1966119027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]': finished 2024-09-12T02:27:37.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:27:37.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:37.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:36 smithi134 ceph-mon[35091]: from='client.? 172.21.15.173:0/1713576981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/1966119027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]': finished 2024-09-12T02:27:37.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:27:37.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:37.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:36 smithi173 ceph-mon[35036]: from='client.? 172.21.15.173:0/1713576981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/1966119027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]: dispatch 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4ce2444-9e0f-4787-acb8-0594c4671e86"}]': finished 2024-09-12T02:27:37.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T02:27:37.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:37.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:36 smithi001 ceph-mon[31252]: from='client.? 172.21.15.173:0/1713576981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:27:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:38 smithi001 ceph-mon[31252]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:27:38.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:38 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:38.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:38 smithi134 ceph-mon[35091]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:27:38.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:38 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:38.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:38 smithi173 ceph-mon[35036]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T02:27:38.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:38 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:39.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:39 smithi001 ceph-mon[31252]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:27:39.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:39 smithi134 ceph-mon[35091]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:27:39.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:39 smithi173 ceph-mon[35036]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:27:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:41 smithi173 ceph-mon[35036]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-12T02:27:41.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:41 smithi001 ceph-mon[31252]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-12T02:27:41.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:41 smithi134 ceph-mon[35091]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-12T02:27:43.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:43 smithi173 ceph-mon[35036]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-12T02:27:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:43 smithi001 ceph-mon[31252]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-12T02:27:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:43 smithi134 ceph-mon[35091]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-12T02:27:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:45 smithi173 ceph-mon[35036]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:27:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:27:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:45.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:45 smithi173 ceph-mon[35036]: Deploying daemon osd.11 on smithi173 2024-09-12T02:27:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:45 smithi001 ceph-mon[31252]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:27:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:27:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:45.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:45 smithi001 ceph-mon[31252]: Deploying daemon osd.11 on smithi173 2024-09-12T02:27:45.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:45 smithi134 ceph-mon[35091]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:27:45.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:27:45.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:45.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:45 smithi134 ceph-mon[35091]: Deploying daemon osd.11 on smithi173 2024-09-12T02:27:47.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:47 smithi001 ceph-mon[31252]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:27:47.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:47 smithi134 ceph-mon[35091]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:27:47.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:47 smithi173 ceph-mon[35036]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:27:49.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:49 smithi001 ceph-mon[31252]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:27:49.383 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:49 smithi173 ceph-mon[35036]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:27:49.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:49 smithi134 ceph-mon[35091]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:27:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:51 smithi001 ceph-mon[31252]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:51.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:51 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:51 smithi134 ceph-mon[35091]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:51 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:51.417 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:51 smithi173 ceph-mon[35036]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:51.417 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:51.417 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:51.417 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:51 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:53.375 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:53 smithi173 ceph-mon[35036]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:53.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:53 smithi001 ceph-mon[31252]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:53.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:53 smithi134 ceph-mon[35091]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:54.429 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2024-09-12T02:27:54.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.429+0000 7f5d877fe640 1 -- 172.21.15.173:0/2682935804 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5d98062630 con 0x7f5d800a2bb0 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 msgr2=0x7f5d800a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 0x7f5d800a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d88005ab0 tx=0x7f5d88000bc0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 msgr2=0x7f5d981a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cad0 tx=0x7f5d9000cf90 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 shutdown_connections 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d800a2bb0 0x7f5d800a5070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d981026d0 0x7f5d981a15e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d98101d10 0x7f5d9819f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 --2- 172.21.15.173:0/2682935804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d98100b10 0x7f5d9806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.431+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 >> 172.21.15.173:0/2682935804 conn(0x7f5d980fc2a0 msgr2=0x7f5d98105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:54.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.432+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 shutdown_connections 2024-09-12T02:27:54.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:27:54.432+0000 7f5d9c8f6640 1 -- 172.21.15.173:0/2682935804 wait complete. 2024-09-12T02:27:54.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:54.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:54.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:54.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:54.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:54.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:54.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:54.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:55.167 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:27:55.170 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:27:55.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:27:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:27:55.814 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:55 smithi001 ceph-mon[31252]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:55.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- 172.21.15.1:0/1907562795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 msgr2=0x7fc000108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 --2- 172.21.15.1:0/1907562795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc000108f60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009ca0 tx=0x7fbff802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- 172.21.15.1:0/1907562795 shutdown_connections 2024-09-12T02:27:55.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 --2- 172.21.15.1:0/1907562795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc000108f60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 --2- 172.21.15.1:0/1907562795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 --2- 172.21.15.1:0/1907562795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 0x7fc000100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- 172.21.15.1:0/1907562795 >> 172.21.15.1:0/1907562795 conn(0x7fc0000fc2a0 msgr2=0x7fc0000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- 172.21.15.1:0/1907562795 shutdown_connections 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- 172.21.15.1:0/1907562795 wait complete. 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 Processor -- start 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.897+0000 7fc007b92640 1 -- start start 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 0x7fc000196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc00010c770 con 0x7fc0001026d0 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc00010c5f0 con 0x7fc000101d10 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc007b92640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc00010c8f0 con 0x7fc000100b10 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56304/0 (socket says 172.21.15.1:56304) 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 -- 172.21.15.1:0/1743804993 learned_addr learned my addr 172.21.15.1:0/1743804993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00592e640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 0x7fc000196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00512d640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 -- 172.21.15.1:0/1743804993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 msgr2=0x7fc000196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 0x7fc000196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 -- 172.21.15.1:0/1743804993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 msgr2=0x7fc000197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 -- 172.21.15.1:0/1743804993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00019e920 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00512d640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.898+0000 7fc00612f640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005e30 tx=0x7fbff8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.899+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8003c30 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.899+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00019ebb0 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.899+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff8003dd0 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.899+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff802fde0 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.899+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00019f140 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.900+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc000107e60 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.901+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fbff8004050 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.901+0000 7fbff6ffd640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 0x7fbfec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.902+0000 7fc00592e640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 0x7fbfec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.902+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fbff80f0170 con 0x7fc0001026d0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.902+0000 7fc00592e640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 0x7fbfec0a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbffc005fd0 tx=0x7fbffc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:55.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:55.905+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbff80bd610 con 0x7fc0001026d0 2024-09-12T02:27:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:55 smithi173 ceph-mon[35036]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:56.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.080+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc00002da10 con 0x7fc0001026d0 2024-09-12T02:27:56.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.081+0000 7fbff6ffd640 1 -- 172.21.15.1:0/1743804993 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fbff80bcf10 con 0x7fc0001026d0 2024-09-12T02:27:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:27:56.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 msgr2=0x7fbfec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 0x7fbfec0a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbffc005fd0 tx=0x7fbffc005850 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 msgr2=0x7fc00019e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005e30 tx=0x7fbff8031ee0 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 shutdown_connections 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbfec0a2b80 0x7fbfec0a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0001026d0 0x7fc00019e280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc000101d10 0x7fc000197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 --2- 172.21.15.1:0/1743804993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc000100b10 0x7fc000196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 >> 172.21.15.1:0/1743804993 conn(0x7fc0000fc2a0 msgr2=0x7fc000105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 shutdown_connections 2024-09-12T02:27:56.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:56.083+0000 7fc007b92640 1 -- 172.21.15.1:0/1743804993 wait complete. 2024-09-12T02:27:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:55 smithi134 ceph-mon[35091]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:56.870 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:56 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1743804993' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:27:56.903 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726108053,"num_in_osds":12,"osd_in_since":1726108056,"num_remapped_pgs":0} 2024-09-12T02:27:56.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:56 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1743804993' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:27:57.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:56 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1743804993' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:27:57.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:27:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:27:57.137+0000 7f9037611640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:27:57.798 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:57 smithi173 ceph-mon[35036]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:57.798 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:57 smithi173 ceph-mon[35036]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:57.798 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:57 smithi173 ceph-mon[35036]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:57.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:27:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:57 smithi001 ceph-mon[31252]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:57 smithi001 ceph-mon[31252]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:58.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:57 smithi001 ceph-mon[31252]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:57 smithi134 ceph-mon[35091]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:57 smithi134 ceph-mon[35091]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:57 smithi134 ceph-mon[35091]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:27:58.180 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:27:58.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 -- 172.21.15.1:0/3672438701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 msgr2=0x7feb74102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 --2- 172.21.15.1:0/3672438701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb74102190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb70009900 tx=0x7feb7002a410 comp rx=0 tx=0).stop 2024-09-12T02:27:58.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 -- 172.21.15.1:0/3672438701 shutdown_connections 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 --2- 172.21.15.1:0/3672438701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb74102190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 --2- 172.21.15.1:0/3672438701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 --2- 172.21.15.1:0/3672438701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 0x7feb74100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 -- 172.21.15.1:0/3672438701 >> 172.21.15.1:0/3672438701 conn(0x7feb740fc2a0 msgr2=0x7feb740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 -- 172.21.15.1:0/3672438701 shutdown_connections 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.655+0000 7feb7c706640 1 -- 172.21.15.1:0/3672438701 wait complete. 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 Processor -- start 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 -- start start 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 0x7feb74104c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb7410c7c0 con 0x7feb74101d10 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb7410c640 con 0x7feb741026d0 2024-09-12T02:27:58.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb7c706640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb7410c940 con 0x7feb74100b10 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb79ca1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb79ca1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56324/0 (socket says 172.21.15.1:56324) 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.656+0000 7feb79ca1640 1 -- 172.21.15.1:0/3367114074 learned_addr learned my addr 172.21.15.1:0/3367114074 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb7a4a2640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 0x7feb74104c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb7aca3640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 -- 172.21.15.1:0/3367114074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 msgr2=0x7feb74104c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 0x7feb74104c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 -- 172.21.15.1:0/3367114074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 msgr2=0x7feb74103820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74103820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 -- 172.21.15.1:0/3367114074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb741040e0 con 0x7feb74101d10 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb7aca3640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb79ca1640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb70031440 tx=0x7feb70032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7003f030 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb70003ce0 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb741a2040 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70035070 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.657+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb741a2540 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.658+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb741a2770 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.660+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7feb70042030 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.661+0000 7feb677fe640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 0x7feb600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.661+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7feb700ef450 con 0x7feb74101d10 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.661+0000 7feb7a4a2640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 0x7feb600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.661+0000 7feb7a4a2640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 0x7feb600a50c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb74101b70 tx=0x7feb6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.664+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb700bc980 con 0x7feb74101d10 2024-09-12T02:27:58.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.841+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7feb74108a70 con 0x7feb74101d10 2024-09-12T02:27:58.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.841+0000 7feb677fe640 1 -- 172.21.15.1:0/3367114074 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7feb700bc280 con 0x7feb74101d10 2024-09-12T02:27:58.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:58.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:58.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:58.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:58 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:58.843 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 msgr2=0x7feb600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 0x7feb600a50c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb74101b70 tx=0x7feb6800b390 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 msgr2=0x7feb741032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb70031440 tx=0x7feb70032e20 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 shutdown_connections 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb600a2c00 0x7feb600a50c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb74101d10 0x7feb741032e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb741026d0 0x7feb74103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.843+0000 7feb7c706640 1 --2- 172.21.15.1:0/3367114074 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb74100b10 0x7feb74104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.844+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 >> 172.21.15.1:0/3367114074 conn(0x7feb740fc2a0 msgr2=0x7feb740fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:58.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.844+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 shutdown_connections 2024-09-12T02:27:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:27:58.844+0000 7feb7c706640 1 -- 172.21.15.1:0/3367114074 wait complete. 2024-09-12T02:27:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:27:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:59.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:58 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:27:58.700+0000 7f9033594640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:27:59.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:27:58.712+0000 7f902f3bc640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T02:27:59.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:59.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:58 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:27:59.635 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726108053,"num_in_osds":12,"osd_in_since":1726108056,"num_remapped_pgs":0} 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: Detected new or changed devices on smithi173 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:27:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:27:59 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3367114074' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: Detected new or changed devices on smithi173 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:00.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:27:59 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3367114074' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: Detected new or changed devices on smithi173 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:27:59 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3367114074' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:00.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:28:00.907 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:01.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:00 smithi001 ceph-mon[31252]: purged_snaps scrub starts 2024-09-12T02:28:01.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:00 smithi001 ceph-mon[31252]: purged_snaps scrub ok 2024-09-12T02:28:01.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:00 smithi001 ceph-mon[31252]: osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] boot 2024-09-12T02:28:01.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:00 smithi001 ceph-mon[31252]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:28:01.028 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:00 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:00 smithi134 ceph-mon[35091]: purged_snaps scrub starts 2024-09-12T02:28:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:00 smithi134 ceph-mon[35091]: purged_snaps scrub ok 2024-09-12T02:28:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:00 smithi134 ceph-mon[35091]: osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] boot 2024-09-12T02:28:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:00 smithi134 ceph-mon[35091]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:28:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:00 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:00 smithi173 ceph-mon[35036]: purged_snaps scrub starts 2024-09-12T02:28:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:00 smithi173 ceph-mon[35036]: purged_snaps scrub ok 2024-09-12T02:28:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:00 smithi173 ceph-mon[35036]: osd.11 [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] boot 2024-09-12T02:28:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:00 smithi173 ceph-mon[35036]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T02:28:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:00 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:28:01.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 -- 172.21.15.1:0/2270686169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 msgr2=0x7f54ec102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 --2- 172.21.15.1:0/2270686169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec102000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009900 tx=0x7f54dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:28:01.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 -- 172.21.15.1:0/2270686169 shutdown_connections 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 --2- 172.21.15.1:0/2270686169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec1037c0 0x7f54ec10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 --2- 172.21.15.1:0/2270686169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec102e00 0x7f54ec103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 --2- 172.21.15.1:0/2270686169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec102000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 -- 172.21.15.1:0/2270686169 >> 172.21.15.1:0/2270686169 conn(0x7f54ec0fd390 msgr2=0x7f54ec0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.397+0000 7f54f2216640 1 -- 172.21.15.1:0/2270686169 shutdown_connections 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 -- 172.21.15.1:0/2270686169 wait complete. 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 Processor -- start 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 -- start start 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec102e00 0x7f54ec198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec1037c0 0x7f54ec19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec10d860 con 0x7f54ec101c00 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec10d6e0 con 0x7f54ec1037c0 2024-09-12T02:28:01.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.398+0000 7f54f2216640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec10d9e0 con 0x7f54ec102e00 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59590/0 (socket says 172.21.15.1:59590) 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 -- 172.21.15.1:0/2285426627 learned_addr learned my addr 172.21.15.1:0/2285426627 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eaffd640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec102e00 0x7f54ec198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 -- 172.21.15.1:0/2285426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec102e00 msgr2=0x7f54ec198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec102e00 0x7f54ec198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54ebfff640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec1037c0 0x7f54ec19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 -- 172.21.15.1:0/2285426627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec1037c0 msgr2=0x7f54ec19f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec1037c0 0x7f54ec19f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 -- 172.21.15.1:0/2285426627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec19fb20 con 0x7f54ec101c00 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54eb7fe640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54dc031610 tx=0x7f54dc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc03f030 con 0x7f54ec101c00 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec19fdb0 con 0x7f54ec101c00 2024-09-12T02:28:01.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54dc003ce0 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc035070 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.399+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec1a01d0 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.400+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ec109070 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.402+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f54dc042030 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.402+0000 7f54e8ff9640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 0x7f54d40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.402+0000 7f54eaffd640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 0x7f54d40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.402+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f54dc0ef330 con 0x7f54ec101c00 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.403+0000 7f54eaffd640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 0x7f54d40a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f54ec199410 tx=0x7f54e000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:01.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.405+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54dc0bc730 con 0x7f54ec101c00 2024-09-12T02:28:01.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.581+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f54ec062ef0 con 0x7f54ec101c00 2024-09-12T02:28:01.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.581+0000 7f54e8ff9640 1 -- 172.21.15.1:0/2285426627 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f54dc0bc030 con 0x7f54ec101c00 2024-09-12T02:28:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 msgr2=0x7f54d40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 0x7f54d40a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f54ec199410 tx=0x7f54e000a2d0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 msgr2=0x7f54ec197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54dc031610 tx=0x7f54dc0043b0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 shutdown_connections 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f54d40a2bb0 0x7f54d40a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54ec1037c0 0x7f54ec19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54ec102e00 0x7f54ec198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 --2- 172.21.15.1:0/2285426627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54ec101c00 0x7f54ec197ef0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 >> 172.21.15.1:0/2285426627 conn(0x7f54ec0fd390 msgr2=0x7f54ec106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 shutdown_connections 2024-09-12T02:28:01.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:01.583+0000 7f54f2216640 1 -- 172.21.15.1:0/2285426627 wait complete. 2024-09-12T02:28:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:01 smithi001 ceph-mon[31252]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:28:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:01 smithi001 ceph-mon[31252]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:28:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:01 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2285426627' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:01 smithi134 ceph-mon[35091]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:28:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:01 smithi134 ceph-mon[35091]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:28:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:01 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2285426627' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:01 smithi173 ceph-mon[35036]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:28:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:01 smithi173 ceph-mon[35036]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T02:28:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:01 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2285426627' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:28:02.375 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726108079,"num_in_osds":12,"osd_in_since":1726108056,"num_remapped_pgs":0} 2024-09-12T02:28:02.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:28:02.637 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:03.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 -- 172.21.15.1:0/1837361307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70102790 msgr2=0x7f0f701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 --2- 172.21.15.1:0/1837361307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70102790 0x7f0f701067e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009900 tx=0x7f0f6402a410 comp rx=0 tx=0).stop 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 -- 172.21.15.1:0/1837361307 shutdown_connections 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 --2- 172.21.15.1:0/1837361307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70102790 0x7f0f701067e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 --2- 172.21.15.1:0/1837361307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 --2- 172.21.15.1:0/1837361307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70101de0 0x7f0f701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 -- 172.21.15.1:0/1837361307 >> 172.21.15.1:0/1837361307 conn(0x7f0f700fd8c0 msgr2=0x7f0f700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 -- 172.21.15.1:0/1837361307 shutdown_connections 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.141+0000 7f0f76540640 1 -- 172.21.15.1:0/1837361307 wait complete. 2024-09-12T02:28:03.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 Processor -- start 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 -- start start 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 0x7f0f70198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f70112010 con 0x7f0f70101de0 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f70111e90 con 0x7f0f70106f10 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f76540640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f70112190 con 0x7f0f70102790 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.142+0000 7f0f6ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59610/0 (socket says 172.21.15.1:59610) 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 -- 172.21.15.1:0/1735959509 learned_addr learned my addr 172.21.15.1:0/1735959509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6f7fe640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 0x7f0f70198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f74add640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 -- 172.21.15.1:0/1735959509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 msgr2=0x7f0f70198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 0x7f0f70198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 -- 172.21.15.1:0/1735959509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 msgr2=0x7f0f7019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 -- 172.21.15.1:0/1735959509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7019d560 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6f7fe640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 0x7f0f70198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f74add640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6ffff640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b4a0 tx=0x7f0f6000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60014070 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7019d850 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f60010af0 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60017d10 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.143+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f701a5130 con 0x7f0f70101de0 2024-09-12T02:28:03.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.144+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f70102240 con 0x7f0f70101de0 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.145+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0f60017070 con 0x7f0f70101de0 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.146+0000 7f0f6d7fa640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 0x7f0f580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.146+0000 7f0f6f7fe640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 0x7f0f580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.146+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0f600ce130 con 0x7f0f70101de0 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.147+0000 7f0f6f7fe640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 0x7f0f580a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:03.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.150+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f6009b490 con 0x7f0f70101de0 2024-09-12T02:28:03.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.327+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f70109b60 con 0x7f0f70101de0 2024-09-12T02:28:03.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.328+0000 7f0f6d7fa640 1 -- 172.21.15.1:0/1735959509 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18420 (secure 0 0 0) 0x7f0f6009ad90 con 0x7f0f70101de0 2024-09-12T02:28:03.329 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:03.329 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:00.706581+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 msgr2=0x7f0f580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 0x7f0f580a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64032d50 comp rx=0 tx=0).stop 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 msgr2=0x7f0f701985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b4a0 tx=0x7f0f6000b960 comp rx=0 tx=0).stop 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 shutdown_connections 2024-09-12T02:28:03.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f580a2b80 0x7f0f580a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70106f10 0x7f0f7019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f70102790 0x7f0f70198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 --2- 172.21.15.1:0/1735959509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f70101de0 0x7f0f701985b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 >> 172.21.15.1:0/1735959509 conn(0x7f0f700fd8c0 msgr2=0x7f0f700fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 shutdown_connections 2024-09-12T02:28:03.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:03.331+0000 7f0f76540640 1 -- 172.21.15.1:0/1735959509 wait complete. 2024-09-12T02:28:03.932 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:03 smithi001 ceph-mon[31252]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:03.932 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:03 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1735959509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:03.964 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:24:10.372859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:28:03.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:28:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:03 smithi134 ceph-mon[35091]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:03 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1735959509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:03 smithi173 ceph-mon[35036]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:03 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1735959509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 -- 172.21.15.1:0/1429391557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c102d40 msgr2=0x7f192c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 --2- 172.21.15.1:0/1429391557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c102d40 0x7f192c103120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f191c009900 tx=0x7f191c02a480 comp rx=0 tx=0).stop 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 -- 172.21.15.1:0/1429391557 shutdown_connections 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 --2- 172.21.15.1:0/1429391557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c10c170 0x7f192c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 --2- 172.21.15.1:0/1429391557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 0x7f192c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 --2- 172.21.15.1:0/1429391557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c102d40 0x7f192c103120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 -- 172.21.15.1:0/1429391557 >> 172.21.15.1:0/1429391557 conn(0x7f192c0fc7a0 msgr2=0x7f192c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 -- 172.21.15.1:0/1429391557 shutdown_connections 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.714+0000 7f1930a54640 1 -- 172.21.15.1:0/1429391557 wait complete. 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 Processor -- start 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 -- start start 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c102d40 0x7f192c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 0x7f192c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f192c111fb0 con 0x7f192c10c170 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f192c111e30 con 0x7f192c102d40 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f1930a54640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f192c112130 con 0x7f192c103660 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f192ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.715+0000 7f192ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59630/0 (socket says 172.21.15.1:59630) 2024-09-12T02:28:04.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 -- 172.21.15.1:0/3132393871 learned_addr learned my addr 172.21.15.1:0/3132393871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192a59c640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c102d40 0x7f192c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f1929d9b640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 0x7f192c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 -- 172.21.15.1:0/3132393871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 msgr2=0x7f192c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 0x7f192c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 -- 172.21.15.1:0/3132393871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c102d40 msgr2=0x7f192c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c102d40 0x7f192c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 -- 172.21.15.1:0/3132393871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c19d3e0 con 0x7f192c10c170 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.716+0000 7f192ad9d640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f192400cce0 tx=0x7f192400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.717+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192400f450 con 0x7f192c10c170 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.717+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192400fad0 con 0x7f192c10c170 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.717+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192c19d6d0 con 0x7f192c10c170 2024-09-12T02:28:04.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.717+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924018c10 con 0x7f192c10c170 2024-09-12T02:28:04.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.717+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192c1a4fb0 con 0x7f192c10c170 2024-09-12T02:28:04.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.718+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f192c103120 con 0x7f192c10c170 2024-09-12T02:28:04.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.719+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f192400f5f0 con 0x7f192c10c170 2024-09-12T02:28:04.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.720+0000 7f191b7fe640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 0x7f19140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:04.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.720+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f19240cf1e0 con 0x7f192c10c170 2024-09-12T02:28:04.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.720+0000 7f192a59c640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 0x7f19140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:04.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.721+0000 7f192a59c640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 0x7f19140a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f191c000c00 tx=0x7f191c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:04.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.724+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1924014030 con 0x7f192c10c170 2024-09-12T02:28:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.897+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f192c02d7c0 con 0x7f192c10c170 2024-09-12T02:28:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.898+0000 7f191b7fe640 1 -- 172.21.15.1:0/3132393871 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f192409c5e0 con 0x7f192c10c170 2024-09-12T02:28:04.898 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-12T02:28:04.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 msgr2=0x7f19140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 0x7f19140a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f191c000c00 tx=0x7f191c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 msgr2=0x7f192c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f192400cce0 tx=0x7f192400a620 comp rx=0 tx=0).stop 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 shutdown_connections 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19140a2b80 0x7f19140a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f192c10c170 0x7f192c19cd00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f192c103660 0x7f192c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 --2- 172.21.15.1:0/3132393871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f192c102d40 0x7f192c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 >> 172.21.15.1:0/3132393871 conn(0x7f192c0fc7a0 msgr2=0x7f192c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 shutdown_connections 2024-09-12T02:28:04.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:04.900+0000 7f1930a54640 1 -- 172.21.15.1:0/3132393871 wait complete. 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.b on smithi134 2024-09-12T02:28:05.675 INFO:tasks.cephadm:Adding mds.e on smithi134 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.h on smithi134 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.k on smithi134 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.c on smithi173 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.f on smithi173 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.i on smithi173 2024-09-12T02:28:05.676 INFO:tasks.cephadm:Adding mds.l on smithi173 2024-09-12T02:28:05.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2024-09-12T02:28:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:05.999 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:05 smithi173 ceph-mon[35036]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:05.999 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:05 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3132393871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:28:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:05 smithi001 ceph-mon[31252]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:05 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3132393871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:28:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:05 smithi134 ceph-mon[35091]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:05 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3132393871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:28:06.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.463+0000 7f9817471640 1 -- 172.21.15.173:0/2732940198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9810100b00 msgr2=0x7f9810100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.463+0000 7f9817471640 1 --2- 172.21.15.173:0/2732940198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9810100b00 0x7f9810100f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f980c009900 tx=0x7f980c02a410 comp rx=0 tx=0).stop 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 -- 172.21.15.173:0/2732940198 shutdown_connections 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 --2- 172.21.15.173:0/2732940198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810101d00 0x7f9810102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 --2- 172.21.15.173:0/2732940198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98101026c0 0x7f9810108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 --2- 172.21.15.173:0/2732940198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9810100b00 0x7f9810100f00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 -- 172.21.15.173:0/2732940198 >> 172.21.15.173:0/2732940198 conn(0x7f98100fc290 msgr2=0x7f98100fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 -- 172.21.15.173:0/2732940198 shutdown_connections 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 -- 172.21.15.173:0/2732940198 wait complete. 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 Processor -- start 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.464+0000 7f9817471640 1 -- start start 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810100b00 0x7f981006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9810101d00 0x7f981019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f981010c7b0 con 0x7f9810100b00 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f981010c630 con 0x7f9810101d00 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9817471640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f981010c930 con 0x7f98101026c0 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:39100/0 (socket says 172.21.15.173:39100) 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 -- 172.21.15.173:0/582125677 learned_addr learned my addr 172.21.15.173:0/582125677 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f981520d640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810100b00 0x7f981006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9814a0c640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9810101d00 0x7f981019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 -- 172.21.15.173:0/582125677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9810101d00 msgr2=0x7f981019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9810101d00 0x7f981019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 -- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810100b00 msgr2=0x7f981006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810100b00 0x7f981006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 -- 172.21.15.173:0/582125677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981019fb60 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f9815a0e640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9808007f30 tx=0x7f980800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.465+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980801e070 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.466+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9810196a60 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.466+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9808011c30 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.466+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808019ce0 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.466+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9810196f50 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.467+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810107ed0 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.468+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9808021070 con 0x7f98101026c0 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.468+0000 7f98067fc640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 0x7f97fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.469+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f98080d3240 con 0x7f98101026c0 2024-09-12T02:28:06.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.469+0000 7f981520d640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 0x7f97fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.469+0000 7f981520d640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 0x7f97fc0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f980c02aa00 tx=0x7f980c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.472+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9808028020 con 0x7f98101026c0 2024-09-12T02:28:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.656+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) -- 0x7f98101985c0 con 0x7f97fc0a2b80 2024-09-12T02:28:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.664+0000 7f98067fc640 1 -- 172.21.15.173:0/582125677 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f98101985c0 con 0x7f97fc0a2b80 2024-09-12T02:28:06.665 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2024-09-12T02:28:06.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 msgr2=0x7f97fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 0x7f97fc0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f980c02aa00 tx=0x7f980c031400 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 msgr2=0x7f981019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9808007f30 tx=0x7f980800a620 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 shutdown_connections 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f97fc0a2b80 0x7f97fc0a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98101026c0 0x7f981019f250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9810101d00 0x7f981019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 --2- 172.21.15.173:0/582125677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9810100b00 0x7f981006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 >> 172.21.15.173:0/582125677 conn(0x7f98100fc290 msgr2=0x7f98101050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:06.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 shutdown_connections 2024-09-12T02:28:06.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T02:28:06.666+0000 7f9817471640 1 -- 172.21.15.173:0/582125677 wait complete. 2024-09-12T02:28:07.429 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:28:07.432 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:28:07.475 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:28:07.518 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:28:07.561 DEBUG:teuthology.orchestra.run.smithi134:mds.b> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:28:07.563 DEBUG:teuthology.orchestra.run.smithi134:mds.e> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:28:07.610 DEBUG:teuthology.orchestra.run.smithi134:mds.h> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:28:07.653 DEBUG:teuthology.orchestra.run.smithi134:mds.k> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:28:07.696 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:28:07.699 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:28:07.745 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:28:07.788 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:28:07.830 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:28:07.831 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:07.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:07.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:07.857 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:07.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:07.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T02:28:07.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:07.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:08.088 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 -- 172.21.15.1:0/3880498017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4103660 msgr2=0x7f99d410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 --2- 172.21.15.1:0/3880498017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4103660 0x7f99d410bb50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009900 tx=0x7f99c002a480 comp rx=0 tx=0).stop 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 -- 172.21.15.1:0/3880498017 shutdown_connections 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 --2- 172.21.15.1:0/3880498017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4103660 0x7f99d410bb50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 --2- 172.21.15.1:0/3880498017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d410c170 0x7f99d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 --2- 172.21.15.1:0/3880498017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4102d40 0x7f99d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 -- 172.21.15.1:0/3880498017 >> 172.21.15.1:0/3880498017 conn(0x7f99d40fc7a0 msgr2=0x7f99d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 -- 172.21.15.1:0/3880498017 shutdown_connections 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.561+0000 7f99dad6d640 1 -- 172.21.15.1:0/3880498017 wait complete. 2024-09-12T02:28:08.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 Processor -- start 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 -- start start 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4103660 0x7f99d4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d410c170 0x7f99d4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111f70 con 0x7f99d4102d40 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111df0 con 0x7f99d410c170 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99dad6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41120f0 con 0x7f99d4103660 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99d8b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99d8b09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59650/0 (socket says 172.21.15.1:59650) 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.562+0000 7f99d8b09640 1 -- 172.21.15.1:0/2511314471 learned_addr learned my addr 172.21.15.1:0/2511314471 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:08.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d3fff640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4103660 0x7f99d4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 -- 172.21.15.1:0/2511314471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4103660 msgr2=0x7f99d4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4103660 0x7f99d4100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 -- 172.21.15.1:0/2511314471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d410c170 msgr2=0x7f99d4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d410c170 0x7f99d4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 -- 172.21.15.1:0/2511314471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41a6910 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d8b09640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d950 tx=0x7f99c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8017070 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c8009c30 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41a6c00 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c800f6b0 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.563+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41a7140 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.564+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d4103120 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.565+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f99c80109d0 con 0x7f99d4102d40 2024-09-12T02:28:08.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.566+0000 7f99d1ffb640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 0x7f99c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.566+0000 7f99d3fff640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 0x7f99c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.567+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f99c80ce8a0 con 0x7f99d4102d40 2024-09-12T02:28:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.567+0000 7f99d3fff640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 0x7f99c40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99c00096c0 tx=0x7f99c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:08.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.571+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99c8009de0 con 0x7f99d4102d40 2024-09-12T02:28:08.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.781+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99d402d7c0 con 0x7f99d4102d40 2024-09-12T02:28:08.782 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:08 smithi001 ceph-mon[31252]: Deploying daemon mds.l on smithi173 2024-09-12T02:28:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.782+0000 7f99d1ffb640 1 -- 172.21.15.1:0/2511314471 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f99c809bca0 con 0x7f99d4102d40 2024-09-12T02:28:08.782 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:08.782 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-12T02:21:05:451625+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:28:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 msgr2=0x7f99c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 0x7f99c40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99c00096c0 tx=0x7f99c0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 msgr2=0x7f99d41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d950 tx=0x7f99c800de10 comp rx=0 tx=0).stop 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 shutdown_connections 2024-09-12T02:28:08.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f99c40a2b80 0x7f99c40a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99d410c170 0x7f99d4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99d4103660 0x7f99d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 --2- 172.21.15.1:0/2511314471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4102d40 0x7f99d41009a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 >> 172.21.15.1:0/2511314471 conn(0x7f99d40fc7a0 msgr2=0x7f99d40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 shutdown_connections 2024-09-12T02:28:08.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:08.784+0000 7f99dad6d640 1 -- 172.21.15.1:0/2511314471 wait complete. 2024-09-12T02:28:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:08 smithi173 ceph-mon[35036]: Deploying daemon mds.l on smithi173 2024-09-12T02:28:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:08 smithi134 ceph-mon[35091]: Deploying daemon mds.l on smithi173 2024-09-12T02:28:09.335 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 systemd[1]: Starting Ceph mds.l for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:09.594 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 podman[64419]: 2024-09-12 02:28:09.237236641 +0000 UTC m=+0.015510700 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:09.594 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 podman[64419]: 2024-09-12 02:28:09.351725246 +0000 UTC m=+0.129999299 container create f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:28:09.594 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 podman[64419]: 2024-09-12 02:28:09.594658944 +0000 UTC m=+0.372933001 container init f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:28:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mon[35036]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2511314471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6832/743947684,v1:172.21.15.173:6833/743947684] up:boot 2024-09-12T02:28:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mon[35036]: fsmap 1 up:standby 2024-09-12T02:28:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:28:09.948 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 podman[64419]: 2024-09-12 02:28:09.59744282 +0000 UTC m=+0.375716875 container start f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:28:09.948 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-mds[64438]: -- 172.21.15.173:0/1195828112 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcc653d860 con 0x55dcc651a800 2024-09-12T02:28:09.948 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: starting mds.l at 2024-09-12T02:28:09.948 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 bash[64419]: f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 2024-09-12T02:28:09.948 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:28:09 smithi173 systemd[1]: Started Ceph mds.l for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:09 smithi001 ceph-mon[31252]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:09 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2511314471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:09 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6832/743947684,v1:172.21.15.173:6833/743947684] up:boot 2024-09-12T02:28:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:09 smithi001 ceph-mon[31252]: fsmap 1 up:standby 2024-09-12T02:28:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:09 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:28:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:09 smithi134 ceph-mon[35091]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:09 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2511314471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:09 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6832/743947684,v1:172.21.15.173:6833/743947684] up:boot 2024-09-12T02:28:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:09 smithi134 ceph-mon[35091]: fsmap 1 up:standby 2024-09-12T02:28:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:09 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:11.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:10 smithi001 ceph-mon[31252]: Deploying daemon mds.k on smithi134 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:11.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:10 smithi134 ceph-mon[35091]: Deploying daemon mds.k on smithi134 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:11.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:10 smithi173 ceph-mon[35036]: Deploying daemon mds.k on smithi134 2024-09-12T02:28:11.729 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:11 smithi134 ceph-mon[35091]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:11.914 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:11 smithi134 systemd[1]: Starting Ceph mds.k for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:11.998 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:12.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:11 smithi001 ceph-mon[31252]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:11 smithi173 ceph-mon[35036]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:12.264 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:11 smithi134 podman[64057]: 2024-09-12 02:28:11.884047875 +0000 UTC m=+0.015664984 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:12.264 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 podman[64057]: 2024-09-12 02:28:12.025722254 +0000 UTC m=+0.157339354 container create 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:28:12.264 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 podman[64057]: 2024-09-12 02:28:12.264683012 +0000 UTC m=+0.396300113 container init 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:28:12.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 -- 172.21.15.1:0/4059084370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 msgr2=0x7f302c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4059084370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c10da40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3024009ca0 tx=0x7f302402a950 comp rx=0 tx=0).stop 2024-09-12T02:28:12.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 -- 172.21.15.1:0/4059084370 shutdown_connections 2024-09-12T02:28:12.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4059084370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c10da40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4059084370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c102570 0x7f302c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4059084370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c100e20 0x7f302c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 -- 172.21.15.1:0/4059084370 >> 172.21.15.1:0/4059084370 conn(0x7f302c0fc7d0 msgr2=0x7f302c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:12.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 -- 172.21.15.1:0/4059084370 shutdown_connections 2024-09-12T02:28:12.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.505+0000 7f3030d3c640 1 -- 172.21.15.1:0/4059084370 wait complete. 2024-09-12T02:28:12.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 Processor -- start 2024-09-12T02:28:12.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 -- start start 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 0x7f302c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c102570 0x7f302c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f302c110f80 con 0x7f302c102ef0 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f302c110e00 con 0x7f302c100e20 2024-09-12T02:28:12.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.506+0000 7f3030d3c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f302c111100 con 0x7f302c102570 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38674/0 (socket says 172.21.15.1:38674) 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302ad9d640 1 -- 172.21.15.1:0/4078103501 learned_addr learned my addr 172.21.15.1:0/4078103501 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f3029d9b640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c102570 0x7f302c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 0x7f302c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 -- 172.21.15.1:0/4078103501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c102570 msgr2=0x7f302c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c102570 0x7f302c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 -- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 msgr2=0x7f302c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 -- 172.21.15.1:0/4078103501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c1a6990 con 0x7f302c100e20 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302ad9d640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f302a59c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 0x7f302c0fcc80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c970 tx=0x7f301c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.507+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c007bb0 con 0x7f302c100e20 2024-09-12T02:28:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.508+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f301c007d50 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.508+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c1a6c80 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.508+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c00f450 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.508+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c1a7170 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.509+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c101200 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.510+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f301c004f30 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.510+0000 7f301b7fe640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 0x7f30140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.510+0000 7f3029d9b640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 0x7f30140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.510+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f301c0ce850 con 0x7f302c100e20 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.511+0000 7f3029d9b640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 0x7f30140a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f302c0fe440 tx=0x7f302000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:12.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.515+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f301c014030 con 0x7f302c100e20 2024-09-12T02:28:12.663 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 podman[64057]: 2024-09-12 02:28:12.267824372 +0000 UTC m=+0.399441472 container start 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:28:12.663 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 ceph-mds[64076]: -- 172.21.15.134:0/344618111 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560522cc9860 con 0x560522ca6800 2024-09-12T02:28:12.663 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: starting mds.k at 2024-09-12T02:28:12.663 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 bash[64057]: 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f 2024-09-12T02:28:12.663 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:28:12 smithi134 systemd[1]: Started Ceph mds.k for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.732+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f302c10a0a0 con 0x7f302c100e20 2024-09-12T02:28:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.732+0000 7f301b7fe640 1 -- 172.21.15.1:0/4078103501 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f301c09b560 con 0x7f302c100e20 2024-09-12T02:28:12.733 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:12.734 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-12T02:28:09:625475+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:28:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-12T02:28:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 msgr2=0x7f30140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 0x7f30140a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f302c0fe440 tx=0x7f302000b390 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 msgr2=0x7f302c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 0x7f302c0fcc80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c970 tx=0x7f301c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 shutdown_connections 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30140a2b80 0x7f30140a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f302c102ef0 0x7f302c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f302c102570 0x7f302c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 --2- 172.21.15.1:0/4078103501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f302c100e20 0x7f302c0fcc80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.735+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 >> 172.21.15.1:0/4078103501 conn(0x7f302c0fc7d0 msgr2=0x7f302c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.736+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 shutdown_connections 2024-09-12T02:28:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:12.736+0000 7f3030d3c640 1 -- 172.21.15.1:0/4078103501 wait complete. 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:13.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: Deploying daemon mds.j on smithi001 2024-09-12T02:28:13.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/4078103501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:13.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6832/1137270315,v1:172.21.15.134:6833/1137270315] up:boot 2024-09-12T02:28:13.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: fsmap 2 up:standby 2024-09-12T02:28:13.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:13 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:13.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: Deploying daemon mds.j on smithi001 2024-09-12T02:28:13.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/4078103501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:13.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6832/1137270315,v1:172.21.15.134:6833/1137270315] up:boot 2024-09-12T02:28:13.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: fsmap 2 up:standby 2024-09-12T02:28:13.698 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:13 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:28:13.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:13.730 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: Deploying daemon mds.j on smithi001 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4078103501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6832/1137270315,v1:172.21.15.134:6833/1137270315] up:boot 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: fsmap 2 up:standby 2024-09-12T02:28:13.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:13 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:28:15.415 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 systemd[1]: Starting Ceph mds.j for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:15.695 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:15 smithi001 ceph-mon[31252]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:15.695 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 podman[68433]: 2024-09-12 02:28:15.47246731 +0000 UTC m=+0.016711370 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:15.695 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 podman[68433]: 2024-09-12 02:28:15.574146885 +0000 UTC m=+0.118390931 container create ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:28:15.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:15 smithi173 ceph-mon[35036]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:15.767 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:15 smithi134 ceph-mon[35091]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:16.035 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 podman[68433]: 2024-09-12 02:28:15.835400423 +0000 UTC m=+0.379644467 container init ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 podman[68433]: 2024-09-12 02:28:15.838795906 +0000 UTC m=+0.383039959 container start ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 ceph-mds[68470]: -- 172.21.15.1:0/2823734458 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd11e95860 con 0x55bd11e72800 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j[68448]: starting mds.j at 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 bash[68433]: ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be 2024-09-12T02:28:16.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:28:15 smithi001 systemd[1]: Started Ceph mds.j for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:16.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- 172.21.15.1:0/3095840909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c106f10 msgr2=0x7f833c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 --2- 172.21.15.1:0/3095840909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c106f10 0x7f833c10ea90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8334009ca0 tx=0x7f833402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- 172.21.15.1:0/3095840909 shutdown_connections 2024-09-12T02:28:16.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 --2- 172.21.15.1:0/3095840909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c106f10 0x7f833c10ea90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 --2- 172.21.15.1:0/3095840909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c102790 0x7f833c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 --2- 172.21.15.1:0/3095840909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c101de0 0x7f833c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- 172.21.15.1:0/3095840909 >> 172.21.15.1:0/3095840909 conn(0x7f833c0fd8c0 msgr2=0x7f833c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- 172.21.15.1:0/3095840909 shutdown_connections 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- 172.21.15.1:0/3095840909 wait complete. 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 Processor -- start 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.549+0000 7f834238f640 1 -- start start 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c101de0 0x7f833c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c106f10 0x7f833c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f833c111f70 con 0x7f833c102790 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f833c111df0 con 0x7f833c106f10 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834238f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f833c1120f0 con 0x7f833c101de0 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38710/0 (socket says 172.21.15.1:38710) 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 -- 172.21.15.1:0/376732436 learned_addr learned my addr 172.21.15.1:0/376732436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833bfff640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c101de0 0x7f833c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f834092c640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c106f10 0x7f833c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 -- 172.21.15.1:0/376732436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c101de0 msgr2=0x7f833c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c101de0 0x7f833c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 -- 172.21.15.1:0/376732436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c106f10 msgr2=0x7f833c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c106f10 0x7f833c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 -- 172.21.15.1:0/376732436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c19d3c0 con 0x7f833c102790 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.550+0000 7f833b7fe640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f833000d770 tx=0x7f833000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.551+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330017070 con 0x7f833c102790 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.551+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8330005500 con 0x7f833c102790 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.551+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c19d6b0 con 0x7f833c102790 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.551+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330004e00 con 0x7f833c102790 2024-09-12T02:28:16.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.551+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1a4f90 con 0x7f833c102790 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.552+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c1021c0 con 0x7f833c102790 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.553+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8330004fa0 con 0x7f833c102790 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.553+0000 7f83397fa640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 0x7f83240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.554+0000 7f833bfff640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 0x7f83240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.554+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f83300ce540 con 0x7f833c102790 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.554+0000 7f833bfff640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 0x7f83240a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f832c00bbe0 tx=0x7f832c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:16.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.558+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f833009b940 con 0x7f833c102790 2024-09-12T02:28:16.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.787+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f833c10a150 con 0x7f833c102790 2024-09-12T02:28:16.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.788+0000 7f83397fa640 1 -- 172.21.15.1:0/376732436 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f833009b240 con 0x7f833c102790 2024-09-12T02:28:16.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:16.790 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-09-12T02:28:16:415998+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:28:16.790 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 msgr2=0x7f83240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 0x7f83240a50c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f832c00bbe0 tx=0x7f832c00b390 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 msgr2=0x7f833c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f833000d770 tx=0x7f833000dc30 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 shutdown_connections 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83240a2c00 0x7f83240a50c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f833c102790 0x7f833c198950 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f833c106f10 0x7f833c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 --2- 172.21.15.1:0/376732436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f833c101de0 0x7f833c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 >> 172.21.15.1:0/376732436 conn(0x7f833c0fd8c0 msgr2=0x7f833c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:16.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.790+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 shutdown_connections 2024-09-12T02:28:16.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:16.791+0000 7f834238f640 1 -- 172.21.15.1:0/376732436 wait complete. 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: Deploying daemon mds.d on smithi001 2024-09-12T02:28:17.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6834/1949670850,v1:172.21.15.1:6835/1949670850] up:boot 2024-09-12T02:28:17.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: fsmap 3 up:standby 2024-09-12T02:28:17.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:28:17.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:16 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/376732436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:17.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:17.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: Deploying daemon mds.d on smithi001 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6834/1949670850,v1:172.21.15.1:6835/1949670850] up:boot 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: fsmap 3 up:standby 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:28:17.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:16 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/376732436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:17.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:17.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: Deploying daemon mds.d on smithi001 2024-09-12T02:28:17.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6834/1949670850,v1:172.21.15.1:6835/1949670850] up:boot 2024-09-12T02:28:17.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: fsmap 3 up:standby 2024-09-12T02:28:17.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:28:17.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:16 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/376732436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:19.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:18 smithi001 ceph-mon[31252]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:19.185 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 systemd[1]: Starting Ceph mds.d for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:19.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:18 smithi134 ceph-mon[35091]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:19.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:18 smithi173 ceph-mon[35036]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:19.513 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 podman[68847]: 2024-09-12 02:28:19.252558679 +0000 UTC m=+0.017063647 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:19.513 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 podman[68847]: 2024-09-12 02:28:19.408929128 +0000 UTC m=+0.173434085 container create dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:28:19.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 podman[68847]: 2024-09-12 02:28:19.628458169 +0000 UTC m=+0.392963125 container init dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 podman[68847]: 2024-09-12 02:28:19.632596543 +0000 UTC m=+0.397101505 container start dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 ceph-mds[68875]: -- 172.21.15.1:0/3909386546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630e074d860 con 0x5630e072b000 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d[68871]: starting mds.d at 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 bash[68847]: dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc 2024-09-12T02:28:19.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:28:19 smithi001 systemd[1]: Started Ceph mds.d for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:19.982 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- 172.21.15.1:0/2007501669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 msgr2=0x7fac241067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 --2- 172.21.15.1:0/2007501669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac241067f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac18009900 tx=0x7fac1802a410 comp rx=0 tx=0).stop 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- 172.21.15.1:0/2007501669 shutdown_connections 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 --2- 172.21.15.1:0/2007501669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac241067f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 --2- 172.21.15.1:0/2007501669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24106f20 0x7fac2410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 --2- 172.21.15.1:0/2007501669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24101df0 0x7fac241021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- 172.21.15.1:0/2007501669 >> 172.21.15.1:0/2007501669 conn(0x7fac240fd8b0 msgr2=0x7fac240ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- 172.21.15.1:0/2007501669 shutdown_connections 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- 172.21.15.1:0/2007501669 wait complete. 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 Processor -- start 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.608+0000 7fac2a65f640 1 -- start start 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 0x7fac24198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 0x7fac2419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac24111f80 con 0x7fac241027a0 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac24111e00 con 0x7fac24101df0 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac2a65f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fac24112100 con 0x7fac24106f20 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38748/0 (socket says 172.21.15.1:38748) 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac23fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 0x7fac24198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 -- 172.21.15.1:0/3985211522 learned_addr learned my addr 172.21.15.1:0/3985211522 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac28bfc640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 0x7fac2419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 -- 172.21.15.1:0/3985211522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 msgr2=0x7fac2419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 0x7fac2419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 -- 172.21.15.1:0/3985211522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 msgr2=0x7fac24198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 0x7fac24198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 -- 172.21.15.1:0/3985211522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2419d3f0 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac28bfc640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 0x7fac2419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac23fff640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 0x7fac24198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.609+0000 7fac237fe640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac18006010 tx=0x7fac180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.610+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1803f030 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.610+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac18003ce0 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.610+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2419d680 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.610+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18035070 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.610+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac241a4fc0 con 0x7fac241027a0 2024-09-12T02:28:20.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.611+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac241032d0 con 0x7fac241027a0 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.612+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fac18042030 con 0x7fac241027a0 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.613+0000 7fac217fa640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 0x7fac0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.613+0000 7fac23fff640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 0x7fac0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.613+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fac180ef300 con 0x7fac241027a0 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.613+0000 7fac23fff640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 0x7fac0c0a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac140058c0 tx=0x7fac1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.617+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac180bc720 con 0x7fac241027a0 2024-09-12T02:28:20.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.830+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac2410a160 con 0x7fac241027a0 2024-09-12T02:28:20.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.830+0000 7fac217fa640 1 -- 172.21.15.1:0/3985211522 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7fac180bc020 con 0x7fac241027a0 2024-09-12T02:28:20.831 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:20.831 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"btime":"2024-09-12T02:28:19:980925+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:28:20.831 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 5 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 msgr2=0x7fac0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 0x7fac0c0a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac140058c0 tx=0x7fac1400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 msgr2=0x7fac24198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac18006010 tx=0x7fac180042f0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 shutdown_connections 2024-09-12T02:28:20.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fac0c0a2b80 0x7fac0c0a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac241027a0 0x7fac24198980 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac24106f20 0x7fac2419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 --2- 172.21.15.1:0/3985211522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac24101df0 0x7fac24198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 >> 172.21.15.1:0/3985211522 conn(0x7fac240fd8b0 msgr2=0x7fac240febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 shutdown_connections 2024-09-12T02:28:20.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:20.833+0000 7fac2a65f640 1 -- 172.21.15.1:0/3985211522 wait complete. 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: Deploying daemon mds.e on smithi134 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6836/732674726,v1:172.21.15.1:6837/732674726] up:boot 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: fsmap 4 up:standby 2024-09-12T02:28:20.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:20 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: Deploying daemon mds.e on smithi134 2024-09-12T02:28:21.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6836/732674726,v1:172.21.15.1:6837/732674726] up:boot 2024-09-12T02:28:21.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: fsmap 4 up:standby 2024-09-12T02:28:21.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:20 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:28:21.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: Deploying daemon mds.e on smithi134 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6836/732674726,v1:172.21.15.1:6837/732674726] up:boot 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: fsmap 4 up:standby 2024-09-12T02:28:21.297 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:20 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:28:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:21 smithi001 ceph-mon[31252]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3985211522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:21 smithi134 ceph-mon[35091]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:21 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3985211522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:21.913 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:21 smithi134 systemd[1]: Starting Ceph mds.e for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:21 smithi173 ceph-mon[35036]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:21 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3985211522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:22.337 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 podman[64372]: 2024-09-12 02:28:21.944405652 +0000 UTC m=+0.015654612 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:22.337 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 podman[64372]: 2024-09-12 02:28:22.09281149 +0000 UTC m=+0.164060451 container create 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:28:22.337 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 podman[64372]: 2024-09-12 02:28:22.337567451 +0000 UTC m=+0.408816410 container init 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:28:22.663 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 podman[64372]: 2024-09-12 02:28:22.340620965 +0000 UTC m=+0.411869934 container start 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:28:22.663 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 ceph-mds[64391]: -- 172.21.15.134:0/3972105372 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55802caf1860 con 0x55802cace800 2024-09-12T02:28:22.663 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: starting mds.e at 2024-09-12T02:28:22.663 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 bash[64372]: 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb 2024-09-12T02:28:22.664 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:28:22 smithi134 systemd[1]: Started Ceph mds.e for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:23.636 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: Deploying daemon mds.f on smithi173 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6834/4061904482,v1:172.21.15.134:6835/4061904482] up:boot 2024-09-12T02:28:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: fsmap 5 up:standby 2024-09-12T02:28:23.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:23 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:28:23.905 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: Deploying daemon mds.f on smithi173 2024-09-12T02:28:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6834/4061904482,v1:172.21.15.134:6835/4061904482] up:boot 2024-09-12T02:28:23.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: fsmap 5 up:standby 2024-09-12T02:28:23.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:23 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: Deploying daemon mds.f on smithi173 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6834/4061904482,v1:172.21.15.134:6835/4061904482] up:boot 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: fsmap 5 up:standby 2024-09-12T02:28:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:23 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:28:24.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- 172.21.15.1:0/3653988890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 msgr2=0x7f4e2c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/3653988890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c10eaa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009ca0 tx=0x7f4e2402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- 172.21.15.1:0/3653988890 shutdown_connections 2024-09-12T02:28:24.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/3653988890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c10eaa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/3653988890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 0x7f4e2c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/3653988890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 0x7f4e2c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- 172.21.15.1:0/3653988890 >> 172.21.15.1:0/3653988890 conn(0x7f4e2c0fd8b0 msgr2=0x7f4e2c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- 172.21.15.1:0/3653988890 shutdown_connections 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- 172.21.15.1:0/3653988890 wait complete. 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 Processor -- start 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.415+0000 7f4e33c5e640 1 -- start start 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 0x7f4e2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 0x7f4e2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c111f80 con 0x7f4e2c106f20 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c111e00 con 0x7f4e2c101df0 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e33c5e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c112100 con 0x7f4e2c1027a0 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37816/0 (socket says 172.21.15.1:37816) 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 -- 172.21.15.1:0/2654900908 learned_addr learned my addr 172.21.15.1:0/2654900908 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e311f9640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 0x7f4e2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e319fa640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 0x7f4e2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 -- 172.21.15.1:0/2654900908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 msgr2=0x7f4e2c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 0x7f4e2c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 -- 172.21.15.1:0/2654900908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 msgr2=0x7f4e2c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 0x7f4e2c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 -- 172.21.15.1:0/2654900908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c1a67e0 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e321fb640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4e24031a20 tx=0x7f4e24031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.416+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24003b70 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.417+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e24003d10 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.417+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c1a6a70 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.417+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2402fc80 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.417+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c1a7000 con 0x7f4e2c106f20 2024-09-12T02:28:24.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.418+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c1021d0 con 0x7f4e2c106f20 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.419+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4e240046a0 con 0x7f4e2c106f20 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.420+0000 7f4e1effd640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 0x7f4e180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.420+0000 7f4e319fa640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 0x7f4e180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.420+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4e240efd00 con 0x7f4e2c106f20 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.420+0000 7f4e319fa640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 0x7f4e180a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e20005d00 tx=0x7f4e2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.424+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e240bd190 con 0x7f4e2c106f20 2024-09-12T02:28:24.628 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 systemd[1]: Starting Ceph mds.f for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:24.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.641+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e2c1a7230 con 0x7f4e2c106f20 2024-09-12T02:28:24.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.641+0000 7f4e1effd640 1 -- 172.21.15.1:0/2654900908 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f4e240bca90 con 0x7f4e2c106f20 2024-09-12T02:28:24.642 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:24.642 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-12T02:28:22:802343+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T02:28:24.642 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-12T02:28:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 msgr2=0x7f4e180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 0x7f4e180a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e20005d00 tx=0x7f4e2000b410 comp rx=0 tx=0).stop 2024-09-12T02:28:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 msgr2=0x7f4e2c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4e24031a20 tx=0x7f4e24031a50 comp rx=0 tx=0).stop 2024-09-12T02:28:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 shutdown_connections 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4e180a2c00 0x7f4e180a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e2c106f20 0x7f4e2c074f70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e2c1027a0 0x7f4e2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 --2- 172.21.15.1:0/2654900908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e2c101df0 0x7f4e2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 >> 172.21.15.1:0/2654900908 conn(0x7f4e2c0fd8b0 msgr2=0x7f4e2c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 shutdown_connections 2024-09-12T02:28:24.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:24.644+0000 7f4e33c5e640 1 -- 172.21.15.1:0/2654900908 wait complete. 2024-09-12T02:28:24.890 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 podman[64720]: 2024-09-12 02:28:24.531096219 +0000 UTC m=+0.016110601 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:24.890 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 podman[64720]: 2024-09-12 02:28:24.645973149 +0000 UTC m=+0.130987528 container create ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:28:24.890 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 podman[64720]: 2024-09-12 02:28:24.890287036 +0000 UTC m=+0.375301426 container init ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:28:25.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 podman[64720]: 2024-09-12 02:28:24.893285731 +0000 UTC m=+0.378300112 container start ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:28:25.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 ceph-mds[64739]: -- 172.21.15.173:0/707899096 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604d21ffc20 con 0x5604d21dd400 2024-09-12T02:28:25.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: starting mds.f at 2024-09-12T02:28:25.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 bash[64720]: ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c 2024-09-12T02:28:25.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:28:24 smithi173 systemd[1]: Started Ceph mds.f for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:25.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:25.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2654900908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:25.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:25.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:25.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:25 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:25.810 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:25.810 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2654900908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:25 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2654900908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:25 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:26 smithi173 ceph-mon[35036]: Deploying daemon mds.c on smithi173 2024-09-12T02:28:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:26 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:boot 2024-09-12T02:28:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:26 smithi173 ceph-mon[35036]: fsmap 6 up:standby 2024-09-12T02:28:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:26 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:28:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:26 smithi001 ceph-mon[31252]: Deploying daemon mds.c on smithi173 2024-09-12T02:28:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:26 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:boot 2024-09-12T02:28:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:26 smithi001 ceph-mon[31252]: fsmap 6 up:standby 2024-09-12T02:28:26.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:26 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:28:26.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:26 smithi134 ceph-mon[35091]: Deploying daemon mds.c on smithi173 2024-09-12T02:28:26.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:26 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:boot 2024-09-12T02:28:26.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:26 smithi134 ceph-mon[35091]: fsmap 6 up:standby 2024-09-12T02:28:26.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:26 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:28:27.197 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 systemd[1]: Starting Ceph mds.c for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:27.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:27 smithi173 ceph-mon[35036]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:27.548 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 podman[65017]: 2024-09-12 02:28:27.169358574 +0000 UTC m=+0.015763135 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:27.548 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 podman[65017]: 2024-09-12 02:28:27.286951233 +0000 UTC m=+0.133355822 container create acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:28:27.549 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 podman[65017]: 2024-09-12 02:28:27.548896596 +0000 UTC m=+0.395301150 container init acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T02:28:27.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:27 smithi001 ceph-mon[31252]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:27 smithi134 ceph-mon[35091]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:27.921 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:27.947 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 podman[65017]: 2024-09-12 02:28:27.551834461 +0000 UTC m=+0.398239016 container start acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:28:27.947 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 ceph-mds[65037]: -- 172.21.15.173:0/1286132528 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc49c17860 con 0x55fc49bf4800 2024-09-12T02:28:27.947 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: starting mds.c at 2024-09-12T02:28:27.947 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 bash[65017]: acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 2024-09-12T02:28:27.947 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:28:27 smithi173 systemd[1]: Started Ceph mds.c for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 -- 172.21.15.1:0/3551010514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a01019f0 msgr2=0x7fb7a0101e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 --2- 172.21.15.1:0/3551010514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a01019f0 0x7fb7a0101e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb788009930 tx=0x7fb78802a420 comp rx=0 tx=0).stop 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 -- 172.21.15.1:0/3551010514 shutdown_connections 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 --2- 172.21.15.1:0/3551010514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a01019f0 0x7fb7a0101e50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 --2- 172.21.15.1:0/3551010514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 0x7fb7a010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 --2- 172.21.15.1:0/3551010514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a0107b00 0x7fb7a0107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 -- 172.21.15.1:0/3551010514 >> 172.21.15.1:0/3551010514 conn(0x7fb7a00fd710 msgr2=0x7fb7a00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 -- 172.21.15.1:0/3551010514 shutdown_connections 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.442+0000 7fb7a5402640 1 -- 172.21.15.1:0/3551010514 wait complete. 2024-09-12T02:28:28.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 Processor -- start 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 -- start start 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 0x7fb7a0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0111f00 con 0x7fb7a0107b00 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0111d80 con 0x7fb7a01019f0 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb7a5402640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0112080 con 0x7fb7a0102390 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:49414/0 (socket says 172.21.15.1:49414) 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37824/0 (socket says 172.21.15.1:37824) 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 -- 172.21.15.1:0/509516276 learned_addr learned my addr 172.21.15.1:0/509516276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb797fff640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 0x7fb7a0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 -- 172.21.15.1:0/509516276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 msgr2=0x7fb7a0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 0x7fb7a0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 -- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 msgr2=0x7fb7a019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 -- 172.21.15.1:0/509516276 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a019d3b0 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79f7fe640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.443+0000 7fb79effd640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e9f0 tx=0x7fb79000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.444+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000cd80 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.444+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a019d6a0 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.444+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb790010910 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.444+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900188f0 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.444+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a4f80 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.445+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a0101e50 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.447+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb790010ac0 con 0x7fb7a01019f0 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.447+0000 7fb79cff9640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 0x7fb78c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.447+0000 7fb797fff640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 0x7fb78c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.447+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb7900cf350 con 0x7fb7a01019f0 2024-09-12T02:28:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.448+0000 7fb797fff640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 0x7fb78c0a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb788009900 tx=0x7fb7880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:28.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.450+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb79009c060 con 0x7fb7a01019f0 2024-09-12T02:28:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.664+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7a00008d0 con 0x7fb7a01019f0 2024-09-12T02:28:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.665+0000 7fb79cff9640 1 -- 172.21.15.1:0/509516276 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6379 (secure 0 0 0) 0x7fb7900a0360 con 0x7fb7a01019f0 2024-09-12T02:28:28.665 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:28.665 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-12T02:28:28:501938+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:28:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 msgr2=0x7fb78c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 0x7fb78c0a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb788009900 tx=0x7fb7880058d0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 msgr2=0x7fb7a0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e9f0 tx=0x7fb79000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 shutdown_connections 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb78c0a2b80 0x7fb78c0a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7a0107b00 0x7fb7a019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0102390 0x7fb7a0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 --2- 172.21.15.1:0/509516276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a01019f0 0x7fb7a0198400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.667+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 >> 172.21.15.1:0/509516276 conn(0x7fb7a00fd710 msgr2=0x7fb7a00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.668+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 shutdown_connections 2024-09-12T02:28:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:28.668+0000 7fb7a5402640 1 -- 172.21.15.1:0/509516276 wait complete. 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: Deploying daemon mds.h on smithi134 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:boot 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: fsmap 7 up:standby 2024-09-12T02:28:29.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:28:29.077 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/509516276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: Deploying daemon mds.h on smithi134 2024-09-12T02:28:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:boot 2024-09-12T02:28:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: fsmap 7 up:standby 2024-09-12T02:28:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:28:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/509516276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: Deploying daemon mds.h on smithi134 2024-09-12T02:28:29.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:boot 2024-09-12T02:28:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: fsmap 7 up:standby 2024-09-12T02:28:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:28:29.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/509516276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:29.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:29 smithi134 ceph-mon[35091]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:29.913 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:29 smithi134 systemd[1]: Starting Ceph mds.h for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:29 smithi001 ceph-mon[31252]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:30.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:29 smithi173 ceph-mon[35036]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:30.242 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:29 smithi134 podman[64674]: 2024-09-12 02:28:29.892394773 +0000 UTC m=+0.016313555 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:30.243 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:29 smithi134 podman[64674]: 2024-09-12 02:28:29.990283748 +0000 UTC m=+0.114202522 container create 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:28:30.243 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 podman[64674]: 2024-09-12 02:28:30.243120266 +0000 UTC m=+0.367039061 container init 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T02:28:30.663 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 podman[64674]: 2024-09-12 02:28:30.246156682 +0000 UTC m=+0.370075469 container start 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:28:30.663 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 ceph-mds[64693]: -- 172.21.15.134:0/2865102016 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5651650ef860 con 0x5651650cc800 2024-09-12T02:28:30.664 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: starting mds.h at 2024-09-12T02:28:30.664 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 bash[64674]: 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 2024-09-12T02:28:30.664 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:28:30 smithi134 systemd[1]: Started Ceph mds.h for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:31.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:31.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:31.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: Deploying daemon mds.i on smithi173 2024-09-12T02:28:31.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:boot 2024-09-12T02:28:31.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: fsmap 8 up:standby 2024-09-12T02:28:31.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:31 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:31.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:31.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:31.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: Deploying daemon mds.i on smithi173 2024-09-12T02:28:31.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:boot 2024-09-12T02:28:31.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: fsmap 8 up:standby 2024-09-12T02:28:31.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:31 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:28:31.672 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:31.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:31.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: Deploying daemon mds.i on smithi173 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:boot 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: fsmap 8 up:standby 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:31 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:28:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 -- 172.21.15.1:0/107452001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc106f10 msgr2=0x7fe0dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 --2- 172.21.15.1:0/107452001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc106f10 0x7fe0dc10ea90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009ca0 tx=0x7fe0d402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 -- 172.21.15.1:0/107452001 shutdown_connections 2024-09-12T02:28:32.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 --2- 172.21.15.1:0/107452001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc106f10 0x7fe0dc10ea90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 --2- 172.21.15.1:0/107452001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc102790 0x7fe0dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 --2- 172.21.15.1:0/107452001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 -- 172.21.15.1:0/107452001 >> 172.21.15.1:0/107452001 conn(0x7fe0dc0fd8c0 msgr2=0x7fe0dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 -- 172.21.15.1:0/107452001 shutdown_connections 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.175+0000 7fe0e2438640 1 -- 172.21.15.1:0/107452001 wait complete. 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 Processor -- start 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 -- start start 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc106f10 0x7fe0dc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111f70 con 0x7fe0dc102790 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111df0 con 0x7fe0dc106f10 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0e2438640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1120f0 con 0x7fe0dc101de0 2024-09-12T02:28:32.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50268/0 (socket says 172.21.15.1:50268) 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0db7fe640 1 -- 172.21.15.1:0/601408837 learned_addr learned my addr 172.21.15.1:0/601408837 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.176+0000 7fe0dbfff640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0e09d5640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc106f10 0x7fe0dc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 -- 172.21.15.1:0/601408837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 msgr2=0x7fe0dc1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 -- 172.21.15.1:0/601408837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc106f10 msgr2=0x7fe0dc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc106f10 0x7fe0dc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 -- 172.21.15.1:0/601408837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc19d3a0 con 0x7fe0dc102790 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0dbfff640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0db7fe640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d950 tx=0x7fe0d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0017030 con 0x7fe0dc102790 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc19d690 con 0x7fe0dc102790 2024-09-12T02:28:32.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0d0004020 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00047a0 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.177+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a4f70 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.178+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc1021c0 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.179+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe0d00041d0 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.180+0000 7fe0d97fa640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 0x7fe0c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.180+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe0d00ce5d0 con 0x7fe0dc102790 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.180+0000 7fe0dbfff640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 0x7fe0c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.181+0000 7fe0dbfff640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 0x7fe0c40a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0058c0 tx=0x7fe0cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:32.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.184+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0d009b9d0 con 0x7fe0dc102790 2024-09-12T02:28:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.400+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0dc02d7c0 con 0x7fe0dc102790 2024-09-12T02:28:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.400+0000 7fe0d97fa640 1 -- 172.21.15.1:0/601408837 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fe0d009b2d0 con 0x7fe0dc102790 2024-09-12T02:28:32.401 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:32.401 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-09-12T02:28:30:727381+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T02:28:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.402+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 msgr2=0x7fe0c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.402+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 0x7fe0c40a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0058c0 tx=0x7fe0cc005850 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.402+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 msgr2=0x7fe0dc198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.402+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d950 tx=0x7fe0d000de10 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 shutdown_connections 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe0c40a2b80 0x7fe0c40a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0dc102790 0x7fe0dc198930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc106f10 0x7fe0dc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 --2- 172.21.15.1:0/601408837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0dc101de0 0x7fe0dc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 >> 172.21.15.1:0/601408837 conn(0x7fe0dc0fd8c0 msgr2=0x7fe0dc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:32.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 shutdown_connections 2024-09-12T02:28:32.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:32.403+0000 7fe0e2438640 1 -- 172.21.15.1:0/601408837 wait complete. 2024-09-12T02:28:32.407 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 systemd[1]: Starting Ceph mds.i for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:32.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:32 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/601408837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:32 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/601408837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.697 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 podman[65322]: 2024-09-12 02:28:32.434360393 +0000 UTC m=+0.015908979 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:32.697 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 podman[65322]: 2024-09-12 02:28:32.569113645 +0000 UTC m=+0.150662224 container create e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:28:32.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:32 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/601408837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 podman[65322]: 2024-09-12 02:28:32.822404565 +0000 UTC m=+0.403953151 container init e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 podman[65322]: 2024-09-12 02:28:32.825341157 +0000 UTC m=+0.406889737 container start e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 ceph-mds[65341]: -- 172.21.15.173:0/813194745 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb075af860 con 0x55cb0758d400 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: starting mds.i at 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 bash[65322]: e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae 2024-09-12T02:28:33.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:28:32 smithi173 systemd[1]: Started Ceph mds.i for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:33.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:33 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:33.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:33 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:33.736 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:33 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:34.508 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:34 smithi001 ceph-mon[31252]: Deploying daemon mds.g on smithi001 2024-09-12T02:28:34.508 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:34 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:boot 2024-09-12T02:28:34.508 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:34 smithi001 ceph-mon[31252]: fsmap 9 up:standby 2024-09-12T02:28:34.508 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:34 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:28:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:34 smithi173 ceph-mon[35036]: Deploying daemon mds.g on smithi001 2024-09-12T02:28:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:34 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:boot 2024-09-12T02:28:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:34 smithi173 ceph-mon[35036]: fsmap 9 up:standby 2024-09-12T02:28:34.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:34 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:28:34.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:34 smithi134 ceph-mon[35091]: Deploying daemon mds.g on smithi001 2024-09-12T02:28:34.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:34 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:boot 2024-09-12T02:28:34.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:34 smithi134 ceph-mon[35091]: fsmap 9 up:standby 2024-09-12T02:28:34.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:34 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:28:35.128 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 systemd[1]: Starting Ceph mds.g for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:35.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:35.419 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 podman[69624]: 2024-09-12 02:28:35.12444857 +0000 UTC m=+0.016657397 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:35.419 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 podman[69624]: 2024-09-12 02:28:35.252983726 +0000 UTC m=+0.145192543 container create e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:28:35.653 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:35.697 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:35 smithi173 ceph-mon[35036]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:35 smithi001 ceph-mon[31252]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 podman[69624]: 2024-09-12 02:28:35.514808417 +0000 UTC m=+0.407017237 container init e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 podman[69624]: 2024-09-12 02:28:35.518028716 +0000 UTC m=+0.410237534 container start e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 ceph-mds[69689]: -- 172.21.15.1:0/3304011501 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d83354f860 con 0x55d83352c800 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: starting mds.g at 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 bash[69624]: e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 2024-09-12T02:28:35.777 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:28:35 smithi001 systemd[1]: Started Ceph mds.g for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:35.814 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:35 smithi134 ceph-mon[35091]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:36.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 -- 172.21.15.1:0/328690303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc1082a0 msgr2=0x7fb1dc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 --2- 172.21.15.1:0/328690303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc10ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009cd0 tx=0x7fb1d402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 -- 172.21.15.1:0/328690303 shutdown_connections 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 --2- 172.21.15.1:0/328690303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc10ec40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 --2- 172.21.15.1:0/328690303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 --2- 172.21.15.1:0/328690303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc102d30 0x7fb1dc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 -- 172.21.15.1:0/328690303 >> 172.21.15.1:0/328690303 conn(0x7fb1dc0fc7d0 msgr2=0x7fb1dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 -- 172.21.15.1:0/328690303 shutdown_connections 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.170+0000 7fb1e232a640 1 -- 172.21.15.1:0/328690303 wait complete. 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 Processor -- start 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 -- start start 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc112100 con 0x7fb1dc102d30 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc111f80 con 0x7fb1dc1082a0 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e232a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc112280 con 0x7fb1dc1036e0 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50290/0 (socket says 172.21.15.1:50290) 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1dbfff640 1 -- 172.21.15.1:0/3698446994 learned_addr learned my addr 172.21.15.1:0/3698446994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1e08c7640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.171+0000 7fb1db7fe640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 -- 172.21.15.1:0/3698446994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 msgr2=0x7fb1dc198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 -- 172.21.15.1:0/3698446994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1082a0 msgr2=0x7fb1dc19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 -- 172.21.15.1:0/3698446994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc19d580 con 0x7fb1dc102d30 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1db7fe640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1dbfff640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b4a0 tx=0x7fb1cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014070 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc19d870 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc010af0 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc017d10 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.172+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1a5150 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.173+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc06a850 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.174+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb1cc017070 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.175+0000 7fb1d97fa640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 0x7fb1c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.175+0000 7fb1db7fe640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 0x7fb1c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.175+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb1cc0cdf70 con 0x7fb1dc102d30 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.176+0000 7fb1db7fe640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 0x7fb1c40a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0fede0 tx=0x7fb1d0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.180+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1cc09b370 con 0x7fb1dc102d30 2024-09-12T02:28:36.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.393+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1dc103110 con 0x7fb1dc102d30 2024-09-12T02:28:36.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.394+0000 7fb1d97fa640 1 -- 172.21.15.1:0/3698446994 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8037 (secure 0 0 0) 0x7fb1cc09ac70 con 0x7fb1dc102d30 2024-09-12T02:28:36.394 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:36.395 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"btime":"2024-09-12T02:28:33:407508+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:28:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 10 2024-09-12T02:28:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 msgr2=0x7fb1c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 0x7fb1c40a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0fede0 tx=0x7fb1d0005e50 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 msgr2=0x7fb1dc1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b4a0 tx=0x7fb1cc00b960 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 shutdown_connections 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb1c40a2b80 0x7fb1c40a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc1082a0 0x7fb1dc19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1dc1036e0 0x7fb1dc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 --2- 172.21.15.1:0/3698446994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1dc102d30 0x7fb1dc1985d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 >> 172.21.15.1:0/3698446994 conn(0x7fb1dc0fc7d0 msgr2=0x7fb1dc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 shutdown_connections 2024-09-12T02:28:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:36.397+0000 7fb1e232a640 1 -- 172.21.15.1:0/3698446994 wait complete. 2024-09-12T02:28:36.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:36.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: Deploying daemon mds.a on smithi001 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3698446994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6838/1207631170,v1:172.21.15.1:6839/1207631170] up:boot 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: fsmap 10 up:standby 2024-09-12T02:28:36.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:36 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:36.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: Deploying daemon mds.a on smithi001 2024-09-12T02:28:36.984 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3698446994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:36.984 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6838/1207631170,v1:172.21.15.1:6839/1207631170] up:boot 2024-09-12T02:28:36.984 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: fsmap 10 up:standby 2024-09-12T02:28:36.984 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:36 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:28:37.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: Deploying daemon mds.a on smithi001 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3698446994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6838/1207631170,v1:172.21.15.1:6839/1207631170] up:boot 2024-09-12T02:28:37.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: fsmap 10 up:standby 2024-09-12T02:28:37.040 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:36 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:28:37.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:37 smithi173 ceph-mon[35036]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:38.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:37 smithi001 ceph-mon[31252]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:37 smithi134 ceph-mon[35091]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:38.744 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:38 smithi001 systemd[1]: Starting Ceph mds.a for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:28:39.021 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:38 smithi001 podman[70044]: 2024-09-12 02:28:38.773504179 +0000 UTC m=+0.017411328 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:39.021 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:38 smithi001 podman[70044]: 2024-09-12 02:28:38.894312802 +0000 UTC m=+0.138219942 container create 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 podman[70044]: 2024-09-12 02:28:39.14743955 +0000 UTC m=+0.391346690 container init 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 podman[70044]: 2024-09-12 02:28:39.15046837 +0000 UTC m=+0.394375510 container start 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mds[70064]: -- 172.21.15.1:0/1688292086 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592555fb860 con 0x5592555d9400 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: starting mds.a at 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 bash[70044]: 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f 2024-09-12T02:28:39.626 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:28:39 smithi001 systemd[1]: Started Ceph mds.a for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:39.690 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:39.954 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:40.005 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:39 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:40.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.076 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:40.077 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:40.077 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:39 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:28:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:28:40.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:39 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 -- 172.21.15.1:0/476576808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 msgr2=0x7f128410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 --2- 172.21.15.1:0/476576808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f128410bbb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1278009900 tx=0x7f127802a480 comp rx=0 tx=0).stop 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 -- 172.21.15.1:0/476576808 shutdown_connections 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 --2- 172.21.15.1:0/476576808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f128410bbb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 --2- 172.21.15.1:0/476576808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f128410c180 0x7f128410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 --2- 172.21.15.1:0/476576808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1284102da0 0x7f1284103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 -- 172.21.15.1:0/476576808 >> 172.21.15.1:0/476576808 conn(0x7f12840fc7a0 msgr2=0x7f12840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 -- 172.21.15.1:0/476576808 shutdown_connections 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.468+0000 7f12888ec640 1 -- 172.21.15.1:0/476576808 wait complete. 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 Processor -- start 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 -- start start 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1284102da0 0x7f1284198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 0x7f128419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111f60 con 0x7f12841036c0 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111de0 con 0x7f128410c180 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f12888ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12841120e0 con 0x7f1284102da0 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50324/0 (socket says 172.21.15.1:50324) 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f1281d9b640 1 -- 172.21.15.1:0/3756021067 learned_addr learned my addr 172.21.15.1:0/3756021067 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f128259c640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1284102da0 0x7f1284198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.469+0000 7f1282d9d640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 0x7f128419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 -- 172.21.15.1:0/3756021067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1284102da0 msgr2=0x7f1284198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1284102da0 0x7f1284198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 -- 172.21.15.1:0/3756021067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 msgr2=0x7f128419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 0x7f128419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 -- 172.21.15.1:0/3756021067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128419d440 con 0x7f12841036c0 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1282d9d640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 0x7f128419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f1281d9b640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1278006010 tx=0x7f12780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127803f030 con 0x7f12841036c0 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128419d6d0 con 0x7f12841036c0 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1278003ce0 con 0x7f12841036c0 2024-09-12T02:28:40.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278035070 con 0x7f12841036c0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.470+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841a5010 con 0x7f12841036c0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.471+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1284103180 con 0x7f12841036c0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.472+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1278042030 con 0x7f12841036c0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.473+0000 7f12737fe640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 0x7f126c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.473+0000 7f128259c640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 0x7f126c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.473+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f12780ef180 con 0x7f12841036c0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.473+0000 7f128259c640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 0x7f126c0a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1274009bd0 tx=0x7f1274005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:40.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.477+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12780bc640 con 0x7f12841036c0 2024-09-12T02:28:40.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.689+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12841071c0 con 0x7f12841036c0 2024-09-12T02:28:40.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.690+0000 7f12737fe640 1 -- 172.21.15.1:0/3756021067 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7f12780bbf40 con 0x7f12841036c0 2024-09-12T02:28:40.690 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:40.690 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-09-12T02:28:39:691502+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:28:40.691 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-09-12T02:28:40.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 msgr2=0x7f126c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 0x7f126c0a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1274009bd0 tx=0x7f1274005f90 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 msgr2=0x7f12841989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1278006010 tx=0x7f12780042f0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 shutdown_connections 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f126c0a2b80 0x7f126c0a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12841036c0 0x7f12841989d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f128410c180 0x7f128419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 --2- 172.21.15.1:0/3756021067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1284102da0 0x7f1284198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 >> 172.21.15.1:0/3756021067 conn(0x7f12840fc7a0 msgr2=0x7f12840fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 shutdown_connections 2024-09-12T02:28:40.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:40.692+0000 7f12888ec640 1 -- 172.21.15.1:0/3756021067 wait complete. 2024-09-12T02:28:40.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:40 smithi134 ceph-mon[35091]: Deploying daemon mds.b on smithi134 2024-09-12T02:28:40.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:40 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6840/2292917282,v1:172.21.15.1:6841/2292917282] up:boot 2024-09-12T02:28:40.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:40 smithi134 ceph-mon[35091]: fsmap 11 up:standby 2024-09-12T02:28:40.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:40 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:28:40.994 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:40 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3756021067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:41.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:40 smithi001 ceph-mon[31252]: Deploying daemon mds.b on smithi134 2024-09-12T02:28:41.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:40 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6840/2292917282,v1:172.21.15.1:6841/2292917282] up:boot 2024-09-12T02:28:41.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:40 smithi001 ceph-mon[31252]: fsmap 11 up:standby 2024-09-12T02:28:41.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:40 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:28:41.105 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:40 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3756021067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:40 smithi173 ceph-mon[35036]: Deploying daemon mds.b on smithi134 2024-09-12T02:28:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:40 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6840/2292917282,v1:172.21.15.1:6841/2292917282] up:boot 2024-09-12T02:28:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:40 smithi173 ceph-mon[35036]: fsmap 11 up:standby 2024-09-12T02:28:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:40 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:28:41.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:40 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3756021067' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:41.703 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:41 smithi134 podman[64987]: 2024-09-12 02:28:41.663334983 +0000 UTC m=+0.127601736 container create d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:28:42.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:41 smithi134 ceph-mon[35091]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:42.023 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:41 smithi134 podman[64987]: 2024-09-12 02:28:41.922944283 +0000 UTC m=+0.387210978 container init d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:28:42.023 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:41 smithi134 podman[64987]: 2024-09-12 02:28:41.925867074 +0000 UTC m=+0.390133777 container start d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:28:42.023 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:41 smithi134 ceph-mds[65006]: -- 172.21.15.134:0/491147997 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dff44d5860 con 0x55dff44b2800 2024-09-12T02:28:42.023 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: starting mds.b at 2024-09-12T02:28:42.023 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:42 smithi134 bash[64987]: d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 2024-09-12T02:28:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:41 smithi001 ceph-mon[31252]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:41 smithi173 ceph-mon[35036]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:42.413 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:42 smithi134 systemd[1]: Started Ceph mds.b for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:43.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:boot 2024-09-12T02:28:43.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: fsmap 12 up:standby 2024-09-12T02:28:43.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:43 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:boot 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: fsmap 12 up:standby 2024-09-12T02:28:43.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:43 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:43.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:43.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:boot 2024-09-12T02:28:43.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: fsmap 12 up:standby 2024-09-12T02:28:43.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:43 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:28:43.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:28:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 -- 172.21.15.1:0/3277362397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8103780 msgr2=0x7f4bf8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 --2- 172.21.15.1:0/3277362397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8103780 0x7f4bf8107bc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009930 tx=0x7f4bec02a420 comp rx=0 tx=0).stop 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 -- 172.21.15.1:0/3277362397 shutdown_connections 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 --2- 172.21.15.1:0/3277362397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8103780 0x7f4bf8107bc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 --2- 172.21.15.1:0/3277362397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8108300 0x7f4bf810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 --2- 172.21.15.1:0/3277362397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8102dd0 0x7f4bf81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 -- 172.21.15.1:0/3277362397 >> 172.21.15.1:0/3277362397 conn(0x7f4bf80fc7d0 msgr2=0x7f4bf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 -- 172.21.15.1:0/3277362397 shutdown_connections 2024-09-12T02:28:44.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.236+0000 7f4bfe823640 1 -- 172.21.15.1:0/3277362397 wait complete. 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 Processor -- start 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 -- start start 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8103780 0x7f4bf8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8108300 0x7f4bf81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8112050 con 0x7f4bf8102dd0 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf8111ed0 con 0x7f4bf8103780 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bfe823640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf81121d0 con 0x7f4bf8108300 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bf7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bf7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47092/0 (socket says 172.21.15.1:47092) 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.237+0000 7f4bf7fff640 1 -- 172.21.15.1:0/1815453137 learned_addr learned my addr 172.21.15.1:0/1815453137 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf77fe640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8103780 0x7f4bf8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bfcdc0640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8108300 0x7f4bf81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 -- 172.21.15.1:0/1815453137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8108300 msgr2=0x7f4bf81014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8108300 0x7f4bf81014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 -- 172.21.15.1:0/1815453137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8103780 msgr2=0x7f4bf8100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8103780 0x7f4bf8100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 -- 172.21.15.1:0/1815453137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf81a6ab0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf7fff640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4be800ea60 tx=0x7f4be800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be800cd20 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be80035f0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf81a6da0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8010690 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.238+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81a7250 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.240+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf81031b0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.241+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4be80037a0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.241+0000 7f4bf57fa640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 0x7f4be00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:44.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.242+0000 7f4bf77fe640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 0x7f4be00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.242+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4be80cedf0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.242+0000 7f4bf77fe640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 0x7f4be00a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4bec005940 tx=0x7f4bec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:44.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.246+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4be809c1f0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.471+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bf810a290 con 0x7f4bf8102dd0 2024-09-12T02:28:44.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.472+0000 7f4bf57fa640 1 -- 172.21.15.1:0/1815453137 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f4be809baf0 con 0x7f4bf8102dd0 2024-09-12T02:28:44.472 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:44.473 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-12T02:28:42:702888+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:28:44.473 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-12T02:28:44.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 msgr2=0x7f4be00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 0x7f4be00a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4bec005940 tx=0x7f4bec0058d0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 msgr2=0x7f4bf8100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:44.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4be800ea60 tx=0x7f4be800ee60 comp rx=0 tx=0).stop 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 shutdown_connections 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4be00a2c00 0x7f4be00a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4bf8108300 0x7f4bf81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf8103780 0x7f4bf8100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 --2- 172.21.15.1:0/1815453137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bf8102dd0 0x7f4bf8100a30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 >> 172.21.15.1:0/1815453137 conn(0x7f4bf80fc7d0 msgr2=0x7f4bf8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 shutdown_connections 2024-09-12T02:28:44.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:44.474+0000 7f4bfe823640 1 -- 172.21.15.1:0/1815453137 wait complete. 2024-09-12T02:28:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:44.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:44 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1815453137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:44.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:44.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:44.950 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:44 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1815453137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:45.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.022 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:45.023 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:44 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1815453137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:28:45.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:28:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:45 smithi001 ceph-mon[31252]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:45 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:45 smithi173 ceph-mon[35036]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:45 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:45 smithi134 ceph-mon[35091]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:45 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 -- 172.21.15.1:0/1859760570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190101420 msgr2=0x7f119010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 --2- 172.21.15.1:0/1859760570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190101420 0x7f119010d950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1188009930 tx=0x7f118802a420 comp rx=0 tx=0).stop 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 -- 172.21.15.1:0/1859760570 shutdown_connections 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 --2- 172.21.15.1:0/1859760570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190101420 0x7f119010d950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 --2- 172.21.15.1:0/1859760570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 --2- 172.21.15.1:0/1859760570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190106a80 0x7f1190106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 -- 172.21.15.1:0/1859760570 >> 172.21.15.1:0/1859760570 conn(0x7f11900fc7a0 msgr2=0x7f11900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 -- 172.21.15.1:0/1859760570 shutdown_connections 2024-09-12T02:28:46.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.369+0000 7f1195a42640 1 -- 172.21.15.1:0/1859760570 wait complete. 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 Processor -- start 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 -- start start 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190101420 0x7f1190198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1190110e80 con 0x7f1190106a80 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1190110d00 con 0x7f1190100a80 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f1195a42640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1190111000 con 0x7f1190101420 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47110/0 (socket says 172.21.15.1:47110) 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 -- 172.21.15.1:0/3351824095 learned_addr learned my addr 172.21.15.1:0/3351824095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118e7fc640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190101420 0x7f1190198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118effd640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 -- 172.21.15.1:0/3351824095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190101420 msgr2=0x7f1190198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190101420 0x7f1190198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 -- 172.21.15.1:0/3351824095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 msgr2=0x7f1190198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118f7fe640 1 -- 172.21.15.1:0/3351824095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119019d300 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.370+0000 7f118effd640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f118f7fe640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1188005ab0 tx=0x7f11880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118803f030 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1188003ce0 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119019d590 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188035070 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.371+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11901a4ed0 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.372+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11901021c0 con 0x7f1190106a80 2024-09-12T02:28:46.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.373+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1188042030 con 0x7f1190106a80 2024-09-12T02:28:46.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.374+0000 7f1194a40640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 0x7f11780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:46.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.374+0000 7f118effd640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 0x7f11780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:46.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.374+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f11880ef4c0 con 0x7f1190106a80 2024-09-12T02:28:46.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.374+0000 7f118effd640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 0x7f11780a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1180007350 tx=0x7f11800072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:46.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.378+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11880bc8c0 con 0x7f1190106a80 2024-09-12T02:28:46.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.570+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f119010a000 con 0x7f1190106a80 2024-09-12T02:28:46.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.571+0000 7f1194a40640 1 -- 172.21.15.1:0/3351824095 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f11880bc1c0 con 0x7f1190106a80 2024-09-12T02:28:46.571 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:46.571 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-12T02:28:46.571 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:28:46.571 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-12T02:28:46.572 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-12T02:28:46.572 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:28:46.572 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-12T02:28:46.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 msgr2=0x7f11780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 0x7f11780a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1180007350 tx=0x7f11800072e0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 msgr2=0x7f119019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1188005ab0 tx=0x7f11880042f0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 shutdown_connections 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11780a2b80 0x7f11780a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1190106a80 0x7f119019cc20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1190101420 0x7f1190198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 --2- 172.21.15.1:0/3351824095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1190100a80 0x7f1190198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 >> 172.21.15.1:0/3351824095 conn(0x7f11900fc7a0 msgr2=0x7f119006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 shutdown_connections 2024-09-12T02:28:46.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:46.573+0000 7f1195a42640 1 -- 172.21.15.1:0/3351824095 wait complete. 2024-09-12T02:28:46.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:46 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:46 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3351824095' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:28:46.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:46 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:46.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:46 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3351824095' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:28:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:46 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:46 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3351824095' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:28:47.337 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:28:47.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:28:47.625 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:47.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:47 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:47.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:47 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:47 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:28:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 -- 172.21.15.1:0/3721163614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1036e0 msgr2=0x7f148c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 --2- 172.21.15.1:0/3721163614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1036e0 0x7f148c107b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f147c009930 tx=0x7f147c02a420 comp rx=0 tx=0).stop 2024-09-12T02:28:48.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 -- 172.21.15.1:0/3721163614 shutdown_connections 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 --2- 172.21.15.1:0/3721163614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1036e0 0x7f148c107b90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 --2- 172.21.15.1:0/3721163614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c1082a0 0x7f148c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 --2- 172.21.15.1:0/3721163614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c102d30 0x7f148c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 -- 172.21.15.1:0/3721163614 >> 172.21.15.1:0/3721163614 conn(0x7f148c0fc7d0 msgr2=0x7f148c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 -- 172.21.15.1:0/3721163614 shutdown_connections 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.174+0000 7f1494112640 1 -- 172.21.15.1:0/3721163614 wait complete. 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 Processor -- start 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 -- start start 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 0x7f148c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 0x7f148c198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1120a0 con 0x7f148c1082a0 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f148c111f20 con 0x7f148c102d30 2024-09-12T02:28:48.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1494112640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112220 con 0x7f148c1036e0 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47136/0 (socket says 172.21.15.1:47136) 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 -- 172.21.15.1:0/2116760927 learned_addr learned my addr 172.21.15.1:0/2116760927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1491eae640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 0x7f148c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14916ad640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 0x7f148c198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 -- 172.21.15.1:0/2116760927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 msgr2=0x7f148c198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 0x7f148c198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 -- 172.21.15.1:0/2116760927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 msgr2=0x7f148c198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 0x7f148c198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14926af640 1 -- 172.21.15.1:0/2116760927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c19d610 con 0x7f148c1082a0 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f1491eae640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 0x7f148c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.175+0000 7f14916ad640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 0x7f148c198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:48.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f14926af640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f148400eb10 tx=0x7f148400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484004b20 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c19d900 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1484004cc0 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484010760 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.176+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c1a51e0 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.177+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148c103110 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.178+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1484005020 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.179+0000 7f1482ffd640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 0x7f14780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.179+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f14840cf240 con 0x7f148c1082a0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.179+0000 7f1491eae640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 0x7f14780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.179+0000 7f1491eae640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 0x7f14780a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1488009b40 tx=0x7f1488005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.183+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f148409c640 con 0x7f148c1082a0 2024-09-12T02:28:48.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.361+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f148c10a2b0 con 0x7f148c1082a0 2024-09-12T02:28:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.845+0000 7f1482ffd640 1 -- 172.21.15.1:0/2116760927 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f148409bf40 con 0x7f148c1082a0 2024-09-12T02:28:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.848+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 msgr2=0x7f14780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.848+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 0x7f14780a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1488009b40 tx=0x7f1488005e50 comp rx=0 tx=0).stop 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.848+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 msgr2=0x7f148c19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.848+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f148400eb10 tx=0x7f148400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 shutdown_connections 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14780a2b80 0x7f14780a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f148c1082a0 0x7f148c19cf30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f148c1036e0 0x7f148c198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 --2- 172.21.15.1:0/2116760927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f148c102d30 0x7f148c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 >> 172.21.15.1:0/2116760927 conn(0x7f148c0fc7d0 msgr2=0x7f148c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 shutdown_connections 2024-09-12T02:28:48.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:48.849+0000 7f1494112640 1 -- 172.21.15.1:0/2116760927 wait complete. 2024-09-12T02:28:49.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:28:49.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:48 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:28:49.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:48 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:28:49.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:28:49.820 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:50.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:49 smithi001 ceph-mon[31252]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:50.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:28:50.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:49 smithi001 ceph-mon[31252]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:28:50.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:49 smithi001 ceph-mon[31252]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:28:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:49 smithi134 ceph-mon[35091]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:49 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:28:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:49 smithi134 ceph-mon[35091]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:28:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:49 smithi134 ceph-mon[35091]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:28:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:49 smithi173 ceph-mon[35036]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:49 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2116760927' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:28:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:49 smithi173 ceph-mon[35036]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T02:28:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:49 smithi173 ceph-mon[35036]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1711046769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 msgr2=0x7fe15810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1711046769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe15810bb50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009900 tx=0x7fe14c02a480 comp rx=0 tx=0).stop 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1711046769 shutdown_connections 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1711046769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe15810bb50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1711046769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe15810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1711046769 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 0x7fe158103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1711046769 >> 172.21.15.1:0/1711046769 conn(0x7fe1580fc7a0 msgr2=0x7fe1580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1711046769 shutdown_connections 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.339+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1711046769 wait complete. 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 Processor -- start 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 -- start start 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 0x7fe1581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe158101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe158111f70 con 0x7fe158103660 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe158111df0 con 0x7fe15810c170 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15c8f0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1581120f0 con 0x7fe158102d40 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47152/0 (socket says 172.21.15.1:47152) 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 -- 172.21.15.1:0/1438395172 learned_addr learned my addr 172.21.15.1:0/1438395172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 -- 172.21.15.1:0/1438395172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 msgr2=0x7fe1581009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe15659c640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 0x7fe1581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe156d9d640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe158101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 0x7fe1581009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 -- 172.21.15.1:0/1438395172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 msgr2=0x7fe158101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe158101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe155d9b640 1 -- 172.21.15.1:0/1438395172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1581a68f0 con 0x7fe158103660 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.340+0000 7fe156d9d640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe158101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe155d9b640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe14c006010 tx=0x7fe14c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c03f030 con 0x7fe158103660 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe14c004440 con 0x7fe158103660 2024-09-12T02:28:50.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1581a6b80 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c035070 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.341+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1581a70b0 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.342+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe158103120 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.343+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe14c042030 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.344+0000 7fe1477fe640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 0x7fe1400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.344+0000 7fe15659c640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 0x7fe1400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.344+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fe14c0ef370 con 0x7fe158103660 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.344+0000 7fe15659c640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 0x7fe1400a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe148009aa0 tx=0x7fe148005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:50.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.347+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe14c0bc6c0 con 0x7fe158103660 2024-09-12T02:28:50.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.523+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe158101ed0 con 0x7fe158103660 2024-09-12T02:28:50.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.960+0000 7fe1477fe640 1 -- 172.21.15.1:0/1438395172 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fe158101ed0 con 0x7fe158103660 2024-09-12T02:28:50.960 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.962+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 msgr2=0x7fe1400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.962+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 0x7fe1400a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe148009aa0 tx=0x7fe148005f90 comp rx=0 tx=0).stop 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.962+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 msgr2=0x7fe158100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.962+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe14c006010 tx=0x7fe14c004040 comp rx=0 tx=0).stop 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 shutdown_connections 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe1400a2c00 0x7fe1400a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe158103660 0x7fe158100ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe15810c170 0x7fe158101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 --2- 172.21.15.1:0/1438395172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe158102d40 0x7fe1581009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 >> 172.21.15.1:0/1438395172 conn(0x7fe1580fc7a0 msgr2=0x7fe1580fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 shutdown_connections 2024-09-12T02:28:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:50.963+0000 7fe15c8f0640 1 -- 172.21.15.1:0/1438395172 wait complete. 2024-09-12T02:28:51.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:51 smithi001 ceph-mon[31252]: pgmap v275: 33 pgs: 6 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:51.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:51 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:28:51.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:51 smithi001 ceph-mon[31252]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:28:51.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:51 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:28:51.361 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:51 smithi001 ceph-mon[31252]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:28:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:51 smithi134 ceph-mon[35091]: pgmap v275: 33 pgs: 6 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:51 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:28:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:51 smithi134 ceph-mon[35091]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:28:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:51 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:28:51.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:51 smithi134 ceph-mon[35091]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:28:51.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:51 smithi173 ceph-mon[35036]: pgmap v275: 33 pgs: 6 creating+peering, 23 unknown, 4 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:51.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:51 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:28:51.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:51 smithi173 ceph-mon[35036]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:28:51.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:51 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1438395172' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:28:51.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:51 smithi173 ceph-mon[35036]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:28:51.728 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:28:52.003 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:52.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- 172.21.15.1:0/287400576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 msgr2=0x7f865410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 --2- 172.21.15.1:0/287400576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865410e610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f864c009ca0 tx=0x7f864c02a950 comp rx=0 tx=0).stop 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- 172.21.15.1:0/287400576 shutdown_connections 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 --2- 172.21.15.1:0/287400576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865410e610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 --2- 172.21.15.1:0/287400576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654103660 0x7f865410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 --2- 172.21.15.1:0/287400576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654102d40 0x7f8654103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- 172.21.15.1:0/287400576 >> 172.21.15.1:0/287400576 conn(0x7f86540fc7a0 msgr2=0x7f86540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- 172.21.15.1:0/287400576 shutdown_connections 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- 172.21.15.1:0/287400576 wait complete. 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 Processor -- start 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.527+0000 7f865c1cd640 1 -- start start 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654102d40 0x7f8654198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654103660 0x7f8654198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8654111f70 con 0x7f865410c170 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8654111df0 con 0x7f8654102d40 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865c1cd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86541120f0 con 0x7f8654103660 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46662/0 (socket says 172.21.15.1:46662) 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 -- 172.21.15.1:0/2730450120 learned_addr learned my addr 172.21.15.1:0/2730450120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f8659768640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654103660 0x7f8654198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f8659f69640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654102d40 0x7f8654198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 -- 172.21.15.1:0/2730450120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654103660 msgr2=0x7f8654198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654103660 0x7f8654198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 -- 172.21.15.1:0/2730450120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654102d40 msgr2=0x7f8654198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:52.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654102d40 0x7f8654198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 -- 172.21.15.1:0/2730450120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865419d3c0 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f865a76a640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f864c02ae70 tx=0x7f864c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c034040 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.528+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864c030920 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.529+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865419d650 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.529+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c045480 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.529+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86541a4f90 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.529+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865406b070 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.531+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f864c037020 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.531+0000 7f864affd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 0x7f86400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.532+0000 7f8659f69640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 0x7f86400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.532+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f864c0eff20 con 0x7f865410c170 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.532+0000 7f8659f69640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 0x7f86400a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f865000cac0 tx=0x7f865000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.535+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f864c0811b0 con 0x7f865410c170 2024-09-12T02:28:52.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:52.746+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86541a51d0 con 0x7f865410c170 2024-09-12T02:28:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:52 smithi001 ceph-mon[31252]: pgmap v277: 97 pgs: 10 creating+peering, 69 unknown, 18 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:52 smithi001 ceph-mon[31252]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:28:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:52 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:28:53.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:52 smithi001 ceph-mon[31252]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:28:53.314 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:52 smithi134 ceph-mon[35091]: pgmap v277: 97 pgs: 10 creating+peering, 69 unknown, 18 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:53.314 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:52 smithi134 ceph-mon[35091]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:28:53.314 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:52 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:28:53.314 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:52 smithi134 ceph-mon[35091]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:28:53.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:52 smithi173 ceph-mon[35036]: pgmap v277: 97 pgs: 10 creating+peering, 69 unknown, 18 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:28:53.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:52 smithi173 ceph-mon[35036]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:28:53.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:52 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:28:53.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:52 smithi173 ceph-mon[35036]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:28:53.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.471+0000 7f864affd640 1 -- 172.21.15.1:0/2730450120 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f864c0bd030 con 0x7f865410c170 2024-09-12T02:28:53.471 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:28:53.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 msgr2=0x7f86400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 0x7f86400a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f865000cac0 tx=0x7f865000c4a0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 msgr2=0x7f865419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:53.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f864c02ae70 tx=0x7f864c02f5b0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 shutdown_connections 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f86400a2c00 0x7f86400a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f865410c170 0x7f865419cce0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8654103660 0x7f8654198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 --2- 172.21.15.1:0/2730450120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8654102d40 0x7f8654198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 >> 172.21.15.1:0/2730450120 conn(0x7f86540fc7a0 msgr2=0x7f86540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:53.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 shutdown_connections 2024-09-12T02:28:53.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:53.474+0000 7f865c1cd640 1 -- 172.21.15.1:0/2730450120 wait complete. 2024-09-12T02:28:54.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:53 smithi001 ceph-mon[31252]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:28:54.263 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:53 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:28:54.263 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:53 smithi001 ceph-mon[31252]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:28:54.263 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:53 smithi001 ceph-mon[31252]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:28:54.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:28:54.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:53 smithi134 ceph-mon[35091]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:28:54.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:53 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:28:54.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:53 smithi134 ceph-mon[35091]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:28:54.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:53 smithi134 ceph-mon[35091]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:28:54.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:53 smithi173 ceph-mon[35036]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:28:54.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:53 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2730450120' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:28:54.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:53 smithi173 ceph-mon[35036]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:28:54.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:53 smithi173 ceph-mon[35036]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:28:54.561 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:55.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 -- 172.21.15.1:0/1888290575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 msgr2=0x7faef4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 --2- 172.21.15.1:0/1888290575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef4101200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faef0009900 tx=0x7faef002a480 comp rx=0 tx=0).stop 2024-09-12T02:28:55.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 -- 172.21.15.1:0/1888290575 shutdown_connections 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 --2- 172.21.15.1:0/1888290575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 0x7faef410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 --2- 172.21.15.1:0/1888290575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102570 0x7faef41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 --2- 172.21.15.1:0/1888290575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef4101200 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 -- 172.21.15.1:0/1888290575 >> 172.21.15.1:0/1888290575 conn(0x7faef40fc7d0 msgr2=0x7faef40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 -- 172.21.15.1:0/1888290575 shutdown_connections 2024-09-12T02:28:55.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 -- 172.21.15.1:0/1888290575 wait complete. 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.049+0000 7faefbffc640 1 Processor -- start 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 -- start start 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 0x7faef4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102ef0 0x7faef41a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faef4110f80 con 0x7faef4100e20 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faef4110e00 con 0x7faef4102ef0 2024-09-12T02:28:55.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefbffc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faef4111100 con 0x7faef4102570 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46670/0 (socket says 172.21.15.1:46670) 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 -- 172.21.15.1:0/1690257802 learned_addr learned my addr 172.21.15.1:0/1690257802 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9597640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 0x7faef4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 -- 172.21.15.1:0/1690257802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 msgr2=0x7faef4199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faefa599640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102ef0 0x7faef41a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 0x7faef4199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 -- 172.21.15.1:0/1690257802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102ef0 msgr2=0x7faef41a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102ef0 0x7faef41a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 -- 172.21.15.1:0/1690257802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef41a4990 con 0x7faef4100e20 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.050+0000 7faef9d98640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faef0006010 tx=0x7faef0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.051+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef003f070 con 0x7faef4100e20 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.051+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef41a4b60 con 0x7faef4100e20 2024-09-12T02:28:55.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.051+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef0031c30 con 0x7faef4100e20 2024-09-12T02:28:55.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.051+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0035030 con 0x7faef4100e20 2024-09-12T02:28:55.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.051+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41a4fb0 con 0x7faef4100e20 2024-09-12T02:28:55.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.052+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef4101200 con 0x7faef4100e20 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.053+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7faef0042070 con 0x7faef4100e20 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.054+0000 7faeeaffd640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 0x7faee00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.054+0000 7faef9597640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 0x7faee00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.054+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7faef00efb40 con 0x7faef4100e20 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.054+0000 7faef9597640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 0x7faee00a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faef406aac0 tx=0x7faee400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:55.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.057+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faef0031de0 con 0x7faef4100e20 2024-09-12T02:28:55.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.231+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faef4109090 con 0x7faef4100e20 2024-09-12T02:28:55.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: pgmap v280: 97 pgs: 10 creating+peering, 44 unknown, 43 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 0 op/s 2024-09-12T02:28:55.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:28:55.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: Cluster is now healthy 2024-09-12T02:28:55.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:active 2024-09-12T02:28:55.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:54 smithi001 ceph-mon[31252]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.233+0000 7faeeaffd640 1 -- 172.21.15.1:0/1690257802 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22231 (secure 0 0 0) 0x7faef00bcbf0 con 0x7faef4100e20 2024-09-12T02:28:55.234 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:55.234 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:52.748131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 msgr2=0x7faee00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 0x7faee00a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faef406aac0 tx=0x7faee400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 msgr2=0x7faef41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faef0006010 tx=0x7faef0003c10 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 shutdown_connections 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee00a2b80 0x7faee00a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4102ef0 0x7faef41a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 0x7faef4199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 --2- 172.21.15.1:0/1690257802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4100e20 0x7faef41993d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 >> 172.21.15.1:0/1690257802 conn(0x7faef40fc7d0 msgr2=0x7faef40fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:55.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 shutdown_connections 2024-09-12T02:28:55.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:55.235+0000 7faefbffc640 1 -- 172.21.15.1:0/1690257802 wait complete. 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: pgmap v280: 97 pgs: 10 creating+peering, 44 unknown, 43 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 0 op/s 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: Cluster is now healthy 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:active 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:54 smithi134 ceph-mon[35091]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: pgmap v280: 97 pgs: 10 creating+peering, 44 unknown, 43 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 0 op/s 2024-09-12T02:28:55.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:28:55.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: Cluster is now healthy 2024-09-12T02:28:55.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] up:active 2024-09-12T02:28:55.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:54 smithi173 ceph-mon[35036]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:28:55.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:28:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:56.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:55 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1690257802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:56.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:55 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1690257802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:56.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:55 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1690257802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:56.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 -- 172.21.15.1:0/3210587811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 msgr2=0x7f51a410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 --2- 172.21.15.1:0/3210587811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a410da40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f519c009ca0 tx=0x7f519c02a950 comp rx=0 tx=0).stop 2024-09-12T02:28:56.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 -- 172.21.15.1:0/3210587811 shutdown_connections 2024-09-12T02:28:56.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 --2- 172.21.15.1:0/3210587811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a410da40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 --2- 172.21.15.1:0/3210587811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 --2- 172.21.15.1:0/3210587811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 -- 172.21.15.1:0/3210587811 >> 172.21.15.1:0/3210587811 conn(0x7f51a40fc7d0 msgr2=0x7f51a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 -- 172.21.15.1:0/3210587811 shutdown_connections 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.715+0000 7f51ab656640 1 -- 172.21.15.1:0/3210587811 wait complete. 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 Processor -- start 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 -- start start 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4110ff0 con 0x7f51a4102ef0 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4110e70 con 0x7f51a4100e20 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51ab656640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4111170 con 0x7f51a4102570 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46684/0 (socket says 172.21.15.1:46684) 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 -- 172.21.15.1:0/2360697597 learned_addr learned my addr 172.21.15.1:0/2360697597 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:56.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a93f2640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a8bf1640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 -- 172.21.15.1:0/2360697597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 msgr2=0x7f51a4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 -- 172.21.15.1:0/2360697597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 msgr2=0x7f51a4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a9bf3640 1 -- 172.21.15.1:0/2360697597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a419d4b0 con 0x7f51a4102ef0 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a93f2640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.716+0000 7f51a8bf1640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:28:56.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f51a9bf3640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f519c0098d0 tx=0x7f519c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c034040 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f519c02fe10 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c039450 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a419d740 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.717+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41a5080 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.718+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a4101200 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.719+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f519c037020 con 0x7f51a4102ef0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.720+0000 7f519a7fc640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 0x7f51900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.720+0000 7f51a93f2640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 0x7f51900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.720+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f519c0effe0 con 0x7f51a4102ef0 2024-09-12T02:28:56.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.720+0000 7f51a93f2640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 0x7f51900a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51a00058c0 tx=0x7f51a0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.724+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f519c0bd090 con 0x7f51a4102ef0 2024-09-12T02:28:56.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.900+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51a410a0a0 con 0x7f51a4102ef0 2024-09-12T02:28:56.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.902+0000 7f519a7fc640 1 -- 172.21.15.1:0/2360697597 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22231 (secure 0 0 0) 0x7f519c0bc990 con 0x7f51a4102ef0 2024-09-12T02:28:56.902 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:28:56.903 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:52.748131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:28:56.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 msgr2=0x7f51900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 0x7f51900a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51a00058c0 tx=0x7f51a0005ec0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 msgr2=0x7f51a419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f519c0098d0 tx=0x7f519c003f10 comp rx=0 tx=0).stop 2024-09-12T02:28:56.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 shutdown_connections 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f51900a2c00 0x7f51900a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f51a4102ef0 0x7f51a419cdd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51a4102570 0x7f51a4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 --2- 172.21.15.1:0/2360697597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51a4100e20 0x7f51a4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 >> 172.21.15.1:0/2360697597 conn(0x7f51a40fc7d0 msgr2=0x7f51a406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 shutdown_connections 2024-09-12T02:28:56.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:56.904+0000 7f51ab656640 1 -- 172.21.15.1:0/2360697597 wait complete. 2024-09-12T02:28:57.359 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:56 smithi001 ceph-mon[31252]: pgmap v281: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-12T02:28:57.359 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:56 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2360697597' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:57.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:56 smithi134 ceph-mon[35091]: pgmap v281: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-12T02:28:57.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:56 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2360697597' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:57.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:56 smithi173 ceph-mon[35036]: pgmap v281: 97 pgs: 4 creating+peering, 93 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-12T02:28:57.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:56 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2360697597' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:28:57.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:28:57.812 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:58.163 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:28:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: 2024-09-12T02:28:57.712+0000 7f3860a9b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 -- 172.21.15.1:0/3871218973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 msgr2=0x7f83f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 --2- 172.21.15.1:0/3871218973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f010ea90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009ca0 tx=0x7f83e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 -- 172.21.15.1:0/3871218973 shutdown_connections 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 --2- 172.21.15.1:0/3871218973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f010ea90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 --2- 172.21.15.1:0/3871218973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0102790 0x7f83f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 --2- 172.21.15.1:0/3871218973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0101de0 0x7f83f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 -- 172.21.15.1:0/3871218973 >> 172.21.15.1:0/3871218973 conn(0x7f83f00fd8c0 msgr2=0x7f83f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 -- 172.21.15.1:0/3871218973 shutdown_connections 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.319+0000 7f83f674b640 1 -- 172.21.15.1:0/3871218973 wait complete. 2024-09-12T02:28:58.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 Processor -- start 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 -- start start 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0101de0 0x7f83f01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102790 0x7f83f0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0111f70 con 0x7f83f0106f10 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0111df0 con 0x7f83f0101de0 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f674b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f83f01120f0 con 0x7f83f0102790 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f4ce8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.320+0000 7f83f4ce8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46696/0 (socket says 172.21.15.1:46696) 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 -- 172.21.15.1:0/674152618 learned_addr learned my addr 172.21.15.1:0/674152618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:28:58.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83ef7fe640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102790 0x7f83f0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83effff640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0101de0 0x7f83f01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 -- 172.21.15.1:0/674152618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102790 msgr2=0x7f83f0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102790 0x7f83f0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 -- 172.21.15.1:0/674152618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0101de0 msgr2=0x7f83f01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0101de0 0x7f83f01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 -- 172.21.15.1:0/674152618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f019d3a0 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f4ce8640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83e8031a20 tx=0x7f83e8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8003c30 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e8003dd0 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f019d630 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e802fcf0 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.321+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f01a4f70 con 0x7f83f0106f10 2024-09-12T02:28:58.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.322+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f01021c0 con 0x7f83f0106f10 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.323+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f83e8004050 con 0x7f83f0106f10 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.324+0000 7f83ed7fa640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 0x7f83d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.324+0000 7f83effff640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 0x7f83d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.324+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f83e80f0240 con 0x7f83f0106f10 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.325+0000 7f83effff640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 0x7f83d80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005fd0 tx=0x7f83e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:58.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.328+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83e80bd380 con 0x7f83f0106f10 2024-09-12T02:28:58.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.545+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f83f0199750 con 0x7f83f0106f10 2024-09-12T02:28:58.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.983+0000 7f83ed7fa640 1 -- 172.21.15.1:0/674152618 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f83e802fe90 con 0x7f83f0106f10 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.985+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 msgr2=0x7f83d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.985+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 0x7f83d80a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005fd0 tx=0x7f83e0005850 comp rx=0 tx=0).stop 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.985+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 msgr2=0x7f83f019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.985+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83e8031a20 tx=0x7f83e8031a50 comp rx=0 tx=0).stop 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 shutdown_connections 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83d80a2b80 0x7f83d80a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83f0106f10 0x7f83f019ccc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102790 0x7f83f0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 --2- 172.21.15.1:0/674152618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f0101de0 0x7f83f01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 >> 172.21.15.1:0/674152618 conn(0x7f83f00fd8c0 msgr2=0x7f83f00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 shutdown_connections 2024-09-12T02:28:58.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:28:58.986+0000 7f83f674b640 1 -- 172.21.15.1:0/674152618 wait complete. 2024-09-12T02:28:59.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:58 smithi001 ceph-mon[31252]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T02:28:59.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:58 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:28:59.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:58 smithi134 ceph-mon[35091]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T02:28:59.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:58 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:28:59.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:58 smithi173 ceph-mon[35036]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T02:28:59.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:58 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:28:59.743 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T02:28:59.743 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T02:29:00.014 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:00.271 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:59 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:29:00.272 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:28:59 smithi001 ceph-mon[31252]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:00.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:59 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:29:00.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:28:59 smithi134 ceph-mon[35091]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:00.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:59 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/674152618' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:29:00.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:28:59 smithi173 ceph-mon[35036]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 -- 172.21.15.1:0/448676615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 msgr2=0x7f5d58106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/448676615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d58106e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009930 tx=0x7f5d5402a420 comp rx=0 tx=0).stop 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 -- 172.21.15.1:0/448676615 shutdown_connections 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/448676615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58101420 0x7f5d5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/448676615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58100a80 0x7f5d58100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/448676615 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d58106e60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 -- 172.21.15.1:0/448676615 >> 172.21.15.1:0/448676615 conn(0x7f5d580fc7a0 msgr2=0x7f5d580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 -- 172.21.15.1:0/448676615 shutdown_connections 2024-09-12T02:29:00.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.495+0000 7f5d5fb81640 1 -- 172.21.15.1:0/448676615 wait complete. 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 Processor -- start 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 -- start start 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58100a80 0x7f5d5819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 0x7f5d5819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58110ea0 con 0x7f5d58106a80 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58110d20 con 0x7f5d58101420 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5fb81640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58111020 con 0x7f5d58100a80 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5e11e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5e11e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46722/0 (socket says 172.21.15.1:46722) 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5e11e640 1 -- 172.21.15.1:0/1990273544 learned_addr learned my addr 172.21.15.1:0/1990273544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5d91d640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58100a80 0x7f5d5819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.496+0000 7f5d5d11c640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 0x7f5d5819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 -- 172.21.15.1:0/1990273544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58100a80 msgr2=0x7f5d5819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58100a80 0x7f5d5819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 -- 172.21.15.1:0/1990273544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 msgr2=0x7f5d5819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 0x7f5d5819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 -- 172.21.15.1:0/1990273544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5819f670 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5d11c640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 0x7f5d5819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5e11e640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b970 tx=0x7f5d5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50019070 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d5000cb40 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5819f960 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50007650 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.497+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d581a7240 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.498+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d58100ee0 con 0x7f5d58106a80 2024-09-12T02:29:00.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.499+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5d5001c070 con 0x7f5d58106a80 2024-09-12T02:29:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.500+0000 7f5d4effd640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 0x7f5d440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.500+0000 7f5d5d91d640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 0x7f5d440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.500+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5d500ce4c0 con 0x7f5d58106a80 2024-09-12T02:29:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.500+0000 7f5d5d91d640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 0x7f5d440a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009900 tx=0x7f5d540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.504+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d5009ae80 con 0x7f5d58106a80 2024-09-12T02:29:00.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.716+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f5d581a74a0 con 0x7f5d58106a80 2024-09-12T02:29:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.995+0000 7f5d4effd640 1 -- 172.21.15.1:0/1990273544 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f5d5009f180 con 0x7f5d58106a80 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 msgr2=0x7f5d440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 0x7f5d440a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009900 tx=0x7f5d540058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 msgr2=0x7f5d5819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b970 tx=0x7f5d5000be30 comp rx=0 tx=0).stop 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 shutdown_connections 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5d440a2c00 0x7f5d440a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d58106a80 0x7f5d5819ef90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d58101420 0x7f5d5819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 --2- 172.21.15.1:0/1990273544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d58100a80 0x7f5d5819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 >> 172.21.15.1:0/1990273544 conn(0x7f5d580fc7a0 msgr2=0x7f5d5806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 shutdown_connections 2024-09-12T02:29:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:00.998+0000 7f5d5fb81640 1 -- 172.21.15.1:0/1990273544 wait complete. 2024-09-12T02:29:01.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:00 smithi001 ceph-mon[31252]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T02:29:01.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:00 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:29:01.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:00 smithi134 ceph-mon[35091]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T02:29:01.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:00 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:29:01.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:00 smithi173 ceph-mon[35036]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T02:29:01.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:00 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:29:01.757 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:29:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:02.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:29:02.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:29:02.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:29:02.283 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:02.283 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:29:02.283 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:01 smithi001 ceph-mon[31252]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:29:02.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:01 smithi134 ceph-mon[35091]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:29:02.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:29:02.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1990273544' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:29:02.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:29:02.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:29:02.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:29:02.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:01 smithi173 ceph-mon[35036]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/1194951836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0810c2f0 msgr2=0x7fbf0810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/1194951836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0810c2f0 0x7fbf0810e790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009900 tx=0x7fbf0002a410 comp rx=0 tx=0).stop 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/1194951836 shutdown_connections 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/1194951836 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf0810c2f0 0x7fbf0810e790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/1194951836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf081037a0 0x7fbf0810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/1194951836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf081031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/1194951836 >> 172.21.15.1:0/1194951836 conn(0x7fbf080fc7d0 msgr2=0x7fbf080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/1194951836 shutdown_connections 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/1194951836 wait complete. 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.505+0000 7fbf0c8c2640 1 Processor -- start 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 -- start start 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf08198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf0810c2f0 0x7fbf0819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbf081121d0 con 0x7fbf081037a0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf08112050 con 0x7fbf0810c2f0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0c8c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf08112350 con 0x7fbf08102df0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59452/0 (socket says 172.21.15.1:59452) 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 -- 172.21.15.1:0/329026174 learned_addr learned my addr 172.21.15.1:0/329026174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf06d9d640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf0810c2f0 0x7fbf0819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0659c640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf08198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 -- 172.21.15.1:0/329026174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 msgr2=0x7fbf08198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf08198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 -- 172.21.15.1:0/329026174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf0810c2f0 msgr2=0x7fbf0819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf0810c2f0 0x7fbf0819cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 -- 172.21.15.1:0/329026174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0819d6c0 con 0x7fbf081037a0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf0659c640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf08198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.506+0000 7fbf05d9b640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00b990 tx=0x7fbefc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.507+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc019070 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.507+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0819d9b0 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.507+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbefc00cba0 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.507+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0126b0 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.507+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf081a5290 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.508+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf081031d0 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.509+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fbefc01c070 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.510+0000 7fbef77fe640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 0x7fbef00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.510+0000 7fbf0659c640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 0x7fbef00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.510+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbefc0ce410 con 0x7fbf081037a0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.510+0000 7fbf0659c640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 0x7fbef00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009930 tx=0x7fbef8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.514+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbefc09ae70 con 0x7fbf081037a0 2024-09-12T02:29:02.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:02.727+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fbf081072c0 con 0x7fbf081037a0 2024-09-12T02:29:03.004 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:29:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: 2024-09-12T02:29:02.712+0000 7f3860a9b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:29:03.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.010+0000 7fbef77fe640 1 -- 172.21.15.1:0/329026174 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fbefc09f170 con 0x7fbf081037a0 2024-09-12T02:29:03.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 msgr2=0x7fbef00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 0x7fbef00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009930 tx=0x7fbef8008040 comp rx=0 tx=0).stop 2024-09-12T02:29:03.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 msgr2=0x7fbf08198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:03.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00b990 tx=0x7fbefc00be50 comp rx=0 tx=0).stop 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 shutdown_connections 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbef00a2b80 0x7fbef00a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf081037a0 0x7fbf08198c50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf0810c2f0 0x7fbf0819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 --2- 172.21.15.1:0/329026174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf08102df0 0x7fbf08198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 >> 172.21.15.1:0/329026174 conn(0x7fbf080fc7d0 msgr2=0x7fbf080fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 shutdown_connections 2024-09-12T02:29:03.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:03.013+0000 7fbf0c8c2640 1 -- 172.21.15.1:0/329026174 wait complete. 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:active 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:29:03.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:03 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:active 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:29:03.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:03 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] up:active 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T02:29:03.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:03 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:29:03.838 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:29:04.105 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:active 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:29:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:04 smithi001 ceph-mon[31252]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:29:04.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:29:04.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:active 2024-09-12T02:29:04.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:29:04.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T02:29:04.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:29:04.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:04 smithi134 ceph-mon[35091]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/329026174' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] up:active 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T02:29:04.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:04 smithi173 ceph-mon[35036]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T02:29:04.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.572+0000 7fdc58e82640 1 -- 172.21.15.1:0/653813256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54101420 msgr2=0x7fdc5410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.572+0000 7fdc58e82640 1 --2- 172.21.15.1:0/653813256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54101420 0x7fdc5410d950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009cd0 tx=0x7fdc4c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 -- 172.21.15.1:0/653813256 shutdown_connections 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 --2- 172.21.15.1:0/653813256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54101420 0x7fdc5410d950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 --2- 172.21.15.1:0/653813256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54100a80 0x7fdc54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 --2- 172.21.15.1:0/653813256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 -- 172.21.15.1:0/653813256 >> 172.21.15.1:0/653813256 conn(0x7fdc540fc7a0 msgr2=0x7fdc540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 -- 172.21.15.1:0/653813256 shutdown_connections 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 -- 172.21.15.1:0/653813256 wait complete. 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.573+0000 7fdc58e82640 1 Processor -- start 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 -- start start 2024-09-12T02:29:04.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 0x7fdc54197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc5419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54110e80 con 0x7fdc54100a80 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54110d00 con 0x7fdc54106a80 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc58e82640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54111000 con 0x7fdc54101420 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59468/0 (socket says 172.21.15.1:59468) 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 -- 172.21.15.1:0/809148721 learned_addr learned my addr 172.21.15.1:0/809148721 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc52d9d640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc5419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc51d9b640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 0x7fdc54197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 -- 172.21.15.1:0/809148721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 msgr2=0x7fdc54197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 0x7fdc54197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 -- 172.21.15.1:0/809148721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 msgr2=0x7fdc5419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc5419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 -- 172.21.15.1:0/809148721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5419c270 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc51d9b640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 0x7fdc54197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc52d9d640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc5419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.574+0000 7fdc5259c640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e9f0 tx=0x7fdc4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.575+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400cd80 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.575+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5419c560 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.575+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc44010910 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.575+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc440188f0 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.575+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc541a3e40 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.576+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc54100ee0 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.578+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdc44010ac0 con 0x7fdc54100a80 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.578+0000 7fdc437fe640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 0x7fdc3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:04.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.578+0000 7fdc51d9b640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 0x7fdc3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:04.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.578+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fdc440cf760 con 0x7fdc54100a80 2024-09-12T02:29:04.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.579+0000 7fdc51d9b640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 0x7fdc3c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc540fecd0 tx=0x7fdc48005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:04.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.581+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc4409c810 con 0x7fdc54100a80 2024-09-12T02:29:04.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:04.794+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fdc54198620 con 0x7fdc54100a80 2024-09-12T02:29:05.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.024+0000 7fdc437fe640 1 -- 172.21.15.1:0/809148721 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fdc4409c110 con 0x7fdc54100a80 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 msgr2=0x7fdc3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 0x7fdc3c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc540fecd0 tx=0x7fdc48005d90 comp rx=0 tx=0).stop 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 msgr2=0x7fdc541972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e9f0 tx=0x7fdc4400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 shutdown_connections 2024-09-12T02:29:05.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fdc3c0a2b80 0x7fdc3c0a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc54106a80 0x7fdc5419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc54101420 0x7fdc54197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 --2- 172.21.15.1:0/809148721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc54100a80 0x7fdc541972c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 >> 172.21.15.1:0/809148721 conn(0x7fdc540fc7a0 msgr2=0x7fdc540fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 shutdown_connections 2024-09-12T02:29:05.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:05.028+0000 7fdc58e82640 1 -- 172.21.15.1:0/809148721 wait complete. 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:active 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: Cluster is now healthy 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:29:05.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:29:05.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:29:05.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:05 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:active 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: Cluster is now healthy 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:29:05.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:05 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:29:05.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2024-09-12T02:29:05.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] up:active 2024-09-12T02:29:05.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:29:05.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:29:05.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: Cluster is now healthy 2024-09-12T02:29:05.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T02:29:05.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:29:05.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:29:05.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:05 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:29:05.881 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T02:29:05.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:29:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:29:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:active 2024-09-12T02:29:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-mon[31252]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:29:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-mon[31252]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:29:06.146 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:06.336 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:06 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:29:06.336 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:06 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:active 2024-09-12T02:29:06.336 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:06 smithi134 ceph-mon[35091]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:29:06.336 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:06 smithi134 ceph-mon[35091]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:29:06.348 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:06 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/809148721' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:29:06.349 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:06 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] up:active 2024-09-12T02:29:06.349 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:06 smithi173 ceph-mon[35036]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T02:29:06.349 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:06 smithi173 ceph-mon[35036]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:29:06.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 -- 172.21.15.1:0/1972276702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c101de0 msgr2=0x7f280c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 --2- 172.21.15.1:0/1972276702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c101de0 0x7f280c1021c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2800009900 tx=0x7f280002a410 comp rx=0 tx=0).stop 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 -- 172.21.15.1:0/1972276702 shutdown_connections 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 --2- 172.21.15.1:0/1972276702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c106f10 0x7f280c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 --2- 172.21.15.1:0/1972276702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 0x7f280c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 --2- 172.21.15.1:0/1972276702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c101de0 0x7f280c1021c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 -- 172.21.15.1:0/1972276702 >> 172.21.15.1:0/1972276702 conn(0x7f280c0fd8c0 msgr2=0x7f280c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 -- 172.21.15.1:0/1972276702 shutdown_connections 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.666+0000 7f2812c47640 1 -- 172.21.15.1:0/1972276702 wait complete. 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 Processor -- start 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 -- start start 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c101de0 0x7f280c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 0x7f280c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f280c111fe0 con 0x7f280c106f10 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f280c111e60 con 0x7f280c101de0 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f2812c47640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f280c112160 con 0x7f280c102790 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.667+0000 7f28111e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59480/0 (socket says 172.21.15.1:59480) 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 -- 172.21.15.1:0/727643914 learned_addr learned my addr 172.21.15.1:0/727643914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28109e3640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c101de0 0x7f280c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f280bfff640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 0x7f280c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 -- 172.21.15.1:0/727643914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 msgr2=0x7f280c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 0x7f280c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 -- 172.21.15.1:0/727643914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c101de0 msgr2=0x7f280c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c101de0 0x7f280c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 -- 172.21.15.1:0/727643914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c19f670 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f28111e4640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f280400eaa0 tx=0x7f280400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280400cdb0 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280c19f960 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2804005020 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28040116b0 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.668+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280c1a7240 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.669+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280c1021c0 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.670+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2804005560 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.671+0000 7f2809ffb640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 0x7f27fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.671+0000 7f28109e3640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 0x7f27fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.671+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f28040cf170 con 0x7f280c106f10 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.672+0000 7f28109e3640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 0x7f27fc0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2800000c00 tx=0x7f2800005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:06.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.675+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2804016030 con 0x7f280c106f10 2024-09-12T02:29:06.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.874+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f280c075430 con 0x7f27fc0a2b80 2024-09-12T02:29:06.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.898+0000 7f2809ffb640 1 -- 172.21.15.1:0/727643914 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f280c075430 con 0x7f27fc0a2b80 2024-09-12T02:29:06.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 msgr2=0x7f27fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 0x7f27fc0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2800000c00 tx=0x7f2800005b50 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 msgr2=0x7f280c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f280400eaa0 tx=0x7f280400ef60 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 shutdown_connections 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f27fc0a2b80 0x7f27fc0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f280c106f10 0x7f280c19ef90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f280c102790 0x7f280c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 --2- 172.21.15.1:0/727643914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f280c101de0 0x7f280c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 >> 172.21.15.1:0/727643914 conn(0x7f280c0fd8c0 msgr2=0x7f280c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 shutdown_connections 2024-09-12T02:29:06.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:06.900+0000 7f2812c47640 1 -- 172.21.15.1:0/727643914 wait complete. 2024-09-12T02:29:07.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:07 smithi001 ceph-mon[31252]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-12T02:29:07.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:07 smithi001 ceph-mon[31252]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:07.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:29:06.878+0000 7fd155dae640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:29:07.127 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:29:06.878+0000 7fd155dae640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:29:07.127 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:29:06.878+0000 7fd155dae640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:29:07.127 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:29:06.878+0000 7fd155dae640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:29:07.127 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:29:06 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:29:06.878+0000 7fd155dae640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:29:07.362 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:07 smithi173 ceph-mon[35036]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-12T02:29:07.362 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:07 smithi173 ceph-mon[35036]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:07.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:07 smithi134 ceph-mon[35091]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-09-12T02:29:07.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:07 smithi134 ceph-mon[35091]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:07.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:29:07.913 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:29:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: 2024-09-12T02:29:07.713+0000 7f3860a9b640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T02:29:07.969 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:08.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 -- 172.21.15.1:0/305923504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 msgr2=0x7feb38100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/305923504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb38100f00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb34009900 tx=0x7feb3402a410 comp rx=0 tx=0).stop 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 -- 172.21.15.1:0/305923504 shutdown_connections 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/305923504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 0x7feb38110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/305923504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb3810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/305923504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb38100f00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 -- 172.21.15.1:0/305923504 >> 172.21.15.1:0/305923504 conn(0x7feb380fc7d0 msgr2=0x7feb380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 -- 172.21.15.1:0/305923504 shutdown_connections 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 -- 172.21.15.1:0/305923504 wait complete. 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.492+0000 7feb3f5ab640 1 Processor -- start 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 -- start start 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb381a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 0x7feb3819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb38114260 con 0x7feb38100b20 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb381140e0 con 0x7feb38101440 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3f5ab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb381143e0 con 0x7feb3810e500 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59524/0 (socket says 172.21.15.1:59524) 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 -- 172.21.15.1:0/2734437335 learned_addr learned my addr 172.21.15.1:0/2734437335 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3db48640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 0x7feb3819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3cb46640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb381a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 -- 172.21.15.1:0/2734437335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 msgr2=0x7feb3819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 0x7feb3819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 -- 172.21.15.1:0/2734437335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 msgr2=0x7feb381a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb381a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3d347640 1 -- 172.21.15.1:0/2734437335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3819acc0 con 0x7feb38100b20 2024-09-12T02:29:08.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.493+0000 7feb3cb46640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb381a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb3d347640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb34006010 tx=0x7feb340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3403f030 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb34003ce0 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3819af50 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34035070 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.494+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381a72a0 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.495+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3806a850 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.496+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7feb34042030 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.497+0000 7feb2e7fc640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 0x7feb240a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.497+0000 7feb3cb46640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 0x7feb240a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.497+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7feb340ef8f0 con 0x7feb38100b20 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.497+0000 7feb3cb46640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 0x7feb240a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb28005d00 tx=0x7feb28005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:08.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.500+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb340bc960 con 0x7feb38100b20 2024-09-12T02:29:08.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.704+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7feb38062630 con 0x7feb240a2c90 2024-09-12T02:29:08.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.732+0000 7feb2e7fc640 1 -- 172.21.15.1:0/2734437335 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feb38062630 con 0x7feb240a2c90 2024-09-12T02:29:08.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 msgr2=0x7feb240a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 0x7feb240a5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb28005d00 tx=0x7feb28005c70 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 msgr2=0x7feb381a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb34006010 tx=0x7feb340042f0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 shutdown_connections 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb240a2c90 0x7feb240a5150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3810e500 0x7feb3819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38101440 0x7feb381a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 --2- 172.21.15.1:0/2734437335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb38100b20 0x7feb381a03d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 >> 172.21.15.1:0/2734437335 conn(0x7feb380fc7d0 msgr2=0x7feb380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 shutdown_connections 2024-09-12T02:29:08.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:08.734+0000 7feb3f5ab640 1 -- 172.21.15.1:0/2734437335 wait complete. 2024-09-12T02:29:09.519 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:29:09.778 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:09 smithi001 ceph-mon[31252]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-12T02:29:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:09 smithi001 ceph-mon[31252]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:29:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:09 smithi001 ceph-mon[31252]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:09 smithi134 ceph-mon[35091]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-12T02:29:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:09 smithi134 ceph-mon[35091]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:29:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:09 smithi134 ceph-mon[35091]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:09 smithi173 ceph-mon[35036]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-12T02:29:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:09 smithi173 ceph-mon[35036]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T02:29:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:09 smithi173 ceph-mon[35036]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:10.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 -- 172.21.15.1:0/1704497098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c106f10 msgr2=0x7f575c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 --2- 172.21.15.1:0/1704497098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c106f10 0x7f575c10ea90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ca0 tx=0x7f575402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 -- 172.21.15.1:0/1704497098 shutdown_connections 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 --2- 172.21.15.1:0/1704497098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c106f10 0x7f575c10ea90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 --2- 172.21.15.1:0/1704497098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c102790 0x7f575c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 --2- 172.21.15.1:0/1704497098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c101de0 0x7f575c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 -- 172.21.15.1:0/1704497098 >> 172.21.15.1:0/1704497098 conn(0x7f575c0fd8c0 msgr2=0x7f575c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 -- 172.21.15.1:0/1704497098 shutdown_connections 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.293+0000 7f5763bd2640 1 -- 172.21.15.1:0/1704497098 wait complete. 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 Processor -- start 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 -- start start 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c102790 0x7f575c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c106f10 0x7f575c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f575c111f70 con 0x7f575c101de0 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f575c111df0 con 0x7f575c102790 2024-09-12T02:29:10.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f5763bd2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1120f0 con 0x7f575c106f10 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f576196e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f576196e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59536/0 (socket says 172.21.15.1:59536) 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.294+0000 7f576196e640 1 -- 172.21.15.1:0/245545926 learned_addr learned my addr 172.21.15.1:0/245545926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576116d640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c102790 0x7f575c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576216f640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c106f10 0x7f575c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 -- 172.21.15.1:0/245545926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c106f10 msgr2=0x7f575c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c106f10 0x7f575c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 -- 172.21.15.1:0/245545926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c102790 msgr2=0x7f575c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c102790 0x7f575c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 -- 172.21.15.1:0/245545926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c19d3c0 con 0x7f575c101de0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f576196e640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f575800d950 tx=0x7f575800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x7f575c101de0 2024-09-12T02:29:10.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c19d6b0 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5758009c30 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575800f6b0 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.295+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c1a4f90 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.296+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c1021c0 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.297+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f57580109d0 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.298+0000 7f5752ffd640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 0x7f57480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.298+0000 7f576116d640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 0x7f57480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.298+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f57580cee40 con 0x7f575c101de0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.299+0000 7f576116d640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 0x7f57480a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f574c005d70 tx=0x7f574c005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:10.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.302+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5758009de0 con 0x7f575c101de0 2024-09-12T02:29:10.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.505+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f575c062630 con 0x7f57480a2c10 2024-09-12T02:29:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.509+0000 7f5752ffd640 1 -- 172.21.15.1:0/245545926 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f575c062630 con 0x7f57480a2c10 2024-09-12T02:29:10.510 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/47f57cbd-6cb0-4aca-971b-a1a778d9d661 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.511+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 msgr2=0x7f57480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.511+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 0x7f57480a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f574c005d70 tx=0x7f574c005d00 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.511+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 msgr2=0x7f575c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f575800d950 tx=0x7f575800de10 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 shutdown_connections 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57480a2c10 0x7f57480a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f575c106f10 0x7f575c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c102790 0x7f575c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 --2- 172.21.15.1:0/245545926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f575c101de0 0x7f575c198410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 >> 172.21.15.1:0/245545926 conn(0x7f575c0fd8c0 msgr2=0x7f575c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 shutdown_connections 2024-09-12T02:29:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:10.512+0000 7f5763bd2640 1 -- 172.21.15.1:0/245545926 wait complete. 2024-09-12T02:29:11.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:29:11.473 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:11.760 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:11 smithi001 ceph-mon[31252]: pgmap v288: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-12T02:29:11.760 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:11 smithi001 ceph-mon[31252]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:11 smithi134 ceph-mon[35091]: pgmap v288: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-12T02:29:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:11 smithi134 ceph-mon[35091]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:11 smithi173 ceph-mon[35036]: pgmap v288: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-12T02:29:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:11 smithi173 ceph-mon[35036]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:11.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 -- 172.21.15.1:0/2320467881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 msgr2=0x7f989810eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 --2- 172.21.15.1:0/2320467881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f989810eb00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9890009cd0 tx=0x7f989002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 -- 172.21.15.1:0/2320467881 shutdown_connections 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 --2- 172.21.15.1:0/2320467881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f989810eb00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 --2- 172.21.15.1:0/2320467881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9898101290 0x7f9898107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 --2- 172.21.15.1:0/2320467881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98981008e0 0x7f9898100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 -- 172.21.15.1:0/2320467881 >> 172.21.15.1:0/2320467881 conn(0x7f9898077210 msgr2=0x7f9898077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 -- 172.21.15.1:0/2320467881 shutdown_connections 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.971+0000 7f989cf93640 1 -- 172.21.15.1:0/2320467881 wait complete. 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 Processor -- start 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 -- start start 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 0x7f9898101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9898101290 0x7f9898101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111fd0 con 0x7f9898108160 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9898111e50 con 0x7f9898101290 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989cf93640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9898112150 con 0x7f98981008e0 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f9896d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f9896d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51152/0 (socket says 172.21.15.1:51152) 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f9896d9d640 1 -- 172.21.15.1:0/3725174545 learned_addr learned my addr 172.21.15.1:0/3725174545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f988dd9b640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9898101290 0x7f9898101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.972+0000 7f989659c640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 0x7f9898101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 -- 172.21.15.1:0/3725174545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 msgr2=0x7f9898101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 0x7f9898101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 -- 172.21.15.1:0/3725174545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9898101290 msgr2=0x7f9898101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:11.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9898101290 0x7f9898101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 -- 172.21.15.1:0/3725174545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98981a6890 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f989659c640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 0x7f9898101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f9896d9d640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9890005cc0 tx=0x7f9890003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890004040 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98900046c0 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98981a6b20 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890030e70 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.973+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98981a7060 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.974+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9898100cc0 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.975+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f98900305a0 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.976+0000 7f988ffff640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 0x7f98840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.976+0000 7f989659c640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 0x7f98840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.976+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f989002e030 con 0x7f9898108160 2024-09-12T02:29:11.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.977+0000 7f989659c640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 0x7f98840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98880058c0 tx=0x7f9888005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:11.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:11.980+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98900098b0 con 0x7f9898108160 2024-09-12T02:29:12.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.182+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f98980ffe70 con 0x7f98840a2c10 2024-09-12T02:29:12.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.205+0000 7f988ffff640 1 -- 172.21.15.1:0/3725174545 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f98980ffe70 con 0x7f98840a2c10 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 msgr2=0x7f98840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 0x7f98840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98880058c0 tx=0x7f9888005850 comp rx=0 tx=0).stop 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 msgr2=0x7f98981022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9890005cc0 tx=0x7f9890003970 comp rx=0 tx=0).stop 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 shutdown_connections 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98840a2c10 0x7f98840a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9898108160 0x7f98981022e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9898101290 0x7f9898101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 --2- 172.21.15.1:0/3725174545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98981008e0 0x7f9898101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:12.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.207+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 >> 172.21.15.1:0/3725174545 conn(0x7f9898077210 msgr2=0x7f98980ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:12.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.208+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 shutdown_connections 2024-09-12T02:29:12.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:12.208+0000 7f989cf93640 1 -- 172.21.15.1:0/3725174545 wait complete. 2024-09-12T02:29:12.928 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:29:13.186 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:13.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:13 smithi001 ceph-mon[31252]: pgmap v289: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-12T02:29:13.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:13 smithi001 ceph-mon[31252]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 -- 172.21.15.1:0/3447135602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54102790 msgr2=0x7f7d541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 --2- 172.21.15.1:0/3447135602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54102790 0x7f7d541067e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009900 tx=0x7f7d3c02a410 comp rx=0 tx=0).stop 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 -- 172.21.15.1:0/3447135602 shutdown_connections 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 --2- 172.21.15.1:0/3447135602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54102790 0x7f7d541067e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 --2- 172.21.15.1:0/3447135602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 0x7f7d5410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 --2- 172.21.15.1:0/3447135602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54101de0 0x7f7d541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 -- 172.21.15.1:0/3447135602 >> 172.21.15.1:0/3447135602 conn(0x7f7d540fd8c0 msgr2=0x7f7d540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:13.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 -- 172.21.15.1:0/3447135602 shutdown_connections 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.682+0000 7f7d59d87640 1 -- 172.21.15.1:0/3447135602 wait complete. 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 Processor -- start 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 -- start start 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54102790 0x7f7d54074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 0x7f7d54074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111f70 con 0x7f7d54101de0 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111df0 con 0x7f7d54102790 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d59d87640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7d541120f0 con 0x7f7d54106f10 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51170/0 (socket says 172.21.15.1:51170) 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 -- 172.21.15.1:0/2444693389 learned_addr learned my addr 172.21.15.1:0/2444693389 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d4affd640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54102790 0x7f7d54074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d53fff640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 0x7f7d54074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 -- 172.21.15.1:0/2444693389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 msgr2=0x7f7d54074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 0x7f7d54074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 -- 172.21.15.1:0/2444693389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54102790 msgr2=0x7f7d54074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54102790 0x7f7d54074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.683+0000 7f7d537fe640 1 -- 172.21.15.1:0/2444693389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d541a68c0 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d537fe640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c920 tx=0x7f7d4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44007c70 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d541a6bb0 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d44007e10 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44018890 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.684+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d541a70f0 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.685+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d541021c0 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.686+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7d44018a70 con 0x7f7d54101de0 2024-09-12T02:29:13.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.687+0000 7f7d517fa640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 0x7f7d400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:13.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.687+0000 7f7d4affd640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 0x7f7d400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.687+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7d440cf220 con 0x7f7d54101de0 2024-09-12T02:29:13.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.687+0000 7f7d4affd640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 0x7f7d400a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d541087d0 tx=0x7f7d3c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:13.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.691+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d44014030 con 0x7f7d54101de0 2024-09-12T02:29:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.893+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7d54062630 con 0x7f7d400a2c10 2024-09-12T02:29:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.897+0000 7f7d517fa640 1 -- 172.21.15.1:0/2444693389 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7d54062630 con 0x7f7d400a2c10 2024-09-12T02:29:13.897 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/437002fb-a25f-434d-87c2-b5dab40e23bf 2024-09-12T02:29:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 msgr2=0x7f7d400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 0x7f7d400a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d541087d0 tx=0x7f7d3c031490 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 msgr2=0x7f7d540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c920 tx=0x7f7d4400cde0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 shutdown_connections 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7d400a2c10 0x7f7d400a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d54106f10 0x7f7d54074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d54102790 0x7f7d54074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 --2- 172.21.15.1:0/2444693389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d54101de0 0x7f7d540744f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 >> 172.21.15.1:0/2444693389 conn(0x7f7d540fd8c0 msgr2=0x7f7d540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 shutdown_connections 2024-09-12T02:29:13.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:13.899+0000 7f7d59d87640 1 -- 172.21.15.1:0/2444693389 wait complete. 2024-09-12T02:29:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:13 smithi134 ceph-mon[35091]: pgmap v289: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-12T02:29:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:13 smithi134 ceph-mon[35091]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:13.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:13 smithi173 ceph-mon[35036]: pgmap v289: 97 pgs: 97 active+clean; 605 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-12T02:29:13.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:13 smithi173 ceph-mon[35036]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:14.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:29:14.863 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:15.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 -- 172.21.15.1:0/112824709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8106a80 msgr2=0x7fccf8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/112824709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8106a80 0x7fccf8106e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009930 tx=0x7fcce802a420 comp rx=0 tx=0).stop 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 -- 172.21.15.1:0/112824709 shutdown_connections 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/112824709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/112824709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8100a80 0x7fccf8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/112824709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8106a80 0x7fccf8106e60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 -- 172.21.15.1:0/112824709 >> 172.21.15.1:0/112824709 conn(0x7fccf80fc7a0 msgr2=0x7fccf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 -- 172.21.15.1:0/112824709 shutdown_connections 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.356+0000 7fccfd7b0640 1 -- 172.21.15.1:0/112824709 wait complete. 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 Processor -- start 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 -- start start 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 0x7fccf819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8110ea0 con 0x7fccf8100a80 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8110d20 con 0x7fccf8101420 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccfd7b0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111020 con 0x7fccf8106a80 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccf6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccf6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51188/0 (socket says 172.21.15.1:51188) 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fccf6ffd640 1 -- 172.21.15.1:0/1803672692 learned_addr learned my addr 172.21.15.1:0/1803672692 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.357+0000 7fcceffff640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf77fe640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 0x7fccf819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 -- 172.21.15.1:0/1803672692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 msgr2=0x7fccf819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 0x7fccf819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 -- 172.21.15.1:0/1803672692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 msgr2=0x7fccf8198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf8198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 -- 172.21.15.1:0/1803672692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf819d470 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fcceffff640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf77fe640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 0x7fccf819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf6ffd640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009a50 tx=0x7fcce8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce803f030 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce8003ce0 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf819d700 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8035070 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.358+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81a5040 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.359+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf8100ee0 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.360+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcce8042030 con 0x7fccf8100a80 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.361+0000 7fccf4ff9640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 0x7fcce40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:15.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.361+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcce80efb30 con 0x7fccf8100a80 2024-09-12T02:29:15.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.361+0000 7fcceffff640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 0x7fcce40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:15.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.362+0000 7fcceffff640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 0x7fcce40a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fccf806b7e0 tx=0x7fcce0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:15.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.364+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcce80bc9e0 con 0x7fccf8100a80 2024-09-12T02:29:15.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.578+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccf81a5210 con 0x7fccf8100a80 2024-09-12T02:29:15.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:15 smithi001 ceph-mon[31252]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:15.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:15 smithi001 ceph-mon[31252]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-12T02:29:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:15.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.578+0000 7fccf4ff9640 1 -- 172.21.15.1:0/1803672692 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7fcce80bc2e0 con 0x7fccf8100a80 2024-09-12T02:29:15.580 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:29:15.580 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:29:15.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 msgr2=0x7fcce40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 0x7fcce40a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fccf806b7e0 tx=0x7fcce0008040 comp rx=0 tx=0).stop 2024-09-12T02:29:15.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 msgr2=0x7fccf81984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:15.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009a50 tx=0x7fcce8004270 comp rx=0 tx=0).stop 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 shutdown_connections 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcce40a2c90 0x7fcce40a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccf8106a80 0x7fccf819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccf8101420 0x7fccf8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 --2- 172.21.15.1:0/1803672692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fccf8100a80 0x7fccf81984c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 >> 172.21.15.1:0/1803672692 conn(0x7fccf80fc7a0 msgr2=0x7fccf8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 shutdown_connections 2024-09-12T02:29:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:15.581+0000 7fccfd7b0640 1 -- 172.21.15.1:0/1803672692 wait complete. 2024-09-12T02:29:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:15 smithi134 ceph-mon[35091]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:15 smithi134 ceph-mon[35091]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-12T02:29:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:15 smithi173 ceph-mon[35036]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:15 smithi173 ceph-mon[35036]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-12T02:29:16.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:29:16.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:16 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1803672692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:29:16.640 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:16.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:16 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1803672692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:29:16.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:16 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1803672692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 -- 172.21.15.1:0/443189728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4102d40 msgr2=0x7f7be4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 --2- 172.21.15.1:0/443189728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4102d40 0x7f7be4103120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009900 tx=0x7f7be002a480 comp rx=0 tx=0).stop 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 -- 172.21.15.1:0/443189728 shutdown_connections 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 --2- 172.21.15.1:0/443189728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 0x7f7be410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 --2- 172.21.15.1:0/443189728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4103660 0x7f7be410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 --2- 172.21.15.1:0/443189728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4102d40 0x7f7be4103120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 -- 172.21.15.1:0/443189728 >> 172.21.15.1:0/443189728 conn(0x7f7be40fc7a0 msgr2=0x7f7be40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 -- 172.21.15.1:0/443189728 shutdown_connections 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.119+0000 7f7bec599640 1 -- 172.21.15.1:0/443189728 wait complete. 2024-09-12T02:29:17.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 Processor -- start 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 -- start start 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 0x7f7be41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 0x7f7be419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111fb0 con 0x7f7be4103660 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111e30 con 0x7f7be4102d40 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bec599640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4112130 con 0x7f7be410c170 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7be9b34640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7be9b34640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51216/0 (socket says 172.21.15.1:51216) 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7be9b34640 1 -- 172.21.15.1:0/799238683 learned_addr learned my addr 172.21.15.1:0/799238683 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.120+0000 7f7bea335640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 0x7f7be41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7beab36640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 0x7f7be419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:17.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 -- 172.21.15.1:0/799238683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 msgr2=0x7f7be419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 0x7f7be419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 -- 172.21.15.1:0/799238683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 msgr2=0x7f7be41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 0x7f7be41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 -- 172.21.15.1:0/799238683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be419d3a0 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bea335640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 0x7f7be41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7be9b34640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c970 tx=0x7f7bd400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4007bb0 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be419d690 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4007d50 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4018820 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.121+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be41a4f70 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.122+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be4103120 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.123+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7bd40189c0 con 0x7f7be4103660 2024-09-12T02:29:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.124+0000 7f7bdb7fe640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 0x7f7bd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.124+0000 7f7bea335640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 0x7f7bd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.124+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7bd40cf2b0 con 0x7f7be4103660 2024-09-12T02:29:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.125+0000 7f7bea335640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 0x7f7bd00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005ab0 tx=0x7f7be0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.128+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bd4014030 con 0x7f7be4103660 2024-09-12T02:29:17.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.304+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7be41a52b0 con 0x7f7be4103660 2024-09-12T02:29:17.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.305+0000 7f7bdb7fe640 1 -- 172.21.15.1:0/799238683 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22231 (secure 0 0 0) 0x7f7bd401f300 con 0x7f7be4103660 2024-09-12T02:29:17.306 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:17.306 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:52.748131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 msgr2=0x7f7bd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 0x7f7bd00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005ab0 tx=0x7f7be0005a20 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 msgr2=0x7f7be4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c970 tx=0x7f7bd400ce30 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 shutdown_connections 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7bd00a2c10 0x7f7bd00a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7be4103660 0x7f7be4198930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7be410c170 0x7f7be419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 --2- 172.21.15.1:0/799238683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be4102d40 0x7f7be41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 >> 172.21.15.1:0/799238683 conn(0x7f7be40fc7a0 msgr2=0x7f7be40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 shutdown_connections 2024-09-12T02:29:17.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:17.308+0000 7f7bec599640 1 -- 172.21.15.1:0/799238683 wait complete. 2024-09-12T02:29:17.620 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:17 smithi001 ceph-mon[31252]: pgmap v291: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 23 op/s 2024-09-12T02:29:17.620 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:17 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/799238683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:17 smithi134 ceph-mon[35091]: pgmap v291: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 23 op/s 2024-09-12T02:29:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:17 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/799238683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:17 smithi173 ceph-mon[35036]: pgmap v291: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 23 op/s 2024-09-12T02:29:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:17 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/799238683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:18.008 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:29:18.008 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:29:18.274 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 -- 172.21.15.1:0/1383018342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8101de0 msgr2=0x7f3fa81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 --2- 172.21.15.1:0/1383018342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8101de0 0x7f3fa81021c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009900 tx=0x7f3f9802a410 comp rx=0 tx=0).stop 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 -- 172.21.15.1:0/1383018342 shutdown_connections 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 --2- 172.21.15.1:0/1383018342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8106f10 0x7f3fa810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 --2- 172.21.15.1:0/1383018342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 0x7f3fa81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 --2- 172.21.15.1:0/1383018342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8101de0 0x7f3fa81021c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 -- 172.21.15.1:0/1383018342 >> 172.21.15.1:0/1383018342 conn(0x7f3fa80fd8c0 msgr2=0x7f3fa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 -- 172.21.15.1:0/1383018342 shutdown_connections 2024-09-12T02:29:18.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.796+0000 7f3fad631640 1 -- 172.21.15.1:0/1383018342 wait complete. 2024-09-12T02:29:18.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 Processor -- start 2024-09-12T02:29:18.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 -- start start 2024-09-12T02:29:18.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8101de0 0x7f3fa8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 0x7f3fa81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8111f90 con 0x7f3fa8106f10 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8111e10 con 0x7f3fa8101de0 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.797+0000 7f3fad631640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8112110 con 0x7f3fa8102790 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa67fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 0x7f3fa81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51232/0 (socket says 172.21.15.1:51232) 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 -- 172.21.15.1:0/1378114763 learned_addr learned my addr 172.21.15.1:0/1378114763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa6ffd640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8101de0 0x7f3fa8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 -- 172.21.15.1:0/1378114763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 msgr2=0x7f3fa81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 0x7f3fa81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 -- 172.21.15.1:0/1378114763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8101de0 msgr2=0x7f3fa8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8101de0 0x7f3fa8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 -- 172.21.15.1:0/1378114763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa819d430 con 0x7f3fa8106f10 2024-09-12T02:29:18.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fa77fe640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000b970 tx=0x7f3fa000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0019070 con 0x7f3fa8106f10 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa000cb40 con 0x7f3fa8106f10 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa819d720 con 0x7f3fa8106f10 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0007650 con 0x7f3fa8106f10 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.798+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81a5000 con 0x7f3fa8106f10 2024-09-12T02:29:18.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.800+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa81021c0 con 0x7f3fa8106f10 2024-09-12T02:29:18.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.801+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3fa001c070 con 0x7f3fa8106f10 2024-09-12T02:29:18.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.801+0000 7f3f8ffff640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 0x7f3f900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.801+0000 7f3fa6ffd640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 0x7f3f900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.801+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3fa00ce500 con 0x7f3fa8106f10 2024-09-12T02:29:18.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.802+0000 7f3fa6ffd640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 0x7f3f900a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.806+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fa009af70 con 0x7f3fa8106f10 2024-09-12T02:29:18.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.978+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fa8062630 con 0x7f3f900a2c10 2024-09-12T02:29:18.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.985+0000 7f3f8ffff640 1 -- 172.21.15.1:0/1378114763 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258913 (secure 0 0 0) 0x7f3fa8062630 con 0x7f3f900a2c10 2024-09-12T02:29:18.987 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:18.989 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:29:18.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 msgr2=0x7f3f900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 0x7f3f900a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f980058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 msgr2=0x7f3fa819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000b970 tx=0x7f3fa000be30 comp rx=0 tx=0).stop 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 shutdown_connections 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f900a2c10 0x7f3f900a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fa8106f10 0x7f3fa819cd50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fa8102790 0x7f3fa81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.987+0000 7f3fad631640 1 --2- 172.21.15.1:0/1378114763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fa8101de0 0x7f3fa8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.988+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 >> 172.21.15.1:0/1378114763 conn(0x7f3fa80fd8c0 msgr2=0x7f3fa80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.988+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 shutdown_connections 2024-09-12T02:29:18.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:18.988+0000 7f3fad631640 1 -- 172.21.15.1:0/1378114763 wait complete. 2024-09-12T02:29:19.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:19 smithi001 ceph-mon[31252]: pgmap v292: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 16 op/s 2024-09-12T02:29:19.870 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-12T02:29:17.958214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640013,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":271,"num_read_kb":236,"num_write":410,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":337,"ondisk_log_size":337,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380800,"kb_used_data":10752,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561024,"statfs":{"total":1151940427776,"available":1151550488576,"internally_reserved":0,"allocated":11010048,"data_stored":6927903,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43095,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":128,"num_read_kb":112,"num_write":66,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966878+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:28:52.966878+0000","last_peered":"2024-09-12T02:28:52.966878+0000","last_clean":"2024-09-12T02:28:52.966878+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:28:52.966878+0000","last_undegraded":"2024-09-12T02:28:52.966878+0000","last_fullsized":"2024-09-12T02:28:52.966878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480535+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:28:53.480535+0000","last_peered":"2024-09-12T02:28:53.480535+0000","last_clean":"2024-09-12T02:28:53.480535+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:28:53.480535+0000","last_undegraded":"2024-09-12T02:28:53.480535+0000","last_fullsized":"2024-09-12T02:28:53.480535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480475+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:28:53.480475+0000","last_peered":"2024-09-12T02:28:53.480475+0000","last_clean":"2024-09-12T02:28:53.480475+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:28:53.480475+0000","last_undegraded":"2024-09-12T02:28:53.480475+0000","last_fullsized":"2024-09-12T02:28:53.480475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.355561+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:28:53.355561+0000","last_peered":"2024-09-12T02:28:53.355561+0000","last_clean":"2024-09-12T02:28:53.355561+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:28:53.355561+0000","last_undegraded":"2024-09-12T02:28:53.355561+0000","last_fullsized":"2024-09-12T02:28:53.355561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478913+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:28:53.478913+0000","last_peered":"2024-09-12T02:28:53.478913+0000","last_clean":"2024-09-12T02:28:53.478913+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:28:53.478913+0000","last_undegraded":"2024-09-12T02:28:53.478913+0000","last_fullsized":"2024-09-12T02:28:53.478913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478822+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:28:53.478822+0000","last_peered":"2024-09-12T02:28:53.478822+0000","last_clean":"2024-09-12T02:28:53.478822+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:28:53.478822+0000","last_undegraded":"2024-09-12T02:28:53.478822+0000","last_fullsized":"2024-09-12T02:28:53.478822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481388+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:28:53.481388+0000","last_peered":"2024-09-12T02:28:53.481388+0000","last_clean":"2024-09-12T02:28:53.481388+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:28:53.481388+0000","last_undegraded":"2024-09-12T02:28:53.481388+0000","last_fullsized":"2024-09-12T02:28:53.481388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.965926+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:28:52.965926+0000","last_peered":"2024-09-12T02:28:52.965926+0000","last_clean":"2024-09-12T02:28:52.965926+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:28:52.965926+0000","last_undegraded":"2024-09-12T02:28:52.965926+0000","last_fullsized":"2024-09-12T02:28:52.965926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967413+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:28:52.967413+0000","last_peered":"2024-09-12T02:28:52.967413+0000","last_clean":"2024-09-12T02:28:52.967413+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:28:52.967413+0000","last_undegraded":"2024-09-12T02:28:52.967413+0000","last_fullsized":"2024-09-12T02:28:52.967413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479236+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:28:53.479236+0000","last_peered":"2024-09-12T02:28:53.479236+0000","last_clean":"2024-09-12T02:28:53.479236+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:28:53.479236+0000","last_undegraded":"2024-09-12T02:28:53.479236+0000","last_fullsized":"2024-09-12T02:28:53.479236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481826+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:28:53.481826+0000","last_peered":"2024-09-12T02:28:53.481826+0000","last_clean":"2024-09-12T02:28:53.481826+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:28:53.481826+0000","last_undegraded":"2024-09-12T02:28:53.481826+0000","last_fullsized":"2024-09-12T02:28:53.481826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.355639+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:28:53.355639+0000","last_peered":"2024-09-12T02:28:53.355639+0000","last_clean":"2024-09-12T02:28:53.355639+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:28:53.355639+0000","last_undegraded":"2024-09-12T02:28:53.355639+0000","last_fullsized":"2024-09-12T02:28:53.355639+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402713+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:28:53.402713+0000","last_peered":"2024-09-12T02:28:53.402713+0000","last_clean":"2024-09-12T02:28:53.402713+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:28:53.402713+0000","last_undegraded":"2024-09-12T02:28:53.402713+0000","last_fullsized":"2024-09-12T02:28:53.402713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480739+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:28:53.480739+0000","last_peered":"2024-09-12T02:28:53.480739+0000","last_clean":"2024-09-12T02:28:53.480739+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:28:53.480739+0000","last_undegraded":"2024-09-12T02:28:53.480739+0000","last_fullsized":"2024-09-12T02:28:53.480739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480521+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:28:53.480521+0000","last_peered":"2024-09-12T02:28:53.480521+0000","last_clean":"2024-09-12T02:28:53.480521+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:28:53.480521+0000","last_undegraded":"2024-09-12T02:28:53.480521+0000","last_fullsized":"2024-09-12T02:28:53.480521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966895+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:28:52.966895+0000","last_peered":"2024-09-12T02:28:52.966895+0000","last_clean":"2024-09-12T02:28:52.966895+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:28:52.966895+0000","last_undegraded":"2024-09-12T02:28:52.966895+0000","last_fullsized":"2024-09-12T02:28:52.966895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966880+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:28:52.966880+0000","last_peered":"2024-09-12T02:28:52.966880+0000","last_clean":"2024-09-12T02:28:52.966880+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:28:52.966880+0000","last_undegraded":"2024-09-12T02:28:52.966880+0000","last_fullsized":"2024-09-12T02:28:52.966880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479767+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:28:53.479767+0000","last_peered":"2024-09-12T02:28:53.479767+0000","last_clean":"2024-09-12T02:28:53.479767+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:28:53.479767+0000","last_undegraded":"2024-09-12T02:28:53.479767+0000","last_fullsized":"2024-09-12T02:28:53.479767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485793+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:28:53.485793+0000","last_peered":"2024-09-12T02:28:53.485793+0000","last_clean":"2024-09-12T02:28:53.485793+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:28:53.485793+0000","last_undegraded":"2024-09-12T02:28:53.485793+0000","last_fullsized":"2024-09-12T02:28:53.485793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966540+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:28:52.966540+0000","last_peered":"2024-09-12T02:28:52.966540+0000","last_clean":"2024-09-12T02:28:52.966540+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:28:52.966540+0000","last_undegraded":"2024-09-12T02:28:52.966540+0000","last_fullsized":"2024-09-12T02:28:52.966540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402889+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:28:53.402889+0000","last_peered":"2024-09-12T02:28:53.402889+0000","last_clean":"2024-09-12T02:28:53.402889+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:28:53.402889+0000","last_undegraded":"2024-09-12T02:28:53.402889+0000","last_fullsized":"2024-09-12T02:28:53.402889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967068+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:28:52.967068+0000","last_peered":"2024-09-12T02:28:52.967068+0000","last_clean":"2024-09-12T02:28:52.967068+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:28:52.967068+0000","last_undegraded":"2024-09-12T02:28:52.967068+0000","last_fullsized":"2024-09-12T02:28:52.967068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966367+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:28:52.966367+0000","last_peered":"2024-09-12T02:28:52.966367+0000","last_clean":"2024-09-12T02:28:52.966367+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:28:52.966367+0000","last_undegraded":"2024-09-12T02:28:52.966367+0000","last_fullsized":"2024-09-12T02:28:52.966367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480327+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:28:53.480327+0000","last_peered":"2024-09-12T02:28:53.480327+0000","last_clean":"2024-09-12T02:28:53.480327+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:28:53.480327+0000","last_undegraded":"2024-09-12T02:28:53.480327+0000","last_fullsized":"2024-09-12T02:28:53.480327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966223+0000","last_change":"2024-09-12T02:28:51.983288+0000","last_active":"2024-09-12T02:28:52.966223+0000","last_peered":"2024-09-12T02:28:52.966223+0000","last_clean":"2024-09-12T02:28:52.966223+0000","last_became_active":"2024-09-12T02:28:51.982982+0000","last_became_peered":"2024-09-12T02:28:51.982982+0000","last_unstale":"2024-09-12T02:28:52.966223+0000","last_undegraded":"2024-09-12T02:28:52.966223+0000","last_fullsized":"2024-09-12T02:28:52.966223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.052613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.486698+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:28:53.486698+0000","last_peered":"2024-09-12T02:28:53.486698+0000","last_clean":"2024-09-12T02:28:53.486698+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:28:53.486698+0000","last_undegraded":"2024-09-12T02:28:53.486698+0000","last_fullsized":"2024-09-12T02:28:53.486698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966694+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:28:52.966694+0000","last_peered":"2024-09-12T02:28:52.966694+0000","last_clean":"2024-09-12T02:28:52.966694+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:28:52.966694+0000","last_undegraded":"2024-09-12T02:28:52.966694+0000","last_fullsized":"2024-09-12T02:28:52.966694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402608+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:28:53.402608+0000","last_peered":"2024-09-12T02:28:53.402608+0000","last_clean":"2024-09-12T02:28:53.402608+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:28:53.402608+0000","last_undegraded":"2024-09-12T02:28:53.402608+0000","last_fullsized":"2024-09-12T02:28:53.402608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481016+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:28:53.481016+0000","last_peered":"2024-09-12T02:28:53.481016+0000","last_clean":"2024-09-12T02:28:53.481016+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:28:53.481016+0000","last_undegraded":"2024-09-12T02:28:53.481016+0000","last_fullsized":"2024-09-12T02:28:53.481016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485243+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:28:53.485243+0000","last_peered":"2024-09-12T02:28:53.485243+0000","last_clean":"2024-09-12T02:28:53.485243+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:28:53.485243+0000","last_undegraded":"2024-09-12T02:28:53.485243+0000","last_fullsized":"2024-09-12T02:28:53.485243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.486436+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:28:53.486436+0000","last_peered":"2024-09-12T02:28:53.486436+0000","last_clean":"2024-09-12T02:28:53.486436+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:28:53.486436+0000","last_undegraded":"2024-09-12T02:28:53.486436+0000","last_fullsized":"2024-09-12T02:28:53.486436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966477+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:28:52.966477+0000","last_peered":"2024-09-12T02:28:52.966477+0000","last_clean":"2024-09-12T02:28:52.966477+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:28:52.966477+0000","last_undegraded":"2024-09-12T02:28:52.966477+0000","last_fullsized":"2024-09-12T02:28:52.966477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481855+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:28:53.481855+0000","last_peered":"2024-09-12T02:28:53.481855+0000","last_clean":"2024-09-12T02:28:53.481855+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:28:53.481855+0000","last_undegraded":"2024-09-12T02:28:53.481855+0000","last_fullsized":"2024-09-12T02:28:53.481855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.052050+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:29:14.052050+0000","last_peered":"2024-09-12T02:29:14.052050+0000","last_clean":"2024-09-12T02:29:14.052050+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:29:14.052050+0000","last_undegraded":"2024-09-12T02:29:14.052050+0000","last_fullsized":"2024-09-12T02:29:14.052050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.483183+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:28:53.483183+0000","last_peered":"2024-09-12T02:28:53.483183+0000","last_clean":"2024-09-12T02:28:53.483183+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:28:53.483183+0000","last_undegraded":"2024-09-12T02:28:53.483183+0000","last_fullsized":"2024-09-12T02:28:53.483183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.026807+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:03.026807+0000","last_peered":"2024-09-12T02:29:03.026807+0000","last_clean":"2024-09-12T02:29:03.026807+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:03.026807+0000","last_undegraded":"2024-09-12T02:29:03.026807+0000","last_fullsized":"2024-09-12T02:29:03.026807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.021441+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:02.021441+0000","last_peered":"2024-09-12T02:29:02.021441+0000","last_clean":"2024-09-12T02:29:02.021441+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:02.021441+0000","last_undegraded":"2024-09-12T02:29:02.021441+0000","last_fullsized":"2024-09-12T02:29:02.021441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966024+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:28:52.966024+0000","last_peered":"2024-09-12T02:28:52.966024+0000","last_clean":"2024-09-12T02:28:52.966024+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:28:52.966024+0000","last_undegraded":"2024-09-12T02:28:52.966024+0000","last_fullsized":"2024-09-12T02:28:52.966024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.032879+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:04.032879+0000","last_peered":"2024-09-12T02:29:04.032879+0000","last_clean":"2024-09-12T02:29:04.032879+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:04.032879+0000","last_undegraded":"2024-09-12T02:29:04.032879+0000","last_fullsized":"2024-09-12T02:29:04.032879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479540+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:28:53.479540+0000","last_peered":"2024-09-12T02:28:53.479540+0000","last_clean":"2024-09-12T02:28:53.479540+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:28:53.479540+0000","last_undegraded":"2024-09-12T02:28:53.479540+0000","last_fullsized":"2024-09-12T02:28:53.479540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.051342+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:29:14.051342+0000","last_peered":"2024-09-12T02:29:14.051342+0000","last_clean":"2024-09-12T02:29:14.051342+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:29:14.051342+0000","last_undegraded":"2024-09-12T02:29:14.051342+0000","last_fullsized":"2024-09-12T02:29:14.051342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967343+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:28:52.967343+0000","last_peered":"2024-09-12T02:28:52.967343+0000","last_clean":"2024-09-12T02:28:52.967343+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:28:52.967343+0000","last_undegraded":"2024-09-12T02:28:52.967343+0000","last_fullsized":"2024-09-12T02:28:52.967343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033308+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:04.033308+0000","last_peered":"2024-09-12T02:29:04.033308+0000","last_clean":"2024-09-12T02:29:04.033308+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:04.033308+0000","last_undegraded":"2024-09-12T02:29:04.033308+0000","last_fullsized":"2024-09-12T02:29:04.033308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481121+0000","last_change":"2024-09-12T02:28:51.983705+0000","last_active":"2024-09-12T02:28:53.481121+0000","last_peered":"2024-09-12T02:28:53.481121+0000","last_clean":"2024-09-12T02:28:53.481121+0000","last_became_active":"2024-09-12T02:28:51.982525+0000","last_became_peered":"2024-09-12T02:28:51.982525+0000","last_unstale":"2024-09-12T02:28:53.481121+0000","last_undegraded":"2024-09-12T02:28:53.481121+0000","last_fullsized":"2024-09-12T02:28:53.481121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:39.045747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.025296+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:03.025296+0000","last_peered":"2024-09-12T02:29:03.025296+0000","last_clean":"2024-09-12T02:29:03.025296+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:03.025296+0000","last_undegraded":"2024-09-12T02:29:03.025296+0000","last_fullsized":"2024-09-12T02:29:03.025296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967347+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:28:52.967347+0000","last_peered":"2024-09-12T02:28:52.967347+0000","last_clean":"2024-09-12T02:28:52.967347+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:28:52.967347+0000","last_undegraded":"2024-09-12T02:28:52.967347+0000","last_fullsized":"2024-09-12T02:28:52.967347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.052578+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:29:14.052578+0000","last_peered":"2024-09-12T02:29:14.052578+0000","last_clean":"2024-09-12T02:29:14.052578+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:29:14.052578+0000","last_undegraded":"2024-09-12T02:29:14.052578+0000","last_fullsized":"2024-09-12T02:29:14.052578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42203,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":53,"num_write":26,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479758+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:28:53.479758+0000","last_peered":"2024-09-12T02:28:53.479758+0000","last_clean":"2024-09-12T02:28:53.479758+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:28:53.479758+0000","last_undegraded":"2024-09-12T02:28:53.479758+0000","last_fullsized":"2024-09-12T02:28:53.479758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036319+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:05.036319+0000","last_peered":"2024-09-12T02:29:05.036319+0000","last_clean":"2024-09-12T02:29:05.036319+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:05.036319+0000","last_undegraded":"2024-09-12T02:29:05.036319+0000","last_fullsized":"2024-09-12T02:29:05.036319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402422+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:28:53.402422+0000","last_peered":"2024-09-12T02:28:53.402422+0000","last_clean":"2024-09-12T02:28:53.402422+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:28:53.402422+0000","last_undegraded":"2024-09-12T02:28:53.402422+0000","last_fullsized":"2024-09-12T02:28:53.402422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033193+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:04.033193+0000","last_peered":"2024-09-12T02:29:04.033193+0000","last_clean":"2024-09-12T02:29:04.033193+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:04.033193+0000","last_undegraded":"2024-09-12T02:29:04.033193+0000","last_fullsized":"2024-09-12T02:29:04.033193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481628+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:28:53.481628+0000","last_peered":"2024-09-12T02:28:53.481628+0000","last_clean":"2024-09-12T02:28:53.481628+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:28:53.481628+0000","last_undegraded":"2024-09-12T02:28:53.481628+0000","last_fullsized":"2024-09-12T02:28:53.481628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.053539+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:29:14.053539+0000","last_peered":"2024-09-12T02:29:14.053539+0000","last_clean":"2024-09-12T02:29:14.053539+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:29:14.053539+0000","last_undegraded":"2024-09-12T02:29:14.053539+0000","last_fullsized":"2024-09-12T02:29:14.053539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481395+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:28:53.481395+0000","last_peered":"2024-09-12T02:28:53.481395+0000","last_clean":"2024-09-12T02:28:53.481395+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:28:53.481395+0000","last_undegraded":"2024-09-12T02:28:53.481395+0000","last_fullsized":"2024-09-12T02:28:53.481395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033839+0000","last_change":"2024-09-12T02:28:50.033239+0000","last_active":"2024-09-12T02:29:04.033839+0000","last_peered":"2024-09-12T02:29:04.033839+0000","last_clean":"2024-09-12T02:29:04.033839+0000","last_became_active":"2024-09-12T02:28:50.032874+0000","last_became_peered":"2024-09-12T02:28:50.032874+0000","last_unstale":"2024-09-12T02:29:04.033839+0000","last_undegraded":"2024-09-12T02:29:04.033839+0000","last_fullsized":"2024-09-12T02:29:04.033839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:41.855728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479807+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:28:53.479807+0000","last_peered":"2024-09-12T02:28:53.479807+0000","last_clean":"2024-09-12T02:28:53.479807+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:28:53.479807+0000","last_undegraded":"2024-09-12T02:28:53.479807+0000","last_fullsized":"2024-09-12T02:28:53.479807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.016226+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:03.016226+0000","last_peered":"2024-09-12T02:29:03.016226+0000","last_clean":"2024-09-12T02:29:03.016226+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:03.016226+0000","last_undegraded":"2024-09-12T02:29:03.016226+0000","last_fullsized":"2024-09-12T02:29:03.016226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966743+0000","last_change":"2024-09-12T02:28:51.990178+0000","last_active":"2024-09-12T02:28:52.966743+0000","last_peered":"2024-09-12T02:28:52.966743+0000","last_clean":"2024-09-12T02:28:52.966743+0000","last_became_active":"2024-09-12T02:28:51.989576+0000","last_became_peered":"2024-09-12T02:28:51.989576+0000","last_unstale":"2024-09-12T02:28:52.966743+0000","last_undegraded":"2024-09-12T02:28:52.966743+0000","last_fullsized":"2024-09-12T02:28:52.966743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:30.697819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033539+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:04.033539+0000","last_peered":"2024-09-12T02:29:04.033539+0000","last_clean":"2024-09-12T02:29:04.033539+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:04.033539+0000","last_undegraded":"2024-09-12T02:29:04.033539+0000","last_fullsized":"2024-09-12T02:29:04.033539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481818+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:28:53.481818+0000","last_peered":"2024-09-12T02:28:53.481818+0000","last_clean":"2024-09-12T02:28:53.481818+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:28:53.481818+0000","last_undegraded":"2024-09-12T02:28:53.481818+0000","last_fullsized":"2024-09-12T02:28:53.481818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.031701+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:04.031701+0000","last_peered":"2024-09-12T02:29:04.031701+0000","last_clean":"2024-09-12T02:29:04.031701+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:04.031701+0000","last_undegraded":"2024-09-12T02:29:04.031701+0000","last_fullsized":"2024-09-12T02:29:04.031701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481617+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:28:53.481617+0000","last_peered":"2024-09-12T02:28:53.481617+0000","last_clean":"2024-09-12T02:28:53.481617+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:28:53.481617+0000","last_undegraded":"2024-09-12T02:28:53.481617+0000","last_fullsized":"2024-09-12T02:28:53.481617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:13.050637+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:29:13.050637+0000","last_peered":"2024-09-12T02:29:13.050637+0000","last_clean":"2024-09-12T02:29:13.050637+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:29:13.050637+0000","last_undegraded":"2024-09-12T02:29:13.050637+0000","last_fullsized":"2024-09-12T02:29:13.050637+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481965+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:28:53.481965+0000","last_peered":"2024-09-12T02:28:53.481965+0000","last_clean":"2024-09-12T02:28:53.481965+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:28:53.481965+0000","last_undegraded":"2024-09-12T02:28:53.481965+0000","last_fullsized":"2024-09-12T02:28:53.481965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481735+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:28:53.481735+0000","last_peered":"2024-09-12T02:28:53.481735+0000","last_clean":"2024-09-12T02:28:53.481735+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:28:53.481735+0000","last_undegraded":"2024-09-12T02:28:53.481735+0000","last_fullsized":"2024-09-12T02:28:53.481735+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036835+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:05.036835+0000","last_peered":"2024-09-12T02:29:05.036835+0000","last_clean":"2024-09-12T02:29:05.036835+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:05.036835+0000","last_undegraded":"2024-09-12T02:29:05.036835+0000","last_fullsized":"2024-09-12T02:29:05.036835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966471+0000","last_change":"2024-09-12T02:28:51.985711+0000","last_active":"2024-09-12T02:28:52.966471+0000","last_peered":"2024-09-12T02:28:52.966471+0000","last_clean":"2024-09-12T02:28:52.966471+0000","last_became_active":"2024-09-12T02:28:51.985376+0000","last_became_peered":"2024-09-12T02:28:51.985376+0000","last_unstale":"2024-09-12T02:28:52.966471+0000","last_undegraded":"2024-09-12T02:28:52.966471+0000","last_fullsized":"2024-09-12T02:28:52.966471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:27.164856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.020136+0000","last_change":"2024-09-12T02:28:49.864384+0000","last_active":"2024-09-12T02:29:02.020136+0000","last_peered":"2024-09-12T02:29:02.020136+0000","last_clean":"2024-09-12T02:29:02.020136+0000","last_became_active":"2024-09-12T02:28:49.863397+0000","last_became_peered":"2024-09-12T02:28:49.863397+0000","last_unstale":"2024-09-12T02:29:02.020136+0000","last_undegraded":"2024-09-12T02:29:02.020136+0000","last_fullsized":"2024-09-12T02:29:02.020136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:03.764542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402509+0000","last_change":"2024-09-12T02:28:51.984139+0000","last_active":"2024-09-12T02:28:53.402509+0000","last_peered":"2024-09-12T02:28:53.402509+0000","last_clean":"2024-09-12T02:28:53.402509+0000","last_became_active":"2024-09-12T02:28:51.983844+0000","last_became_peered":"2024-09-12T02:28:51.983844+0000","last_unstale":"2024-09-12T02:28:53.402509+0000","last_undegraded":"2024-09-12T02:28:53.402509+0000","last_fullsized":"2024-09-12T02:28:53.402509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:48.347351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:16.055269+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:29:16.055269+0000","last_peered":"2024-09-12T02:29:16.055269+0000","last_clean":"2024-09-12T02:29:16.055269+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:29:16.055269+0000","last_undegraded":"2024-09-12T02:29:16.055269+0000","last_fullsized":"2024-09-12T02:29:16.055269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480502+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:28:53.480502+0000","last_peered":"2024-09-12T02:28:53.480502+0000","last_clean":"2024-09-12T02:28:53.480502+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:28:53.480502+0000","last_undegraded":"2024-09-12T02:28:53.480502+0000","last_fullsized":"2024-09-12T02:28:53.480502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:16.053765+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:29:16.053765+0000","last_peered":"2024-09-12T02:29:16.053765+0000","last_clean":"2024-09-12T02:29:16.053765+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:29:16.053765+0000","last_undegraded":"2024-09-12T02:29:16.053765+0000","last_fullsized":"2024-09-12T02:29:16.053765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479140+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:28:53.479140+0000","last_peered":"2024-09-12T02:28:53.479140+0000","last_clean":"2024-09-12T02:28:53.479140+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:28:53.479140+0000","last_undegraded":"2024-09-12T02:28:53.479140+0000","last_fullsized":"2024-09-12T02:28:53.479140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.591213+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:28:53.591213+0000","last_peered":"2024-09-12T02:28:53.591213+0000","last_clean":"2024-09-12T02:28:53.591213+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:28:53.591213+0000","last_undegraded":"2024-09-12T02:28:53.591213+0000","last_fullsized":"2024-09-12T02:28:53.591213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:54.883140+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:28:54.883140+0000","last_peered":"2024-09-12T02:28:54.883140+0000","last_clean":"2024-09-12T02:28:54.883140+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:28:54.883140+0000","last_undegraded":"2024-09-12T02:28:54.883140+0000","last_fullsized":"2024-09-12T02:28:54.883140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.034009+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:04.034009+0000","last_peered":"2024-09-12T02:29:04.034009+0000","last_clean":"2024-09-12T02:29:04.034009+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:04.034009+0000","last_undegraded":"2024-09-12T02:29:04.034009+0000","last_fullsized":"2024-09-12T02:29:04.034009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402823+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:28:53.402823+0000","last_peered":"2024-09-12T02:28:53.402823+0000","last_clean":"2024-09-12T02:28:53.402823+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:28:53.402823+0000","last_undegraded":"2024-09-12T02:28:53.402823+0000","last_fullsized":"2024-09-12T02:28:53.402823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:09.480352+0000","last_change":"2024-09-12T02:28:49.858046+0000","last_active":"2024-09-12T02:29:09.480352+0000","last_peered":"2024-09-12T02:29:09.480352+0000","last_clean":"2024-09-12T02:29:09.480352+0000","last_became_active":"2024-09-12T02:28:49.857728+0000","last_became_peered":"2024-09-12T02:28:49.857728+0000","last_unstale":"2024-09-12T02:29:09.480352+0000","last_undegraded":"2024-09-12T02:29:09.480352+0000","last_fullsized":"2024-09-12T02:29:09.480352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:09.743162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966355+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:28:52.966355+0000","last_peered":"2024-09-12T02:28:52.966355+0000","last_clean":"2024-09-12T02:28:52.966355+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:28:52.966355+0000","last_undegraded":"2024-09-12T02:28:52.966355+0000","last_fullsized":"2024-09-12T02:28:52.966355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033427+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:04.033427+0000","last_peered":"2024-09-12T02:29:04.033427+0000","last_clean":"2024-09-12T02:29:04.033427+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:04.033427+0000","last_undegraded":"2024-09-12T02:29:04.033427+0000","last_fullsized":"2024-09-12T02:29:04.033427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480887+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:28:53.480887+0000","last_peered":"2024-09-12T02:28:53.480887+0000","last_clean":"2024-09-12T02:28:53.480887+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:28:53.480887+0000","last_undegraded":"2024-09-12T02:28:53.480887+0000","last_fullsized":"2024-09-12T02:28:53.480887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.011101+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:01.011101+0000","last_peered":"2024-09-12T02:29:01.011101+0000","last_clean":"2024-09-12T02:29:01.011101+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:01.011101+0000","last_undegraded":"2024-09-12T02:29:01.011101+0000","last_fullsized":"2024-09-12T02:29:01.011101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478924+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:28:53.478924+0000","last_peered":"2024-09-12T02:28:53.478924+0000","last_clean":"2024-09-12T02:28:53.478924+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:28:53.478924+0000","last_undegraded":"2024-09-12T02:28:53.478924+0000","last_fullsized":"2024-09-12T02:28:53.478924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033344+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:04.033344+0000","last_peered":"2024-09-12T02:29:04.033344+0000","last_clean":"2024-09-12T02:29:04.033344+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:04.033344+0000","last_undegraded":"2024-09-12T02:29:04.033344+0000","last_fullsized":"2024-09-12T02:29:04.033344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966775+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:28:52.966775+0000","last_peered":"2024-09-12T02:28:52.966775+0000","last_clean":"2024-09-12T02:28:52.966775+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:28:52.966775+0000","last_undegraded":"2024-09-12T02:28:52.966775+0000","last_fullsized":"2024-09-12T02:28:52.966775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.026497+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:03.026497+0000","last_peered":"2024-09-12T02:29:03.026497+0000","last_clean":"2024-09-12T02:29:03.026497+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:03.026497+0000","last_undegraded":"2024-09-12T02:29:03.026497+0000","last_fullsized":"2024-09-12T02:29:03.026497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966327+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:28:52.966327+0000","last_peered":"2024-09-12T02:28:52.966327+0000","last_clean":"2024-09-12T02:28:52.966327+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:28:52.966327+0000","last_undegraded":"2024-09-12T02:28:52.966327+0000","last_fullsized":"2024-09-12T02:28:52.966327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.013723+0000","last_change":"2024-09-12T02:28:49.865788+0000","last_active":"2024-09-12T02:29:01.013723+0000","last_peered":"2024-09-12T02:29:01.013723+0000","last_clean":"2024-09-12T02:29:01.013723+0000","last_became_active":"2024-09-12T02:28:49.865434+0000","last_became_peered":"2024-09-12T02:28:49.865434+0000","last_unstale":"2024-09-12T02:29:01.013723+0000","last_undegraded":"2024-09-12T02:29:01.013723+0000","last_fullsized":"2024-09-12T02:29:01.013723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:39.707131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481528+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:28:53.481528+0000","last_peered":"2024-09-12T02:28:53.481528+0000","last_clean":"2024-09-12T02:28:53.481528+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:28:53.481528+0000","last_undegraded":"2024-09-12T02:28:53.481528+0000","last_fullsized":"2024-09-12T02:28:53.481528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480253+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:28:53.480253+0000","last_peered":"2024-09-12T02:28:53.480253+0000","last_clean":"2024-09-12T02:28:53.480253+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:28:53.480253+0000","last_undegraded":"2024-09-12T02:28:53.480253+0000","last_fullsized":"2024-09-12T02:28:53.480253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033577+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:04.033577+0000","last_peered":"2024-09-12T02:29:04.033577+0000","last_clean":"2024-09-12T02:29:04.033577+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:04.033577+0000","last_undegraded":"2024-09-12T02:29:04.033577+0000","last_fullsized":"2024-09-12T02:29:04.033577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967078+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:28:52.967078+0000","last_peered":"2024-09-12T02:28:52.967078+0000","last_clean":"2024-09-12T02:28:52.967078+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:28:52.967078+0000","last_undegraded":"2024-09-12T02:28:52.967078+0000","last_fullsized":"2024-09-12T02:28:52.967078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036965+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:05.036965+0000","last_peered":"2024-09-12T02:29:05.036965+0000","last_clean":"2024-09-12T02:29:05.036965+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:05.036965+0000","last_undegraded":"2024-09-12T02:29:05.036965+0000","last_fullsized":"2024-09-12T02:29:05.036965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481139+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:28:53.481139+0000","last_peered":"2024-09-12T02:28:53.481139+0000","last_clean":"2024-09-12T02:28:53.481139+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:28:53.481139+0000","last_undegraded":"2024-09-12T02:28:53.481139+0000","last_fullsized":"2024-09-12T02:28:53.481139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485360+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:28:53.485360+0000","last_peered":"2024-09-12T02:28:53.485360+0000","last_clean":"2024-09-12T02:28:53.485360+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:28:53.485360+0000","last_undegraded":"2024-09-12T02:28:53.485360+0000","last_fullsized":"2024-09-12T02:28:53.485360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966410+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:28:52.966410+0000","last_peered":"2024-09-12T02:28:52.966410+0000","last_clean":"2024-09-12T02:28:52.966410+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:28:52.966410+0000","last_undegraded":"2024-09-12T02:28:52.966410+0000","last_fullsized":"2024-09-12T02:28:52.966410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:12.048280+0000","last_change":"2024-09-12T02:28:49.864972+0000","last_active":"2024-09-12T02:29:12.048280+0000","last_peered":"2024-09-12T02:29:12.048280+0000","last_clean":"2024-09-12T02:29:12.048280+0000","last_became_active":"2024-09-12T02:28:49.864553+0000","last_became_peered":"2024-09-12T02:28:49.864553+0000","last_unstale":"2024-09-12T02:29:12.048280+0000","last_undegraded":"2024-09-12T02:29:12.048280+0000","last_fullsized":"2024-09-12T02:29:12.048280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:40.359699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49411,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":145,"num_read_kb":127,"num_write":227,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":148233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":418514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1052139,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":418444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":418822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1011735,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":418554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1010627,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":418415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":461497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":461670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":419500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":44348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":44332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:19.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:29:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:19 smithi134 ceph-mon[35091]: pgmap v292: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 16 op/s 2024-09-12T02:29:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:19 smithi173 ceph-mon[35036]: pgmap v292: 97 pgs: 97 active+clean; 625 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 16 op/s 2024-09-12T02:29:20.141 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:20.540 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:20 smithi001 ceph-mon[31252]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:20.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 -- 172.21.15.1:0/2445422252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004102790 msgr2=0x7f10041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 --2- 172.21.15.1:0/2445422252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004102790 0x7f10041067e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009900 tx=0x7f0ff402a410 comp rx=0 tx=0).stop 2024-09-12T02:29:20.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 -- 172.21.15.1:0/2445422252 shutdown_connections 2024-09-12T02:29:20.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 --2- 172.21.15.1:0/2445422252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004102790 0x7f10041067e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 --2- 172.21.15.1:0/2445422252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106f10 0x7f100410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 --2- 172.21.15.1:0/2445422252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004101de0 0x7f10041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 -- 172.21.15.1:0/2445422252 >> 172.21.15.1:0/2445422252 conn(0x7f10040fd8c0 msgr2=0x7f10040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 -- 172.21.15.1:0/2445422252 shutdown_connections 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.623+0000 7f100c2d2640 1 -- 172.21.15.1:0/2445422252 wait complete. 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 Processor -- start 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 -- start start 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101de0 0x7f1004198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004102790 0x7f10041989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111f70 con 0x7f1004106f10 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111df0 con 0x7f1004101de0 2024-09-12T02:29:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100c2d2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10041120f0 con 0x7f1004102790 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51248/0 (socket says 172.21.15.1:51248) 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 -- 172.21.15.1:0/245141914 learned_addr learned my addr 172.21.15.1:0/245141914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100986d640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004102790 0x7f10041989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a06e640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101de0 0x7f1004198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 -- 172.21.15.1:0/245141914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004102790 msgr2=0x7f10041989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004102790 0x7f10041989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 -- 172.21.15.1:0/245141914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101de0 msgr2=0x7f1004198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101de0 0x7f1004198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.624+0000 7f100a86f640 1 -- 172.21.15.1:0/245141914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100419d440 con 0x7f1004106f10 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f100a86f640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009fd0 tx=0x7f0ffc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc017070 con 0x7f1004106f10 2024-09-12T02:29:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100419d730 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041a5010 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ffc003e50 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.625+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0106c0 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.626+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10041032c0 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.627+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0ffc003970 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.628+0000 7f0ffb7fe640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 0x7f0ff00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.628+0000 7f100a06e640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 0x7f0ff00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.628+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0ffc0cee50 con 0x7f1004106f10 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.628+0000 7f100a06e640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 0x7f0ff00a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10000058c0 tx=0x7f100000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.632+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ffc09bd00 con 0x7f1004106f10 2024-09-12T02:29:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.803+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1004062630 con 0x7f0ff00a2c10 2024-09-12T02:29:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.811+0000 7f0ffb7fe640 1 -- 172.21.15.1:0/245141914 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258912 (secure 0 0 0) 0x7f1004062630 con 0x7f0ff00a2c10 2024-09-12T02:29:20.813 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:29:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 msgr2=0x7f0ff00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 0x7f0ff00a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10000058c0 tx=0x7f100000a4c0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 msgr2=0x7f100419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009fd0 tx=0x7f0ffc00b260 comp rx=0 tx=0).stop 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 shutdown_connections 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ff00a2c10 0x7f0ff00a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1004106f10 0x7f100419cd60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1004102790 0x7f10041989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 --2- 172.21.15.1:0/245141914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101de0 0x7f1004198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 >> 172.21.15.1:0/245141914 conn(0x7f10040fd8c0 msgr2=0x7f10040fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 shutdown_connections 2024-09-12T02:29:20.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:20.814+0000 7f100c2d2640 1 -- 172.21.15.1:0/245141914 wait complete. 2024-09-12T02:29:20.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:20 smithi134 ceph-mon[35091]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:20.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:20 smithi173 ceph-mon[35036]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:21.657 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-12T02:29:19.958656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652255,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":421,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380836,"kb_used_data":10788,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560988,"statfs":{"total":1151940427776,"available":1151550451712,"internally_reserved":0,"allocated":11046912,"data_stored":6964629,"data_compressed":108882,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53550,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":130,"num_write":36,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003012"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966878+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:28:52.966878+0000","last_peered":"2024-09-12T02:28:52.966878+0000","last_clean":"2024-09-12T02:28:52.966878+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:28:52.966878+0000","last_undegraded":"2024-09-12T02:28:52.966878+0000","last_fullsized":"2024-09-12T02:28:52.966878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480535+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:28:53.480535+0000","last_peered":"2024-09-12T02:28:53.480535+0000","last_clean":"2024-09-12T02:28:53.480535+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:28:53.480535+0000","last_undegraded":"2024-09-12T02:28:53.480535+0000","last_fullsized":"2024-09-12T02:28:53.480535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480475+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:28:53.480475+0000","last_peered":"2024-09-12T02:28:53.480475+0000","last_clean":"2024-09-12T02:28:53.480475+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:28:53.480475+0000","last_undegraded":"2024-09-12T02:28:53.480475+0000","last_fullsized":"2024-09-12T02:28:53.480475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.355561+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:28:53.355561+0000","last_peered":"2024-09-12T02:28:53.355561+0000","last_clean":"2024-09-12T02:28:53.355561+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:28:53.355561+0000","last_undegraded":"2024-09-12T02:28:53.355561+0000","last_fullsized":"2024-09-12T02:28:53.355561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478913+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:28:53.478913+0000","last_peered":"2024-09-12T02:28:53.478913+0000","last_clean":"2024-09-12T02:28:53.478913+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:28:53.478913+0000","last_undegraded":"2024-09-12T02:28:53.478913+0000","last_fullsized":"2024-09-12T02:28:53.478913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478822+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:28:53.478822+0000","last_peered":"2024-09-12T02:28:53.478822+0000","last_clean":"2024-09-12T02:28:53.478822+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:28:53.478822+0000","last_undegraded":"2024-09-12T02:28:53.478822+0000","last_fullsized":"2024-09-12T02:28:53.478822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481388+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:28:53.481388+0000","last_peered":"2024-09-12T02:28:53.481388+0000","last_clean":"2024-09-12T02:28:53.481388+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:28:53.481388+0000","last_undegraded":"2024-09-12T02:28:53.481388+0000","last_fullsized":"2024-09-12T02:28:53.481388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.965926+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:28:52.965926+0000","last_peered":"2024-09-12T02:28:52.965926+0000","last_clean":"2024-09-12T02:28:52.965926+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:28:52.965926+0000","last_undegraded":"2024-09-12T02:28:52.965926+0000","last_fullsized":"2024-09-12T02:28:52.965926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967413+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:28:52.967413+0000","last_peered":"2024-09-12T02:28:52.967413+0000","last_clean":"2024-09-12T02:28:52.967413+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:28:52.967413+0000","last_undegraded":"2024-09-12T02:28:52.967413+0000","last_fullsized":"2024-09-12T02:28:52.967413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479236+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:28:53.479236+0000","last_peered":"2024-09-12T02:28:53.479236+0000","last_clean":"2024-09-12T02:28:53.479236+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:28:53.479236+0000","last_undegraded":"2024-09-12T02:28:53.479236+0000","last_fullsized":"2024-09-12T02:28:53.479236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481826+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:28:53.481826+0000","last_peered":"2024-09-12T02:28:53.481826+0000","last_clean":"2024-09-12T02:28:53.481826+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:28:53.481826+0000","last_undegraded":"2024-09-12T02:28:53.481826+0000","last_fullsized":"2024-09-12T02:28:53.481826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.355639+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:28:53.355639+0000","last_peered":"2024-09-12T02:28:53.355639+0000","last_clean":"2024-09-12T02:28:53.355639+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:28:53.355639+0000","last_undegraded":"2024-09-12T02:28:53.355639+0000","last_fullsized":"2024-09-12T02:28:53.355639+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402713+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:28:53.402713+0000","last_peered":"2024-09-12T02:28:53.402713+0000","last_clean":"2024-09-12T02:28:53.402713+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:28:53.402713+0000","last_undegraded":"2024-09-12T02:28:53.402713+0000","last_fullsized":"2024-09-12T02:28:53.402713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480739+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:28:53.480739+0000","last_peered":"2024-09-12T02:28:53.480739+0000","last_clean":"2024-09-12T02:28:53.480739+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:28:53.480739+0000","last_undegraded":"2024-09-12T02:28:53.480739+0000","last_fullsized":"2024-09-12T02:28:53.480739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480521+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:28:53.480521+0000","last_peered":"2024-09-12T02:28:53.480521+0000","last_clean":"2024-09-12T02:28:53.480521+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:28:53.480521+0000","last_undegraded":"2024-09-12T02:28:53.480521+0000","last_fullsized":"2024-09-12T02:28:53.480521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966895+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:28:52.966895+0000","last_peered":"2024-09-12T02:28:52.966895+0000","last_clean":"2024-09-12T02:28:52.966895+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:28:52.966895+0000","last_undegraded":"2024-09-12T02:28:52.966895+0000","last_fullsized":"2024-09-12T02:28:52.966895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966880+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:28:52.966880+0000","last_peered":"2024-09-12T02:28:52.966880+0000","last_clean":"2024-09-12T02:28:52.966880+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:28:52.966880+0000","last_undegraded":"2024-09-12T02:28:52.966880+0000","last_fullsized":"2024-09-12T02:28:52.966880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479767+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:28:53.479767+0000","last_peered":"2024-09-12T02:28:53.479767+0000","last_clean":"2024-09-12T02:28:53.479767+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:28:53.479767+0000","last_undegraded":"2024-09-12T02:28:53.479767+0000","last_fullsized":"2024-09-12T02:28:53.479767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485793+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:28:53.485793+0000","last_peered":"2024-09-12T02:28:53.485793+0000","last_clean":"2024-09-12T02:28:53.485793+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:28:53.485793+0000","last_undegraded":"2024-09-12T02:28:53.485793+0000","last_fullsized":"2024-09-12T02:28:53.485793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966540+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:28:52.966540+0000","last_peered":"2024-09-12T02:28:52.966540+0000","last_clean":"2024-09-12T02:28:52.966540+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:28:52.966540+0000","last_undegraded":"2024-09-12T02:28:52.966540+0000","last_fullsized":"2024-09-12T02:28:52.966540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402889+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:28:53.402889+0000","last_peered":"2024-09-12T02:28:53.402889+0000","last_clean":"2024-09-12T02:28:53.402889+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:28:53.402889+0000","last_undegraded":"2024-09-12T02:28:53.402889+0000","last_fullsized":"2024-09-12T02:28:53.402889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967068+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:28:52.967068+0000","last_peered":"2024-09-12T02:28:52.967068+0000","last_clean":"2024-09-12T02:28:52.967068+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:28:52.967068+0000","last_undegraded":"2024-09-12T02:28:52.967068+0000","last_fullsized":"2024-09-12T02:28:52.967068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966367+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:28:52.966367+0000","last_peered":"2024-09-12T02:28:52.966367+0000","last_clean":"2024-09-12T02:28:52.966367+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:28:52.966367+0000","last_undegraded":"2024-09-12T02:28:52.966367+0000","last_fullsized":"2024-09-12T02:28:52.966367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480327+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:28:53.480327+0000","last_peered":"2024-09-12T02:28:53.480327+0000","last_clean":"2024-09-12T02:28:53.480327+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:28:53.480327+0000","last_undegraded":"2024-09-12T02:28:53.480327+0000","last_fullsized":"2024-09-12T02:28:53.480327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966223+0000","last_change":"2024-09-12T02:28:51.983288+0000","last_active":"2024-09-12T02:28:52.966223+0000","last_peered":"2024-09-12T02:28:52.966223+0000","last_clean":"2024-09-12T02:28:52.966223+0000","last_became_active":"2024-09-12T02:28:51.982982+0000","last_became_peered":"2024-09-12T02:28:51.982982+0000","last_unstale":"2024-09-12T02:28:52.966223+0000","last_undegraded":"2024-09-12T02:28:52.966223+0000","last_fullsized":"2024-09-12T02:28:52.966223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.052613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.486698+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:28:53.486698+0000","last_peered":"2024-09-12T02:28:53.486698+0000","last_clean":"2024-09-12T02:28:53.486698+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:28:53.486698+0000","last_undegraded":"2024-09-12T02:28:53.486698+0000","last_fullsized":"2024-09-12T02:28:53.486698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966694+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:28:52.966694+0000","last_peered":"2024-09-12T02:28:52.966694+0000","last_clean":"2024-09-12T02:28:52.966694+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:28:52.966694+0000","last_undegraded":"2024-09-12T02:28:52.966694+0000","last_fullsized":"2024-09-12T02:28:52.966694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402608+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:28:53.402608+0000","last_peered":"2024-09-12T02:28:53.402608+0000","last_clean":"2024-09-12T02:28:53.402608+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:28:53.402608+0000","last_undegraded":"2024-09-12T02:28:53.402608+0000","last_fullsized":"2024-09-12T02:28:53.402608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481016+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:28:53.481016+0000","last_peered":"2024-09-12T02:28:53.481016+0000","last_clean":"2024-09-12T02:28:53.481016+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:28:53.481016+0000","last_undegraded":"2024-09-12T02:28:53.481016+0000","last_fullsized":"2024-09-12T02:28:53.481016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485243+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:28:53.485243+0000","last_peered":"2024-09-12T02:28:53.485243+0000","last_clean":"2024-09-12T02:28:53.485243+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:28:53.485243+0000","last_undegraded":"2024-09-12T02:28:53.485243+0000","last_fullsized":"2024-09-12T02:28:53.485243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.486436+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:28:53.486436+0000","last_peered":"2024-09-12T02:28:53.486436+0000","last_clean":"2024-09-12T02:28:53.486436+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:28:53.486436+0000","last_undegraded":"2024-09-12T02:28:53.486436+0000","last_fullsized":"2024-09-12T02:28:53.486436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966477+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:28:52.966477+0000","last_peered":"2024-09-12T02:28:52.966477+0000","last_clean":"2024-09-12T02:28:52.966477+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:28:52.966477+0000","last_undegraded":"2024-09-12T02:28:52.966477+0000","last_fullsized":"2024-09-12T02:28:52.966477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481855+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:28:53.481855+0000","last_peered":"2024-09-12T02:28:53.481855+0000","last_clean":"2024-09-12T02:28:53.481855+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:28:53.481855+0000","last_undegraded":"2024-09-12T02:28:53.481855+0000","last_fullsized":"2024-09-12T02:28:53.481855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.052050+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:29:14.052050+0000","last_peered":"2024-09-12T02:29:14.052050+0000","last_clean":"2024-09-12T02:29:14.052050+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:29:14.052050+0000","last_undegraded":"2024-09-12T02:29:14.052050+0000","last_fullsized":"2024-09-12T02:29:14.052050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.483183+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:28:53.483183+0000","last_peered":"2024-09-12T02:28:53.483183+0000","last_clean":"2024-09-12T02:28:53.483183+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:28:53.483183+0000","last_undegraded":"2024-09-12T02:28:53.483183+0000","last_fullsized":"2024-09-12T02:28:53.483183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.026807+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:03.026807+0000","last_peered":"2024-09-12T02:29:03.026807+0000","last_clean":"2024-09-12T02:29:03.026807+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:03.026807+0000","last_undegraded":"2024-09-12T02:29:03.026807+0000","last_fullsized":"2024-09-12T02:29:03.026807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.021441+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:02.021441+0000","last_peered":"2024-09-12T02:29:02.021441+0000","last_clean":"2024-09-12T02:29:02.021441+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:02.021441+0000","last_undegraded":"2024-09-12T02:29:02.021441+0000","last_fullsized":"2024-09-12T02:29:02.021441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966024+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:28:52.966024+0000","last_peered":"2024-09-12T02:28:52.966024+0000","last_clean":"2024-09-12T02:28:52.966024+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:28:52.966024+0000","last_undegraded":"2024-09-12T02:28:52.966024+0000","last_fullsized":"2024-09-12T02:28:52.966024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.032879+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:04.032879+0000","last_peered":"2024-09-12T02:29:04.032879+0000","last_clean":"2024-09-12T02:29:04.032879+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:04.032879+0000","last_undegraded":"2024-09-12T02:29:04.032879+0000","last_fullsized":"2024-09-12T02:29:04.032879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479540+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:28:53.479540+0000","last_peered":"2024-09-12T02:28:53.479540+0000","last_clean":"2024-09-12T02:28:53.479540+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:28:53.479540+0000","last_undegraded":"2024-09-12T02:28:53.479540+0000","last_fullsized":"2024-09-12T02:28:53.479540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:19.057910+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:29:19.057910+0000","last_peered":"2024-09-12T02:29:19.057910+0000","last_clean":"2024-09-12T02:29:19.057910+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:29:19.057910+0000","last_undegraded":"2024-09-12T02:29:19.057910+0000","last_fullsized":"2024-09-12T02:29:19.057910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967343+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:28:52.967343+0000","last_peered":"2024-09-12T02:28:52.967343+0000","last_clean":"2024-09-12T02:28:52.967343+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:28:52.967343+0000","last_undegraded":"2024-09-12T02:28:52.967343+0000","last_fullsized":"2024-09-12T02:28:52.967343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033308+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:04.033308+0000","last_peered":"2024-09-12T02:29:04.033308+0000","last_clean":"2024-09-12T02:29:04.033308+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:04.033308+0000","last_undegraded":"2024-09-12T02:29:04.033308+0000","last_fullsized":"2024-09-12T02:29:04.033308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481121+0000","last_change":"2024-09-12T02:28:51.983705+0000","last_active":"2024-09-12T02:28:53.481121+0000","last_peered":"2024-09-12T02:28:53.481121+0000","last_clean":"2024-09-12T02:28:53.481121+0000","last_became_active":"2024-09-12T02:28:51.982525+0000","last_became_peered":"2024-09-12T02:28:51.982525+0000","last_unstale":"2024-09-12T02:28:53.481121+0000","last_undegraded":"2024-09-12T02:28:53.481121+0000","last_fullsized":"2024-09-12T02:28:53.481121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:39.045747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.025296+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:03.025296+0000","last_peered":"2024-09-12T02:29:03.025296+0000","last_clean":"2024-09-12T02:29:03.025296+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:03.025296+0000","last_undegraded":"2024-09-12T02:29:03.025296+0000","last_fullsized":"2024-09-12T02:29:03.025296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967347+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:28:52.967347+0000","last_peered":"2024-09-12T02:28:52.967347+0000","last_clean":"2024-09-12T02:28:52.967347+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:28:52.967347+0000","last_undegraded":"2024-09-12T02:28:52.967347+0000","last_fullsized":"2024-09-12T02:28:52.967347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:19.058696+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:29:19.058696+0000","last_peered":"2024-09-12T02:29:19.058696+0000","last_clean":"2024-09-12T02:29:19.058696+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:29:19.058696+0000","last_undegraded":"2024-09-12T02:29:19.058696+0000","last_fullsized":"2024-09-12T02:29:19.058696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54445,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":70,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479758+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:28:53.479758+0000","last_peered":"2024-09-12T02:28:53.479758+0000","last_clean":"2024-09-12T02:28:53.479758+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:28:53.479758+0000","last_undegraded":"2024-09-12T02:28:53.479758+0000","last_fullsized":"2024-09-12T02:28:53.479758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036319+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:05.036319+0000","last_peered":"2024-09-12T02:29:05.036319+0000","last_clean":"2024-09-12T02:29:05.036319+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:05.036319+0000","last_undegraded":"2024-09-12T02:29:05.036319+0000","last_fullsized":"2024-09-12T02:29:05.036319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402422+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:28:53.402422+0000","last_peered":"2024-09-12T02:28:53.402422+0000","last_clean":"2024-09-12T02:28:53.402422+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:28:53.402422+0000","last_undegraded":"2024-09-12T02:28:53.402422+0000","last_fullsized":"2024-09-12T02:28:53.402422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033193+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:04.033193+0000","last_peered":"2024-09-12T02:29:04.033193+0000","last_clean":"2024-09-12T02:29:04.033193+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:04.033193+0000","last_undegraded":"2024-09-12T02:29:04.033193+0000","last_fullsized":"2024-09-12T02:29:04.033193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481628+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:28:53.481628+0000","last_peered":"2024-09-12T02:28:53.481628+0000","last_clean":"2024-09-12T02:28:53.481628+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:28:53.481628+0000","last_undegraded":"2024-09-12T02:28:53.481628+0000","last_fullsized":"2024-09-12T02:28:53.481628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:14.053539+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:29:14.053539+0000","last_peered":"2024-09-12T02:29:14.053539+0000","last_clean":"2024-09-12T02:29:14.053539+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:29:14.053539+0000","last_undegraded":"2024-09-12T02:29:14.053539+0000","last_fullsized":"2024-09-12T02:29:14.053539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481395+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:28:53.481395+0000","last_peered":"2024-09-12T02:28:53.481395+0000","last_clean":"2024-09-12T02:28:53.481395+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:28:53.481395+0000","last_undegraded":"2024-09-12T02:28:53.481395+0000","last_fullsized":"2024-09-12T02:28:53.481395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033839+0000","last_change":"2024-09-12T02:28:50.033239+0000","last_active":"2024-09-12T02:29:04.033839+0000","last_peered":"2024-09-12T02:29:04.033839+0000","last_clean":"2024-09-12T02:29:04.033839+0000","last_became_active":"2024-09-12T02:28:50.032874+0000","last_became_peered":"2024-09-12T02:28:50.032874+0000","last_unstale":"2024-09-12T02:29:04.033839+0000","last_undegraded":"2024-09-12T02:29:04.033839+0000","last_fullsized":"2024-09-12T02:29:04.033839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:41.855728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479807+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:28:53.479807+0000","last_peered":"2024-09-12T02:28:53.479807+0000","last_clean":"2024-09-12T02:28:53.479807+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:28:53.479807+0000","last_undegraded":"2024-09-12T02:28:53.479807+0000","last_fullsized":"2024-09-12T02:28:53.479807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.016226+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:03.016226+0000","last_peered":"2024-09-12T02:29:03.016226+0000","last_clean":"2024-09-12T02:29:03.016226+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:03.016226+0000","last_undegraded":"2024-09-12T02:29:03.016226+0000","last_fullsized":"2024-09-12T02:29:03.016226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966743+0000","last_change":"2024-09-12T02:28:51.990178+0000","last_active":"2024-09-12T02:28:52.966743+0000","last_peered":"2024-09-12T02:28:52.966743+0000","last_clean":"2024-09-12T02:28:52.966743+0000","last_became_active":"2024-09-12T02:28:51.989576+0000","last_became_peered":"2024-09-12T02:28:51.989576+0000","last_unstale":"2024-09-12T02:28:52.966743+0000","last_undegraded":"2024-09-12T02:28:52.966743+0000","last_fullsized":"2024-09-12T02:28:52.966743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:30.697819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033539+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:04.033539+0000","last_peered":"2024-09-12T02:29:04.033539+0000","last_clean":"2024-09-12T02:29:04.033539+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:04.033539+0000","last_undegraded":"2024-09-12T02:29:04.033539+0000","last_fullsized":"2024-09-12T02:29:04.033539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481818+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:28:53.481818+0000","last_peered":"2024-09-12T02:28:53.481818+0000","last_clean":"2024-09-12T02:28:53.481818+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:28:53.481818+0000","last_undegraded":"2024-09-12T02:28:53.481818+0000","last_fullsized":"2024-09-12T02:28:53.481818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.031701+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:04.031701+0000","last_peered":"2024-09-12T02:29:04.031701+0000","last_clean":"2024-09-12T02:29:04.031701+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:04.031701+0000","last_undegraded":"2024-09-12T02:29:04.031701+0000","last_fullsized":"2024-09-12T02:29:04.031701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481617+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:28:53.481617+0000","last_peered":"2024-09-12T02:28:53.481617+0000","last_clean":"2024-09-12T02:28:53.481617+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:28:53.481617+0000","last_undegraded":"2024-09-12T02:28:53.481617+0000","last_fullsized":"2024-09-12T02:28:53.481617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:18.057253+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:29:18.057253+0000","last_peered":"2024-09-12T02:29:18.057253+0000","last_clean":"2024-09-12T02:29:18.057253+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:29:18.057253+0000","last_undegraded":"2024-09-12T02:29:18.057253+0000","last_fullsized":"2024-09-12T02:29:18.057253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481965+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:28:53.481965+0000","last_peered":"2024-09-12T02:28:53.481965+0000","last_clean":"2024-09-12T02:28:53.481965+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:28:53.481965+0000","last_undegraded":"2024-09-12T02:28:53.481965+0000","last_fullsized":"2024-09-12T02:28:53.481965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481735+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:28:53.481735+0000","last_peered":"2024-09-12T02:28:53.481735+0000","last_clean":"2024-09-12T02:28:53.481735+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:28:53.481735+0000","last_undegraded":"2024-09-12T02:28:53.481735+0000","last_fullsized":"2024-09-12T02:28:53.481735+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036835+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:05.036835+0000","last_peered":"2024-09-12T02:29:05.036835+0000","last_clean":"2024-09-12T02:29:05.036835+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:05.036835+0000","last_undegraded":"2024-09-12T02:29:05.036835+0000","last_fullsized":"2024-09-12T02:29:05.036835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966471+0000","last_change":"2024-09-12T02:28:51.985711+0000","last_active":"2024-09-12T02:28:52.966471+0000","last_peered":"2024-09-12T02:28:52.966471+0000","last_clean":"2024-09-12T02:28:52.966471+0000","last_became_active":"2024-09-12T02:28:51.985376+0000","last_became_peered":"2024-09-12T02:28:51.985376+0000","last_unstale":"2024-09-12T02:28:52.966471+0000","last_undegraded":"2024-09-12T02:28:52.966471+0000","last_fullsized":"2024-09-12T02:28:52.966471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:27.164856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:02.020136+0000","last_change":"2024-09-12T02:28:49.864384+0000","last_active":"2024-09-12T02:29:02.020136+0000","last_peered":"2024-09-12T02:29:02.020136+0000","last_clean":"2024-09-12T02:29:02.020136+0000","last_became_active":"2024-09-12T02:28:49.863397+0000","last_became_peered":"2024-09-12T02:28:49.863397+0000","last_unstale":"2024-09-12T02:29:02.020136+0000","last_undegraded":"2024-09-12T02:29:02.020136+0000","last_fullsized":"2024-09-12T02:29:02.020136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:03.764542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402509+0000","last_change":"2024-09-12T02:28:51.984139+0000","last_active":"2024-09-12T02:28:53.402509+0000","last_peered":"2024-09-12T02:28:53.402509+0000","last_clean":"2024-09-12T02:28:53.402509+0000","last_became_active":"2024-09-12T02:28:51.983844+0000","last_became_peered":"2024-09-12T02:28:51.983844+0000","last_unstale":"2024-09-12T02:28:53.402509+0000","last_undegraded":"2024-09-12T02:28:53.402509+0000","last_fullsized":"2024-09-12T02:28:53.402509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:48.347351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:16.055269+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:29:16.055269+0000","last_peered":"2024-09-12T02:29:16.055269+0000","last_clean":"2024-09-12T02:29:16.055269+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:29:16.055269+0000","last_undegraded":"2024-09-12T02:29:16.055269+0000","last_fullsized":"2024-09-12T02:29:16.055269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480502+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:28:53.480502+0000","last_peered":"2024-09-12T02:28:53.480502+0000","last_clean":"2024-09-12T02:28:53.480502+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:28:53.480502+0000","last_undegraded":"2024-09-12T02:28:53.480502+0000","last_fullsized":"2024-09-12T02:28:53.480502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:16.053765+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:29:16.053765+0000","last_peered":"2024-09-12T02:29:16.053765+0000","last_clean":"2024-09-12T02:29:16.053765+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:29:16.053765+0000","last_undegraded":"2024-09-12T02:29:16.053765+0000","last_fullsized":"2024-09-12T02:29:16.053765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479140+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:28:53.479140+0000","last_peered":"2024-09-12T02:28:53.479140+0000","last_clean":"2024-09-12T02:28:53.479140+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:28:53.479140+0000","last_undegraded":"2024-09-12T02:28:53.479140+0000","last_fullsized":"2024-09-12T02:28:53.479140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.591213+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:28:53.591213+0000","last_peered":"2024-09-12T02:28:53.591213+0000","last_clean":"2024-09-12T02:28:53.591213+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:28:53.591213+0000","last_undegraded":"2024-09-12T02:28:53.591213+0000","last_fullsized":"2024-09-12T02:28:53.591213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:54.883140+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:28:54.883140+0000","last_peered":"2024-09-12T02:28:54.883140+0000","last_clean":"2024-09-12T02:28:54.883140+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:28:54.883140+0000","last_undegraded":"2024-09-12T02:28:54.883140+0000","last_fullsized":"2024-09-12T02:28:54.883140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.034009+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:04.034009+0000","last_peered":"2024-09-12T02:29:04.034009+0000","last_clean":"2024-09-12T02:29:04.034009+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:04.034009+0000","last_undegraded":"2024-09-12T02:29:04.034009+0000","last_fullsized":"2024-09-12T02:29:04.034009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.402823+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:28:53.402823+0000","last_peered":"2024-09-12T02:28:53.402823+0000","last_clean":"2024-09-12T02:28:53.402823+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:28:53.402823+0000","last_undegraded":"2024-09-12T02:28:53.402823+0000","last_fullsized":"2024-09-12T02:28:53.402823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:17.481675+0000","last_change":"2024-09-12T02:28:49.858046+0000","last_active":"2024-09-12T02:29:17.481675+0000","last_peered":"2024-09-12T02:29:17.481675+0000","last_clean":"2024-09-12T02:29:17.481675+0000","last_became_active":"2024-09-12T02:28:49.857728+0000","last_became_peered":"2024-09-12T02:28:49.857728+0000","last_unstale":"2024-09-12T02:29:17.481675+0000","last_undegraded":"2024-09-12T02:29:17.481675+0000","last_fullsized":"2024-09-12T02:29:17.481675+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:09.743162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966355+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:28:52.966355+0000","last_peered":"2024-09-12T02:28:52.966355+0000","last_clean":"2024-09-12T02:28:52.966355+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:28:52.966355+0000","last_undegraded":"2024-09-12T02:28:52.966355+0000","last_fullsized":"2024-09-12T02:28:52.966355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033427+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:04.033427+0000","last_peered":"2024-09-12T02:29:04.033427+0000","last_clean":"2024-09-12T02:29:04.033427+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:04.033427+0000","last_undegraded":"2024-09-12T02:29:04.033427+0000","last_fullsized":"2024-09-12T02:29:04.033427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480887+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:28:53.480887+0000","last_peered":"2024-09-12T02:28:53.480887+0000","last_clean":"2024-09-12T02:28:53.480887+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:28:53.480887+0000","last_undegraded":"2024-09-12T02:28:53.480887+0000","last_fullsized":"2024-09-12T02:28:53.480887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.011101+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:01.011101+0000","last_peered":"2024-09-12T02:29:01.011101+0000","last_clean":"2024-09-12T02:29:01.011101+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:01.011101+0000","last_undegraded":"2024-09-12T02:29:01.011101+0000","last_fullsized":"2024-09-12T02:29:01.011101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.478924+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:28:53.478924+0000","last_peered":"2024-09-12T02:28:53.478924+0000","last_clean":"2024-09-12T02:28:53.478924+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:28:53.478924+0000","last_undegraded":"2024-09-12T02:28:53.478924+0000","last_fullsized":"2024-09-12T02:28:53.478924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033344+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:04.033344+0000","last_peered":"2024-09-12T02:29:04.033344+0000","last_clean":"2024-09-12T02:29:04.033344+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:04.033344+0000","last_undegraded":"2024-09-12T02:29:04.033344+0000","last_fullsized":"2024-09-12T02:29:04.033344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966775+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:28:52.966775+0000","last_peered":"2024-09-12T02:28:52.966775+0000","last_clean":"2024-09-12T02:28:52.966775+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:28:52.966775+0000","last_undegraded":"2024-09-12T02:28:52.966775+0000","last_fullsized":"2024-09-12T02:28:52.966775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:03.026497+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:03.026497+0000","last_peered":"2024-09-12T02:29:03.026497+0000","last_clean":"2024-09-12T02:29:03.026497+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:03.026497+0000","last_undegraded":"2024-09-12T02:29:03.026497+0000","last_fullsized":"2024-09-12T02:29:03.026497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966327+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:28:52.966327+0000","last_peered":"2024-09-12T02:28:52.966327+0000","last_clean":"2024-09-12T02:28:52.966327+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:28:52.966327+0000","last_undegraded":"2024-09-12T02:28:52.966327+0000","last_fullsized":"2024-09-12T02:28:52.966327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:01.013723+0000","last_change":"2024-09-12T02:28:49.865788+0000","last_active":"2024-09-12T02:29:01.013723+0000","last_peered":"2024-09-12T02:29:01.013723+0000","last_clean":"2024-09-12T02:29:01.013723+0000","last_became_active":"2024-09-12T02:28:49.865434+0000","last_became_peered":"2024-09-12T02:28:49.865434+0000","last_unstale":"2024-09-12T02:29:01.013723+0000","last_undegraded":"2024-09-12T02:29:01.013723+0000","last_fullsized":"2024-09-12T02:29:01.013723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:39.707131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481528+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:28:53.481528+0000","last_peered":"2024-09-12T02:28:53.481528+0000","last_clean":"2024-09-12T02:28:53.481528+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:28:53.481528+0000","last_undegraded":"2024-09-12T02:28:53.481528+0000","last_fullsized":"2024-09-12T02:28:53.481528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480253+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:28:53.480253+0000","last_peered":"2024-09-12T02:28:53.480253+0000","last_clean":"2024-09-12T02:28:53.480253+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:28:53.480253+0000","last_undegraded":"2024-09-12T02:28:53.480253+0000","last_fullsized":"2024-09-12T02:28:53.480253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033577+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:04.033577+0000","last_peered":"2024-09-12T02:29:04.033577+0000","last_clean":"2024-09-12T02:29:04.033577+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:04.033577+0000","last_undegraded":"2024-09-12T02:29:04.033577+0000","last_fullsized":"2024-09-12T02:29:04.033577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.967078+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:28:52.967078+0000","last_peered":"2024-09-12T02:28:52.967078+0000","last_clean":"2024-09-12T02:28:52.967078+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:28:52.967078+0000","last_undegraded":"2024-09-12T02:28:52.967078+0000","last_fullsized":"2024-09-12T02:28:52.967078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:05.036965+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:05.036965+0000","last_peered":"2024-09-12T02:29:05.036965+0000","last_clean":"2024-09-12T02:29:05.036965+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:05.036965+0000","last_undegraded":"2024-09-12T02:29:05.036965+0000","last_fullsized":"2024-09-12T02:29:05.036965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481139+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:28:53.481139+0000","last_peered":"2024-09-12T02:28:53.481139+0000","last_clean":"2024-09-12T02:28:53.481139+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:28:53.481139+0000","last_undegraded":"2024-09-12T02:28:53.481139+0000","last_fullsized":"2024-09-12T02:28:53.481139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485360+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:28:53.485360+0000","last_peered":"2024-09-12T02:28:53.485360+0000","last_clean":"2024-09-12T02:28:53.485360+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:28:53.485360+0000","last_undegraded":"2024-09-12T02:28:53.485360+0000","last_fullsized":"2024-09-12T02:28:53.485360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966410+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:28:52.966410+0000","last_peered":"2024-09-12T02:28:52.966410+0000","last_clean":"2024-09-12T02:28:52.966410+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:28:52.966410+0000","last_undegraded":"2024-09-12T02:28:52.966410+0000","last_fullsized":"2024-09-12T02:28:52.966410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:17.054428+0000","last_change":"2024-09-12T02:28:49.864972+0000","last_active":"2024-09-12T02:29:17.054428+0000","last_peered":"2024-09-12T02:29:17.054428+0000","last_clean":"2024-09-12T02:29:17.054428+0000","last_became_active":"2024-09-12T02:28:49.864553+0000","last_became_peered":"2024-09-12T02:28:49.864553+0000","last_unstale":"2024-09-12T02:29:17.054428+0000","last_undegraded":"2024-09-12T02:29:17.054428+0000","last_fullsized":"2024-09-12T02:29:17.054428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:40.359699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61653,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":238,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":184959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":418514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":1064381,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972381,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":418444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":418822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1011735,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":418554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1010627,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":418415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444097,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":473739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":473912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":419500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:29:21.662 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:29:21.662 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:29:21.663 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:29:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:21 smithi001 ceph-mon[31252]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s 2024-09-12T02:29:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:21 smithi001 ceph-mon[31252]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:21 smithi134 ceph-mon[35091]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s 2024-09-12T02:29:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:21 smithi134 ceph-mon[35091]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:21 smithi173 ceph-mon[35036]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s 2024-09-12T02:29:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:21 smithi173 ceph-mon[35036]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:29:22.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 -- 172.21.15.1:0/4283357243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 msgr2=0x7feb4010a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 --2- 172.21.15.1:0/4283357243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4010a060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb38009ca0 tx=0x7feb3802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 -- 172.21.15.1:0/4283357243 shutdown_connections 2024-09-12T02:29:22.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 --2- 172.21.15.1:0/4283357243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4010a060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 --2- 172.21.15.1:0/4283357243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 --2- 172.21.15.1:0/4283357243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 -- 172.21.15.1:0/4283357243 >> 172.21.15.1:0/4283357243 conn(0x7feb400fd3c0 msgr2=0x7feb400ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 -- 172.21.15.1:0/4283357243 shutdown_connections 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.442+0000 7feb4565c640 1 -- 172.21.15.1:0/4283357243 wait complete. 2024-09-12T02:29:22.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.443+0000 7feb4565c640 1 Processor -- start 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.443+0000 7feb4565c640 1 -- start start 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb4010d8f0 con 0x7feb401037d0 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb4010d770 con 0x7feb40101c10 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb4565c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb4010da70 con 0x7feb40102e10 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50082/0 (socket says 172.21.15.1:50082) 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 -- 172.21.15.1:0/3497395437 learned_addr learned my addr 172.21.15.1:0/3497395437 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3e7fc640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3effd640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 -- 172.21.15.1:0/3497395437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 msgr2=0x7feb40198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 -- 172.21.15.1:0/3497395437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 msgr2=0x7feb40197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 -- 172.21.15.1:0/3497395437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4019faf0 con 0x7feb401037d0 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3e7fc640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3effd640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.444+0000 7feb3f7fe640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb380098d0 tx=0x7feb3802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.445+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3802fc30 con 0x7feb401037d0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.445+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb38003e50 con 0x7feb401037d0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.445+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4019fd80 con 0x7feb401037d0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.445+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb401a02e0 con 0x7feb401037d0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.445+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb380305c0 con 0x7feb401037d0 2024-09-12T02:29:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.446+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb40108f40 con 0x7feb401037d0 2024-09-12T02:29:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.447+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7feb38004b40 con 0x7feb401037d0 2024-09-12T02:29:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.448+0000 7feb27fff640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 0x7feb280a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.448+0000 7feb3effd640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 0x7feb280a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.448+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7feb380f0590 con 0x7feb401037d0 2024-09-12T02:29:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.448+0000 7feb3effd640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 0x7feb280a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb40102c70 tx=0x7feb3000a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:22.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.451+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb380bd550 con 0x7feb401037d0 2024-09-12T02:29:22.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.692+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7feb4002d7c0 con 0x7feb401037d0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.694+0000 7feb27fff640 1 -- 172.21.15.1:0/3497395437 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7feb380bce50 con 0x7feb401037d0 2024-09-12T02:29:22.694 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-12T02:29:22.695 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQACUuJmmMBZKRAA+t9iEiE6lmXVXK5FN+6D5g== 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.696+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 msgr2=0x7feb280a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.696+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 0x7feb280a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb40102c70 tx=0x7feb3000a560 comp rx=0 tx=0).stop 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.696+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 msgr2=0x7feb4019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.696+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb380098d0 tx=0x7feb3802f840 comp rx=0 tx=0).stop 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 shutdown_connections 2024-09-12T02:29:22.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feb280a2c40 0x7feb280a5100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb401037d0 0x7feb4019f480 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb40102e10 0x7feb40198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 --2- 172.21.15.1:0/3497395437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb40101c10 0x7feb40197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 >> 172.21.15.1:0/3497395437 conn(0x7feb400fd3c0 msgr2=0x7feb40106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 shutdown_connections 2024-09-12T02:29:22.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:22.697+0000 7feb4565c640 1 -- 172.21.15.1:0/3497395437 wait complete. 2024-09-12T02:29:23.400 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:29:23.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:29:23.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:29:23.442 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:29:23.443 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:29:23.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:29:23.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:23 smithi001 ceph-mon[31252]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:23.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:23 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:29:23.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:23 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:29:23.744 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:23 smithi134 ceph-mon[35091]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:23 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:29:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:23 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:29:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:23 smithi173 ceph-mon[35036]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:23 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:29:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:23 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3497395437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:29:24.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 -- 172.21.15.1:0/2165347738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f308810c170 msgr2=0x7f308810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 --2- 172.21.15.1:0/2165347738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f308810c170 0x7f308810e610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3080009ca0 tx=0x7f308002a950 comp rx=0 tx=0).stop 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 -- 172.21.15.1:0/2165347738 shutdown_connections 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 --2- 172.21.15.1:0/2165347738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f308810c170 0x7f308810e610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 --2- 172.21.15.1:0/2165347738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088103660 0x7f308810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 --2- 172.21.15.1:0/2165347738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3088102d40 0x7f3088103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 -- 172.21.15.1:0/2165347738 >> 172.21.15.1:0/2165347738 conn(0x7f30880fc7a0 msgr2=0x7f30880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 -- 172.21.15.1:0/2165347738 shutdown_connections 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.252+0000 7f308fe70640 1 -- 172.21.15.1:0/2165347738 wait complete. 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 Processor -- start 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 -- start start 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 0x7f30881983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f308810c170 0x7f308819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3088111f70 con 0x7f3088103660 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3088111df0 con 0x7f3088102d40 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308fe70640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30881120f0 con 0x7f308810c170 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50104/0 (socket says 172.21.15.1:50104) 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 -- 172.21.15.1:0/1411545046 learned_addr learned my addr 172.21.15.1:0/1411545046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308dc0c640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 0x7f30881983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308e40d640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f308810c170 0x7f308819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 -- 172.21.15.1:0/1411545046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f308810c170 msgr2=0x7f308819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f308810c170 0x7f308819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 -- 172.21.15.1:0/1411545046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 msgr2=0x7f30881983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 0x7f30881983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308d40b640 1 -- 172.21.15.1:0/1411545046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308819d3a0 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.253+0000 7f308dc0c640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 0x7f30881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f308d40b640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f307800d740 tx=0x7f307800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078017070 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f307800de50 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308819d690 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307800f620 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.254+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30881a4f70 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.255+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3088103120 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.256+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3078009c30 con 0x7f3088103660 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.257+0000 7f307effd640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 0x7f30740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.257+0000 7f308dc0c640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 0x7f30740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.257+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f30780cec10 con 0x7f3088103660 2024-09-12T02:29:24.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.257+0000 7f308dc0c640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 0x7f30740a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30840058c0 tx=0x7f3084005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.261+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f307809bbc0 con 0x7f3088103660 2024-09-12T02:29:24.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.485+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3088106c80 con 0x7f3088103660 2024-09-12T02:29:24.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.489+0000 7f307effd640 1 -- 172.21.15.1:0/1411545046 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263192 (secure 0 0 0) 0x7f307809b4c0 con 0x7f3088103660 2024-09-12T02:29:24.493 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 msgr2=0x7f30740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 0x7f30740a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30840058c0 tx=0x7f3084005850 comp rx=0 tx=0).stop 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 msgr2=0x7f3088198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f307800d740 tx=0x7f307800dc00 comp rx=0 tx=0).stop 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 shutdown_connections 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f30740a2c90 0x7f30740a5150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3088103660 0x7f3088198930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f308810c170 0x7f308819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 --2- 172.21.15.1:0/1411545046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3088102d40 0x7f30881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 >> 172.21.15.1:0/1411545046 conn(0x7f30880fc7a0 msgr2=0x7f30880fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 shutdown_connections 2024-09-12T02:29:24.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:24.493+0000 7f308fe70640 1 -- 172.21.15.1:0/1411545046 wait complete. 2024-09-12T02:29:24.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:24 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1411545046' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:29:24.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:24 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1411545046' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:29:24.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:24 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1411545046' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:29:25.325 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3015676599},{"type":"v1","addr":"172.21.15.1:6801","nonce":3015676599}]},"active_addr":"172.21.15.1:6801/3015676599","active_change":"2024-09-12T02:21:53.871301+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2569775057}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2749367897}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2385808398}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1941168838}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1731478515}]}]} 2024-09-12T02:29:25.331 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:29:25.331 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:29:25.331 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:29:25.592 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:25.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:25 smithi001 ceph-mon[31252]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:25 smithi134 ceph-mon[35091]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:25 smithi173 ceph-mon[35036]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 -- 172.21.15.1:0/2860450384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8104e80 msgr2=0x7f6cf8105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 --2- 172.21.15.1:0/2860450384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8104e80 0x7f6cf8105330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009ca0 tx=0x7f6cf002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 -- 172.21.15.1:0/2860450384 shutdown_connections 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 --2- 172.21.15.1:0/2860450384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8104e80 0x7f6cf8105330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 --2- 172.21.15.1:0/2860450384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806a370 0x7f6cf81009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 --2- 172.21.15.1:0/2860450384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf8069f00 0x7f6cf8100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 -- 172.21.15.1:0/2860450384 >> 172.21.15.1:0/2860450384 conn(0x7f6cf8077210 msgr2=0x7f6cf80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 -- 172.21.15.1:0/2860450384 shutdown_connections 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.096+0000 7f6cff54d640 1 -- 172.21.15.1:0/2860450384 wait complete. 2024-09-12T02:29:26.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 Processor -- start 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 -- start start 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 0x7f6cf8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 0x7f6cf819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8110eb0 con 0x7f6cf8069f00 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8110d30 con 0x7f6cf8104e80 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cff54d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8111030 con 0x7f6cf806a370 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cfd2e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cfd2e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50134/0 (socket says 172.21.15.1:50134) 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cfd2e9640 1 -- 172.21.15.1:0/1484226206 learned_addr learned my addr 172.21.15.1:0/1484226206 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.097+0000 7f6cfdaea640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 0x7f6cf819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:26.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfcae8640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 0x7f6cf8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 -- 172.21.15.1:0/1484226206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 msgr2=0x7f6cf8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 0x7f6cf8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 -- 172.21.15.1:0/1484226206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 msgr2=0x7f6cf819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 0x7f6cf819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 -- 172.21.15.1:0/1484226206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf819d400 con 0x7f6cf8069f00 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfdaea640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 0x7f6cf819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfcae8640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 0x7f6cf8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cfd2e9640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400b4a0 tx=0x7f6cf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4014070 con 0x7f6cf8069f00 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf819d6f0 con 0x7f6cf8069f00 2024-09-12T02:29:26.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf4010af0 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4017d10 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.098+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a4fd0 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.099+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8105330 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.100+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6cf4017070 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.101+0000 7f6cee7fc640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 0x7f6ce40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.101+0000 7f6cfcae8640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 0x7f6ce40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.101+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6cf40ce500 con 0x7f6cf8069f00 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.101+0000 7f6cfcae8640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 0x7f6ce40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cf81043f0 tx=0x7f6ce8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:26.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.105+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cf409b4c0 con 0x7f6cf8069f00 2024-09-12T02:29:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.282+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cf810a880 con 0x7f6cf8069f00 2024-09-12T02:29:26.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.283+0000 7f6cee7fc640 1 -- 172.21.15.1:0/1484226206 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22231 (secure 0 0 0) 0x7f6cf409adc0 con 0x7f6cf8069f00 2024-09-12T02:29:26.284 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:26.284 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:52.748131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:26.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 msgr2=0x7f6ce40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 0x7f6ce40a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cf81043f0 tx=0x7f6ce8005e50 comp rx=0 tx=0).stop 2024-09-12T02:29:26.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 msgr2=0x7f6cf8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400b4a0 tx=0x7f6cf400b960 comp rx=0 tx=0).stop 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 shutdown_connections 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6ce40a2c10 0x7f6ce40a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf8104e80 0x7f6cf819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cf806a370 0x7f6cf8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 --2- 172.21.15.1:0/1484226206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6cf8069f00 0x7f6cf8198450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 >> 172.21.15.1:0/1484226206 conn(0x7f6cf8077210 msgr2=0x7f6cf80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 shutdown_connections 2024-09-12T02:29:26.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:26.286+0000 7f6cff54d640 1 -- 172.21.15.1:0/1484226206 wait complete. 2024-09-12T02:29:26.625 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:26 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1484226206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:26.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:26 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1484226206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:26.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:26 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1484226206' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:27.133 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:29:27.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:29:27.398 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:27.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:27 smithi001 ceph-mon[31252]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-12T02:29:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:27 smithi134 ceph-mon[35091]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-12T02:29:27.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.890+0000 7fba5ef33640 1 -- 172.21.15.1:0/24685442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58106f10 msgr2=0x7fba5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.890+0000 7fba5ef33640 1 --2- 172.21.15.1:0/24685442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58106f10 0x7fba5810ea90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba50009ca0 tx=0x7fba5002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.890+0000 7fba5ef33640 1 -- 172.21.15.1:0/24685442 shutdown_connections 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.890+0000 7fba5ef33640 1 --2- 172.21.15.1:0/24685442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58106f10 0x7fba5810ea90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 --2- 172.21.15.1:0/24685442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58102790 0x7fba581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 --2- 172.21.15.1:0/24685442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58101de0 0x7fba581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- 172.21.15.1:0/24685442 >> 172.21.15.1:0/24685442 conn(0x7fba580fd8c0 msgr2=0x7fba580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- 172.21.15.1:0/24685442 shutdown_connections 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- 172.21.15.1:0/24685442 wait complete. 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 Processor -- start 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- start start 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58101de0 0x7fba58198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 0x7fba5819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba58111f90 con 0x7fba58102790 2024-09-12T02:29:27.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba58111e10 con 0x7fba58106f10 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba5ef33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fba58112110 con 0x7fba58101de0 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.891+0000 7fba57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50160/0 (socket says 172.21.15.1:50160) 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 -- 172.21.15.1:0/3388536343 learned_addr learned my addr 172.21.15.1:0/3388536343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba5d4d0640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 0x7fba5819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba5cccf640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58101de0 0x7fba58198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 -- 172.21.15.1:0/3388536343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58101de0 msgr2=0x7fba58198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58101de0 0x7fba58198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 -- 172.21.15.1:0/3388536343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 msgr2=0x7fba5819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 0x7fba5819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 -- 172.21.15.1:0/3388536343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5819d420 con 0x7fba58102790 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba5d4d0640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 0x7fba5819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:27.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba57fff640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba4400b4a0 tx=0x7fba4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44014070 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba44010af0 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5819d710 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44017d10 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.892+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba581a4ff0 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.893+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba581021c0 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.894+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fba44017070 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.895+0000 7fba55ffb640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 0x7fba480a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.895+0000 7fba5cccf640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 0x7fba480a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.895+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fba440ce320 con 0x7fba58102790 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.895+0000 7fba5cccf640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 0x7fba480a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba4c005fd0 tx=0x7fba4c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:27.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:27.899+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba4409b3e0 con 0x7fba58102790 2024-09-12T02:29:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:27 smithi173 ceph-mon[35036]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-12T02:29:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.077+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba58109b60 con 0x7fba58102790 2024-09-12T02:29:28.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.079+0000 7fba55ffb640 1 -- 172.21.15.1:0/3388536343 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22231 (secure 0 0 0) 0x7fba4409ace0 con 0x7fba58102790 2024-09-12T02:29:28.079 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:28.080 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:28:52.748131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.081+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 msgr2=0x7fba480a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.081+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 0x7fba480a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba4c005fd0 tx=0x7fba4c00b590 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.081+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 msgr2=0x7fba581989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.081+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba4400b4a0 tx=0x7fba4400b960 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 shutdown_connections 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fba480a2c90 0x7fba480a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba58102790 0x7fba581989b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba58106f10 0x7fba5819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 --2- 172.21.15.1:0/3388536343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba58101de0 0x7fba58198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:28.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 >> 172.21.15.1:0/3388536343 conn(0x7fba580fd8c0 msgr2=0x7fba580fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:28.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 shutdown_connections 2024-09-12T02:29:28.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:28.082+0000 7fba5ef33640 1 -- 172.21.15.1:0/3388536343 wait complete. 2024-09-12T02:29:28.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3388536343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:28.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:29:28.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:29:28.914 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:29:28.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:29:28.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:29:28.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:29:28.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:29:28.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:29:28.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:29:28.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:29:28.918 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:29:28.918 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:29:28.920 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3388536343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:28.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3388536343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:29:29.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:29.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:29 smithi001 ceph-mon[31252]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:29:29.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:29 smithi134 ceph-mon[35091]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:29:29.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:29 smithi173 ceph-mon[35036]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-12T02:29:30.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 -- 172.21.15.1:0/1559938128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380101de0 msgr2=0x7f73801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 --2- 172.21.15.1:0/1559938128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380101de0 0x7f73801021c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f737c009900 tx=0x7f737c02a410 comp rx=0 tx=0).stop 2024-09-12T02:29:30.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 -- 172.21.15.1:0/1559938128 shutdown_connections 2024-09-12T02:29:30.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 --2- 172.21.15.1:0/1559938128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 0x7f738010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 --2- 172.21.15.1:0/1559938128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7380102790 0x7f73801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 --2- 172.21.15.1:0/1559938128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380101de0 0x7f73801021c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 -- 172.21.15.1:0/1559938128 >> 172.21.15.1:0/1559938128 conn(0x7f73800fd8c0 msgr2=0x7f73800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 -- 172.21.15.1:0/1559938128 shutdown_connections 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.104+0000 7f7387d1a640 1 -- 172.21.15.1:0/1559938128 wait complete. 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 Processor -- start 2024-09-12T02:29:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 -- start start 2024-09-12T02:29:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7380101de0 0x7f73800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 0x7f7380074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 0x7f7380074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7380111fb0 con 0x7f7380102790 2024-09-12T02:29:30.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7380111e30 con 0x7f7380101de0 2024-09-12T02:29:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f7387d1a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7380112130 con 0x7f7380106f10 2024-09-12T02:29:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f73852b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 0x7f7380074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f73852b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 0x7f7380074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50180/0 (socket says 172.21.15.1:50180) 2024-09-12T02:29:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.105+0000 7f73852b5640 1 -- 172.21.15.1:0/500970306 learned_addr learned my addr 172.21.15.1:0/500970306 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7385ab6640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7380101de0 0x7f73800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73862b7640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 0x7f7380074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 -- 172.21.15.1:0/500970306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 msgr2=0x7f7380074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 0x7f7380074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 -- 172.21.15.1:0/500970306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7380101de0 msgr2=0x7f73800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7380101de0 0x7f73800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73801a6940 con 0x7f7380102790 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73862b7640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7380106f10 0x7f7380074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f73852b5640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 0x7f7380074a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f737000b4a0 tx=0x7f737000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370014070 con 0x7f7380102790 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73801a6c30 con 0x7f7380102790 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7370010af0 con 0x7f7380102790 2024-09-12T02:29:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370017d10 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.106+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73801a7170 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.107+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7380062880 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.108+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7370017070 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7376ffd640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f736c0a2c10 0x7f736c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7385ab6640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f736c0a2c10 0x7f736c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f73700ce720 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7376ffd640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] conn(0x7f736c0ac460 0x7f736c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f737000dec0 con 0x7f736c0ac460 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f73700cec00 con 0x7f7380102790 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.109+0000 7f73862b7640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] conn(0x7f736c0ac460 0x7f736c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.110+0000 7f7385ab6640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f736c0a2c10 0x7f736c0a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f737c005ab0 tx=0x7f737c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.110+0000 7f73862b7640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] conn(0x7f736c0ac460 0x7f736c0ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:30.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.110+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== osd.0 v2:172.21.15.1:6802/2377919946 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f737000dec0 con 0x7f736c0ac460 2024-09-12T02:29:30.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.124+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 --> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7380062d00 con 0x7f736c0ac460 2024-09-12T02:29:30.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.124+0000 7f7376ffd640 1 -- 172.21.15.1:0/500970306 <== osd.0 v2:172.21.15.1:6802/2377919946 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7380062d00 con 0x7f736c0ac460 2024-09-12T02:29:30.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] conn(0x7f736c0ac460 msgr2=0x7f736c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] conn(0x7f736c0ac460 0x7f736c0ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:30.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f736c0a2c10 msgr2=0x7f736c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f736c0a2c10 0x7f736c0a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f737c005ab0 tx=0x7f737c005a20 comp rx=0 tx=0).stop 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 msgr2=0x7f7380074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 --2- 172.21.15.1:0/500970306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7380102790 0x7f7380074a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f737000b4a0 tx=0x7f737000b960 comp rx=0 tx=0).stop 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f73862b7640 1 -- 172.21.15.1:0/500970306 reap_dead start 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 shutdown_connections 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 >> 172.21.15.1:0/500970306 conn(0x7f73800fd8c0 msgr2=0x7f73800fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 shutdown_connections 2024-09-12T02:29:30.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:30.125+0000 7f7387d1a640 1 -- 172.21.15.1:0/500970306 wait complete. 2024-09-12T02:29:30.427 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.445 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.449 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.739 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:31.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:31 smithi001 ceph-mon[31252]: pgmap v298: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 -- 172.21.15.1:0/2054968640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c10e3c0 msgr2=0x7f834c110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2054968640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c10e3c0 0x7f834c110810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8344009ca0 tx=0x7f834402a950 comp rx=0 tx=0).stop 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 -- 172.21.15.1:0/2054968640 shutdown_connections 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2054968640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c10e3c0 0x7f834c110810 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2054968640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f834c074f40 0x7f834c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2054968640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c074620 0x7f834c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 -- 172.21.15.1:0/2054968640 >> 172.21.15.1:0/2054968640 conn(0x7f834c0fd8c0 msgr2=0x7f834c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 -- 172.21.15.1:0/2054968640 shutdown_connections 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.874+0000 7f8350a1d640 1 -- 172.21.15.1:0/2054968640 wait complete. 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.875+0000 7f8350a1d640 1 Processor -- start 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.875+0000 7f8350a1d640 1 -- start start 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 0x7f834c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f834c074f40 0x7f834c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c10e3c0 0x7f834c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f834c114160 con 0x7f834c074620 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f834c113fe0 con 0x7f834c074f40 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1142e0 con 0x7f834c10e3c0 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 0x7f834c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 0x7f834c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39248/0 (socket says 172.21.15.1:39248) 2024-09-12T02:29:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 -- 172.21.15.1:0/2230488167 learned_addr learned my addr 172.21.15.1:0/2230488167 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8349d9b640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f834c074f40 0x7f834c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 -- 172.21.15.1:0/2230488167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c10e3c0 msgr2=0x7f834c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834ad9d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c10e3c0 0x7f834c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c10e3c0 0x7f834c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 -- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f834c074f40 msgr2=0x7f834c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f834c074f40 0x7f834c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c19f650 con 0x7f834c074620 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834ad9d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f834c10e3c0 0x7f834c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f834a59c640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 0x7f834c19a6a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c970 tx=0x7f833c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c007bb0 con 0x7f834c074620 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f833c007d50 con 0x7f834c074620 2024-09-12T02:29:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c19f940 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.876+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c00f450 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.877+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1a7220 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.877+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f834c062900 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f833c004fa0 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83340a2c10 0x7f83340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f8349d9b640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83340a2c10 0x7f83340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f833c0cf370 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] conn(0x7f83340ac460 0x7f83340ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83340aef30 con 0x7f83340ac460 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.879+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f833c0cf720 con 0x7f834c074620 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.880+0000 7f8349d9b640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83340a2c10 0x7f83340a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8340005d90 tx=0x7f8340005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.880+0000 7f834ad9d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] conn(0x7f83340ac460 0x7f83340ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:31.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.880+0000 7f834ad9d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] conn(0x7f83340ac460 0x7f83340ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:31.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.881+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== osd.1 v2:172.21.15.134:6800/3734137838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83340aef30 con 0x7f83340ac460 2024-09-12T02:29:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.895+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 --> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f834c062d80 con 0x7f83340ac460 2024-09-12T02:29:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.895+0000 7f833b7fe640 1 -- 172.21.15.1:0/2230488167 <== osd.1 v2:172.21.15.134:6800/3734137838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f834c062d80 con 0x7f83340ac460 2024-09-12T02:29:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] conn(0x7f83340ac460 msgr2=0x7f83340ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] conn(0x7f83340ac460 0x7f83340ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83340a2c10 msgr2=0x7f83340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83340a2c10 0x7f83340a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8340005d90 tx=0x7f8340005d20 comp rx=0 tx=0).stop 2024-09-12T02:29:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 msgr2=0x7f834c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 --2- 172.21.15.1:0/2230488167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f834c074620 0x7f834c19a6a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f833c00c970 tx=0x7f833c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f834ad9d640 1 -- 172.21.15.1:0/2230488167 reap_dead start 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 shutdown_connections 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 >> 172.21.15.1:0/2230488167 conn(0x7f834c0fd8c0 msgr2=0x7f834c0fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 shutdown_connections 2024-09-12T02:29:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.896+0000 7f8350a1d640 1 -- 172.21.15.1:0/2230488167 wait complete. 2024-09-12T02:29:31.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:31 smithi134 ceph-mon[35091]: pgmap v298: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:29:31.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:31 smithi173 ceph-mon[35036]: pgmap v298: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:29:32.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 -- 172.21.15.1:0/3726520582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8101420 msgr2=0x7f14f810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3726520582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8101420 0x7f14f810d950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009cd0 tx=0x7f14f002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 -- 172.21.15.1:0/3726520582 shutdown_connections 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3726520582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8101420 0x7f14f810d950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3726520582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14f8100a80 0x7f14f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3726520582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14f8106a80 0x7f14f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 -- 172.21.15.1:0/3726520582 >> 172.21.15.1:0/3726520582 conn(0x7f14f80fc7a0 msgr2=0x7f14f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 -- 172.21.15.1:0/3726520582 shutdown_connections 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.076+0000 7f14fcf33640 1 -- 172.21.15.1:0/3726520582 wait complete. 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 Processor -- start 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 -- start start 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14f8100a80 0x7f14f8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14f8101420 0x7f14f8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:32.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 0x7f14f819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8110e80 con 0x7f14f8106a80 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8110d00 con 0x7f14f8100a80 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14fcf33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8111000 con 0x7f14f8101420 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14f6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 0x7f14f819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14f6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 0x7f14f819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39264/0 (socket says 172.21.15.1:39264) 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14f6d9d640 1 -- 172.21.15.1:0/3686959266 learned_addr learned my addr 172.21.15.1:0/3686959266 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.077+0000 7f14f5d9b640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14f8101420 0x7f14f8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f659c640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14f8100a80 0x7f14f8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 -- 172.21.15.1:0/3686959266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14f8101420 msgr2=0x7f14f8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14f8101420 0x7f14f8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 -- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14f8100a80 msgr2=0x7f14f8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14f8100a80 0x7f14f8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f819d3f0 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14f6d9d640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 0x7f14f819cd10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14f0005cc0 tx=0x7f14f00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0003e00 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f819d680 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f0004520 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0030db0 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.078+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81a4fc0 con 0x7f14f8106a80 2024-09-12T02:29:32.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.079+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f8062980 con 0x7f14f8106a80 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.080+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f14f00046d0 con 0x7f14f8106a80 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14e77fe640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14e00a2c10 0x7f14e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14f659c640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14e00a2c10 0x7f14e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14f002e030 con 0x7f14f8106a80 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14e77fe640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] conn(0x7f14e00ac460 0x7f14e00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14f00020b0 con 0x7f14e00ac460 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.081+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f14f00f0b10 con 0x7f14f8106a80 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.082+0000 7f14f659c640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14e00a2c10 0x7f14e00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009b50 tx=0x7f14e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.082+0000 7f14f5d9b640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] conn(0x7f14e00ac460 0x7f14e00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.082+0000 7f14f5d9b640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] conn(0x7f14e00ac460 0x7f14e00ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.083+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== osd.4 v2:172.21.15.134:6808/2124784542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14f00020b0 con 0x7f14e00ac460 2024-09-12T02:29:32.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.097+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 --> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14f8062d80 con 0x7f14e00ac460 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.097+0000 7f14e77fe640 1 -- 172.21.15.1:0/3686959266 <== osd.4 v2:172.21.15.134:6808/2124784542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f14f8062d80 con 0x7f14e00ac460 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] conn(0x7f14e00ac460 msgr2=0x7f14e00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] conn(0x7f14e00ac460 0x7f14e00ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14e00a2c10 msgr2=0x7f14e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14e00a2c10 0x7f14e00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009b50 tx=0x7f14e8005f90 comp rx=0 tx=0).stop 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 msgr2=0x7f14f819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 --2- 172.21.15.1:0/3686959266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f8106a80 0x7f14f819cd10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14f0005cc0 tx=0x7f14f00093d0 comp rx=0 tx=0).stop 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14f6d9d640 1 -- 172.21.15.1:0/3686959266 reap_dead start 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 shutdown_connections 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 >> 172.21.15.1:0/3686959266 conn(0x7f14f80fc7a0 msgr2=0x7f14f806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 shutdown_connections 2024-09-12T02:29:32.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.098+0000 7f14fcf33640 1 -- 172.21.15.1:0/3686959266 wait complete. 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 -- 172.21.15.1:0/2562761694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 msgr2=0x7f93dc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 --2- 172.21.15.1:0/2562761694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc106e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009930 tx=0x7f93d802a420 comp rx=0 tx=0).stop 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 -- 172.21.15.1:0/2562761694 shutdown_connections 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 --2- 172.21.15.1:0/2562761694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93dc101420 0x7f93dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 --2- 172.21.15.1:0/2562761694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93dc100a80 0x7f93dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 --2- 172.21.15.1:0/2562761694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc106e60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 -- 172.21.15.1:0/2562761694 >> 172.21.15.1:0/2562761694 conn(0x7f93dc0fc7a0 msgr2=0x7f93dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 -- 172.21.15.1:0/2562761694 shutdown_connections 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.344+0000 7f93e3bae640 1 -- 172.21.15.1:0/2562761694 wait complete. 2024-09-12T02:29:33.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 Processor -- start 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 -- start start 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93dc100a80 0x7f93dc197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93dc101420 0x7f93dc197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc110e80 con 0x7f93dc106a80 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc110d00 con 0x7f93dc100a80 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e3bae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111000 con 0x7f93dc101420 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e214b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e214b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc19bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39312/0 (socket says 172.21.15.1:39312) 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.345+0000 7f93e214b640 1 -- 172.21.15.1:0/4134946789 learned_addr learned my addr 172.21.15.1:0/4134946789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 -- 172.21.15.1:0/4134946789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93dc101420 msgr2=0x7f93dc197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93dc101420 0x7f93dc197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 -- 172.21.15.1:0/4134946789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93dc100a80 msgr2=0x7f93dc197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e194a640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93dc100a80 0x7f93dc197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93dc100a80 0x7f93dc197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc19c2f0 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e214b640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc19bc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93d400eaa0 tx=0x7f93d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d400cdb0 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d4005020 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40116b0 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc19c5e0 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.346+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a3ec0 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.347+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93dc062980 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.348+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f93d4005560 con 0x7f93dc106a80 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93d2ffd640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93c80a2c90 0x7f93c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93e194a640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93c80a2c90 0x7f93c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f93d40cf720 con 0x7f93dc106a80 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93d2ffd640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] conn(0x7f93c80ac4e0 0x7f93c80ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93d4014ec0 con 0x7f93c80ac4e0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f93d40cfad0 con 0x7f93dc106a80 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93e1149640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] conn(0x7f93c80ac4e0 0x7f93c80ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.349+0000 7f93e194a640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93c80a2c90 0x7f93c80a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93d80096c0 tx=0x7f93d8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.350+0000 7f93e1149640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] conn(0x7f93c80ac4e0 0x7f93c80ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.350+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== osd.3 v2:172.21.15.1:6810/203292465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93d4014ec0 con 0x7f93c80ac4e0 2024-09-12T02:29:33.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.364+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 --> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93dc062d80 con 0x7f93c80ac4e0 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.364+0000 7f93d2ffd640 1 -- 172.21.15.1:0/4134946789 <== osd.3 v2:172.21.15.1:6810/203292465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93dc062d80 con 0x7f93c80ac4e0 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] conn(0x7f93c80ac4e0 msgr2=0x7f93c80ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] conn(0x7f93c80ac4e0 0x7f93c80ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93c80a2c90 msgr2=0x7f93c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93c80a2c90 0x7f93c80a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93d80096c0 tx=0x7f93d8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 msgr2=0x7f93dc19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 --2- 172.21.15.1:0/4134946789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93dc106a80 0x7f93dc19bc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93d400eaa0 tx=0x7f93d400ef60 comp rx=0 tx=0).stop 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e214b640 1 -- 172.21.15.1:0/4134946789 reap_dead start 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 shutdown_connections 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 >> 172.21.15.1:0/4134946789 conn(0x7f93dc0fc7a0 msgr2=0x7f93dc0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 shutdown_connections 2024-09-12T02:29:33.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.365+0000 7f93e3bae640 1 -- 172.21.15.1:0/4134946789 wait complete. 2024-09-12T02:29:33.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.555+0000 7f3873635640 1 -- 172.21.15.1:0/2169759699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c1036f0 msgr2=0x7f386c10bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.555+0000 7f3873635640 1 --2- 172.21.15.1:0/2169759699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c1036f0 0x7f386c10bbe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f385c009900 tx=0x7f385c02a480 comp rx=0 tx=0).stop 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 -- 172.21.15.1:0/2169759699 shutdown_connections 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 --2- 172.21.15.1:0/2169759699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c1036f0 0x7f386c10bbe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 --2- 172.21.15.1:0/2169759699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f386c10c170 0x7f386c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 --2- 172.21.15.1:0/2169759699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386c102dd0 0x7f386c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 -- 172.21.15.1:0/2169759699 >> 172.21.15.1:0/2169759699 conn(0x7f386c0fc790 msgr2=0x7f386c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 -- 172.21.15.1:0/2169759699 shutdown_connections 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 -- 172.21.15.1:0/2169759699 wait complete. 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 Processor -- start 2024-09-12T02:29:33.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 -- start start 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f386c102dd0 0x7f386c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.556+0000 7f3873635640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386c1036f0 0x7f386c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 0x7f386c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f386c111fa0 con 0x7f386c10c170 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f386c111e20 con 0x7f386c102dd0 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f386c112120 con 0x7f386c1036f0 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 0x7f386c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 0x7f386c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39330/0 (socket says 172.21.15.1:39330) 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 -- 172.21.15.1:0/2013228718 learned_addr learned my addr 172.21.15.1:0/2013228718 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3870bd0640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386c1036f0 0x7f386c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f38713d1640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f386c102dd0 0x7f386c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 -- 172.21.15.1:0/2013228718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386c1036f0 msgr2=0x7f386c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f386c1036f0 0x7f386c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 -- 172.21.15.1:0/2013228718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f386c102dd0 msgr2=0x7f386c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f386c102dd0 0x7f386c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c19d470 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3871bd2640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 0x7f386c19cd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f386400eaa0 tx=0x7f386400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386400cdb0 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c19d760 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3864005020 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38640116b0 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.557+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c1a5040 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.558+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f386c062980 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3864005560 con 0x7f386c10c170 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38580a2c10 0x7f38580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38713d1640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38580a2c10 0x7f38580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f38640cf780 con 0x7f386c10c170 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] conn(0x7f38580ac460 0x7f38580ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3864014ec0 con 0x7f38580ac460 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.560+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f38640cfb30 con 0x7f386c10c170 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.561+0000 7f3870bd0640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] conn(0x7f38580ac460 0x7f38580ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.561+0000 7f38713d1640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38580a2c10 0x7f38580a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3868009890 tx=0x7f3868008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.561+0000 7f3870bd0640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] conn(0x7f38580ac460 0x7f38580ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.562+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== osd.9 v2:172.21.15.1:6826/1141465152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3864014ec0 con 0x7f38580ac460 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.575+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 --> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f386c062e00 con 0x7f38580ac460 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.575+0000 7f38627fc640 1 -- 172.21.15.1:0/2013228718 <== osd.9 v2:172.21.15.1:6826/1141465152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f386c062e00 con 0x7f38580ac460 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] conn(0x7f38580ac460 msgr2=0x7f38580ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] conn(0x7f38580ac460 0x7f38580ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38580a2c10 msgr2=0x7f38580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38580a2c10 0x7f38580a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3868009890 tx=0x7f3868008040 comp rx=0 tx=0).stop 2024-09-12T02:29:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 msgr2=0x7f386c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 --2- 172.21.15.1:0/2013228718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f386c10c170 0x7f386c19cd90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f386400eaa0 tx=0x7f386400ef60 comp rx=0 tx=0).stop 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3871bd2640 1 -- 172.21.15.1:0/2013228718 reap_dead start 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 shutdown_connections 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 >> 172.21.15.1:0/2013228718 conn(0x7f386c0fc790 msgr2=0x7f386c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 shutdown_connections 2024-09-12T02:29:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:33.576+0000 7f3873635640 1 -- 172.21.15.1:0/2013228718 wait complete. 2024-09-12T02:29:33.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:33 smithi001 ceph-mon[31252]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:29:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:33 smithi134 ceph-mon[35091]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:29:33.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:33 smithi173 ceph-mon[35036]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/1961052192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e281011e0 msgr2=0x7f1e28105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/1961052192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e281011e0 0x7f1e28105980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009900 tx=0x7f1e1802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/1961052192 shutdown_connections 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/1961052192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e281011e0 0x7f1e28105980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/1961052192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28105ec0 0x7f1e28106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/1961052192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e281008c0 0x7f1e28100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/1961052192 >> 172.21.15.1:0/1961052192 conn(0x7f1e280fc7d0 msgr2=0x7f1e280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/1961052192 shutdown_connections 2024-09-12T02:29:33.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.421+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/1961052192 wait complete. 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 Processor -- start 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 -- start start 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e281008c0 0x7f1e281a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e281011e0 0x7f1e281a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 0x7f1e2819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28118610 con 0x7f1e28105ec0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28118490 con 0x7f1e281011e0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2f3a8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28118790 con 0x7f1e281008c0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 0x7f1e2819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 0x7f1e2819e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39244/0 (socket says 172.21.15.1:39244) 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2d945640 1 -- 172.21.15.1:0/4007688786 learned_addr learned my addr 172.21.15.1:0/4007688786 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2c943640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e281011e0 0x7f1e281a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.422+0000 7f1e2d144640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e281008c0 0x7f1e281a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 -- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e281008c0 msgr2=0x7f1e281a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e281008c0 0x7f1e281a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 -- 172.21.15.1:0/4007688786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e281011e0 msgr2=0x7f1e281a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e281011e0 0x7f1e281a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2819f010 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2d945640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 0x7f1e2819e8e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000cce0 tx=0x7f1e2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000f450 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2819f300 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e2000fad0 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20018b60 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.423+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e281ab5f0 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.424+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e28105340 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.426+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1e2000fc80 con 0x7f1e28105ec0 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.426+0000 7f1e1e7fc640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e140a2c10 0x7f1e140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e2d144640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e140a2c10 0x7f1e140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f1e200cf9e0 con 0x7f1e28105ec0 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e1e7fc640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] conn(0x7f1e140ac460 0x7f1e140ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e20012ec0 con 0x7f1e140ac460 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f1e200cfe40 con 0x7f1e28105ec0 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e2d144640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e140a2c10 0x7f1e140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e2819fa20 tx=0x7f1e2400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.427+0000 7f1e2c943640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] conn(0x7f1e140ac460 0x7f1e140ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.428+0000 7f1e2c943640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] conn(0x7f1e140ac460 0x7f1e140ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.429+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== osd.8 v2:172.21.15.173:6816/4264302819 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e20012ec0 con 0x7f1e140ac460 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.442+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 --> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e2806a850 con 0x7f1e140ac460 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e1e7fc640 1 -- 172.21.15.1:0/4007688786 <== osd.8 v2:172.21.15.173:6816/4264302819 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1e2806a850 con 0x7f1e140ac460 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] conn(0x7f1e140ac460 msgr2=0x7f1e140ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] conn(0x7f1e140ac460 0x7f1e140ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e140a2c10 msgr2=0x7f1e140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e140a2c10 0x7f1e140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e2819fa20 tx=0x7f1e2400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 msgr2=0x7f1e2819e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 --2- 172.21.15.1:0/4007688786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e28105ec0 0x7f1e2819e8e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000cce0 tx=0x7f1e2000a620 comp rx=0 tx=0).stop 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2d945640 1 -- 172.21.15.1:0/4007688786 reap_dead start 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 shutdown_connections 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 >> 172.21.15.1:0/4007688786 conn(0x7f1e280fc7d0 msgr2=0x7f1e28103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 shutdown_connections 2024-09-12T02:29:33.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:31.443+0000 7f1e2f3a8640 1 -- 172.21.15.1:0/4007688786 wait complete. 2024-09-12T02:29:34.771 INFO:teuthology.orchestra.run.smithi001.stdout:236223201315 2024-09-12T02:29:34.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:29:35.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 -- 172.21.15.1:0/2290779869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538101400 msgr2=0x7ff53810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/2290779869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538101400 0x7ff53810d930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff530009930 tx=0x7ff53002a420 comp rx=0 tx=0).stop 2024-09-12T02:29:35.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 -- 172.21.15.1:0/2290779869 shutdown_connections 2024-09-12T02:29:35.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/2290779869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538101400 0x7ff53810d930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/2290779869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff538100a60 0x7ff538100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/2290779869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538106a60 0x7ff538106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 -- 172.21.15.1:0/2290779869 >> 172.21.15.1:0/2290779869 conn(0x7ff5380fc780 msgr2=0x7ff5380feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 -- 172.21.15.1:0/2290779869 shutdown_connections 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.872+0000 7ff53ffcd640 1 -- 172.21.15.1:0/2290779869 wait complete. 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 Processor -- start 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 -- start start 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff538100a60 0x7ff5380fce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538101400 0x7ff5380fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 0x7ff5380fd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff538110e80 con 0x7ff538106a60 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff538110d00 con 0x7ff538101400 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53ffcd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff538111000 con 0x7ff538100a60 2024-09-12T02:29:35.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 0x7ff5380fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 0x7ff5380fd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39288/0 (socket says 172.21.15.1:39288) 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 -- 172.21.15.1:0/3087196267 learned_addr learned my addr 172.21.15.1:0/3087196267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53d568640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538101400 0x7ff5380fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53dd69640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff538100a60 0x7ff5380fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 -- 172.21.15.1:0/3087196267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff538100a60 msgr2=0x7ff5380fce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff538100a60 0x7ff5380fce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 -- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538101400 msgr2=0x7ff5380fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538101400 0x7ff5380fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53e56a640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5381a6910 con 0x7ff538106a60 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.873+0000 7ff53d568640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff538101400 0x7ff5380fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff53e56a640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 0x7ff5380fd890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff530005ab0 tx=0x7ff5300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53003f030 con 0x7ff538106a60 2024-09-12T02:29:35.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff530003ce0 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5381a6ba0 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530035070 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.874+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381a70d0 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.875+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff538062880 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.877+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff530042030 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.877+0000 7ff52affd640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5240a2c90 0x7ff5240a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff5300ef680 con 0x7ff538106a60 2024-09-12T02:29:35.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff53dd69640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5240a2c90 0x7ff5240a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff52affd640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] conn(0x7ff5240ac4e0 0x7ff5240ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff530001d30 con 0x7ff5240ac4e0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff5300efa30 con 0x7ff538106a60 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff53d568640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] conn(0x7ff5240ac4e0 0x7ff5240ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.878+0000 7ff53dd69640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5240a2c90 0x7ff5240a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff534005fd0 tx=0x7ff534005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.879+0000 7ff53d568640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] conn(0x7ff5240ac4e0 0x7ff5240ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.880+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== osd.7 v2:172.21.15.134:6816/1939894500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff530001d30 con 0x7ff5240ac4e0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.894+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 --> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff538062c80 con 0x7ff5240ac4e0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff52affd640 1 -- 172.21.15.1:0/3087196267 <== osd.7 v2:172.21.15.134:6816/1939894500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff538062c80 con 0x7ff5240ac4e0 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] conn(0x7ff5240ac4e0 msgr2=0x7ff5240ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] conn(0x7ff5240ac4e0 0x7ff5240ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5240a2c90 msgr2=0x7ff5240a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5240a2c90 0x7ff5240a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff534005fd0 tx=0x7ff534005850 comp rx=0 tx=0).stop 2024-09-12T02:29:35.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 msgr2=0x7ff5380fd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53ffcd640 1 --2- 172.21.15.1:0/3087196267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff538106a60 0x7ff5380fd890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff530005ab0 tx=0x7ff5300042f0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.895+0000 7ff53e56a640 1 -- 172.21.15.1:0/3087196267 reap_dead start 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.896+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 shutdown_connections 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.896+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 >> 172.21.15.1:0/3087196267 conn(0x7ff5380fc780 msgr2=0x7ff53806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.896+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 shutdown_connections 2024-09-12T02:29:35.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:32.896+0000 7ff53ffcd640 1 -- 172.21.15.1:0/3087196267 wait complete. 2024-09-12T02:29:35.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:35 smithi001 ceph-mon[31252]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:29:35.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:35 smithi134 ceph-mon[35091]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:29:35.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:35 smithi173 ceph-mon[35036]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-12T02:29:36.248 INFO:teuthology.orchestra.run.smithi001.stdout:206158430251 2024-09-12T02:29:36.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:29:36.442 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:36.592 INFO:teuthology.orchestra.run.smithi001.stdout:266287972384 2024-09-12T02:29:36.592 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.520+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/1399919655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1036e0 msgr2=0x7fcbec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.520+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/1399919655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1036e0 0x7fcbec107b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009930 tx=0x7fcbdc02a420 comp rx=0 tx=0).stop 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.520+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/1399919655 shutdown_connections 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.520+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/1399919655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1036e0 0x7fcbec107b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.520+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/1399919655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbec1082a0 0x7fcbec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/1399919655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec102d30 0x7fcbec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/1399919655 >> 172.21.15.1:0/1399919655 conn(0x7fcbec0fc7d0 msgr2=0x7fcbec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/1399919655 shutdown_connections 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/1399919655 wait complete. 2024-09-12T02:29:36.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 Processor -- start 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.521+0000 7fcbf2e9f640 1 -- start start 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbec102d30 0x7fcbec198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec1036e0 0x7fcbec198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 0x7fcbec19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1120c0 con 0x7fcbec1082a0 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec111f40 con 0x7fcbec1036e0 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf2e9f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec112240 con 0x7fcbec102d30 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 0x7fcbec19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 0x7fcbec19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39362/0 (socket says 172.21.15.1:39362) 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 -- 172.21.15.1:0/446310316 learned_addr learned my addr 172.21.15.1:0/446310316 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbe3fff640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec1036e0 0x7fcbec198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf0c3b640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbec102d30 0x7fcbec198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 -- 172.21.15.1:0/446310316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbec102d30 msgr2=0x7fcbec198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbec102d30 0x7fcbec198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 -- 172.21.15.1:0/446310316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec1036e0 msgr2=0x7fcbec198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec1036e0 0x7fcbec198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec19d5d0 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.522+0000 7fcbf143c640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 0x7fcbec19cef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b970 tx=0x7fcbe400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.523+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4019070 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.523+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe400cb40 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.523+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec19d8c0 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.523+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007650 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.523+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec1a51a0 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.524+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbec062980 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.525+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcbe401c070 con 0x7fcbec1082a0 2024-09-12T02:29:36.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbe1ffb640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcbd40a2c90 0x7fcbd40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbf0c3b640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcbd40a2c90 0x7fcbd40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcbe40ce540 con 0x7fcbec1082a0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbe1ffb640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] conn(0x7fcbd40ac4e0 0x7fcbd40ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbe4017e70 con 0x7fcbd40ac4e0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.526+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fcbe40d5050 con 0x7fcbec1082a0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.527+0000 7fcbf0c3b640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcbd40a2c90 0x7fcbd40a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800bbe0 tx=0x7fcbe800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.527+0000 7fcbe3fff640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] conn(0x7fcbd40ac4e0 0x7fcbd40ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.527+0000 7fcbe3fff640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] conn(0x7fcbd40ac4e0 0x7fcbd40ae900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.528+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== osd.6 v2:172.21.15.1:6818/2324171883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcbe4017e70 con 0x7fcbd40ac4e0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 --> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcbec062e00 con 0x7fcbd40ac4e0 2024-09-12T02:29:36.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbe1ffb640 1 -- 172.21.15.1:0/446310316 <== osd.6 v2:172.21.15.1:6818/2324171883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcbec062e00 con 0x7fcbd40ac4e0 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] conn(0x7fcbd40ac4e0 msgr2=0x7fcbd40ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] conn(0x7fcbd40ac4e0 0x7fcbd40ae900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcbd40a2c90 msgr2=0x7fcbd40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcbd40a2c90 0x7fcbd40a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800bbe0 tx=0x7fcbe800b390 comp rx=0 tx=0).stop 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 msgr2=0x7fcbec19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 --2- 172.21.15.1:0/446310316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbec1082a0 0x7fcbec19cef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b970 tx=0x7fcbe400be30 comp rx=0 tx=0).stop 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf143c640 1 -- 172.21.15.1:0/446310316 reap_dead start 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 shutdown_connections 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.543+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 >> 172.21.15.1:0/446310316 conn(0x7fcbec0fc7d0 msgr2=0x7fcbec105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.544+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 shutdown_connections 2024-09-12T02:29:36.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:36.544+0000 7fcbf2e9f640 1 -- 172.21.15.1:0/446310316 wait complete. 2024-09-12T02:29:37.525 INFO:teuthology.orchestra.run.smithi001.stdout:55834574921 2024-09-12T02:29:37.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- 172.21.15.1:0/3425905113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 msgr2=0x7f01b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 --2- 172.21.15.1:0/3425905113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b010da40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009ca0 tx=0x7f01a802a950 comp rx=0 tx=0).stop 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- 172.21.15.1:0/3425905113 shutdown_connections 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 --2- 172.21.15.1:0/3425905113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b010da40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 --2- 172.21.15.1:0/3425905113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0102570 0x7f01b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 --2- 172.21.15.1:0/3425905113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b0100e20 0x7f01b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- 172.21.15.1:0/3425905113 >> 172.21.15.1:0/3425905113 conn(0x7f01b00fc7d0 msgr2=0x7f01b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- 172.21.15.1:0/3425905113 shutdown_connections 2024-09-12T02:29:37.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- 172.21.15.1:0/3425905113 wait complete. 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 Processor -- start 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.707+0000 7f01b723a640 1 -- start start 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0100e20 0x7f01b00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b0102570 0x7f01b00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01b0110f80 con 0x7f01b0102ef0 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01b0110e00 con 0x7f01b0102570 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b723a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01b0111100 con 0x7f01b0100e20 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39384/0 (socket says 172.21.15.1:39384) 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 -- 172.21.15.1:0/347728058 learned_addr learned my addr 172.21.15.1:0/347728058 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01affff640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b0102570 0x7f01b00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:37.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b4fd6640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0100e20 0x7f01b00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 -- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0100e20 msgr2=0x7f01b00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0100e20 0x7f01b00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 -- 172.21.15.1:0/347728058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b0102570 msgr2=0x7f01b00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01b0102570 0x7f01b00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b01a6950 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b4fd6640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01b0100e20 0x7f01b00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.708+0000 7f01b57d7640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b00fd700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01a8004af0 tx=0x7f01a802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.709+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8034040 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.709+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b01a6be0 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.709+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a8030920 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.709+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004820 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.709+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b01a7110 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.710+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01b0062940 con 0x7f01b0102ef0 2024-09-12T02:29:37.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.711+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f01a8037020 con 0x7f01b0102ef0 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01adffb640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01a00a2c10 0x7f01a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01b4fd6640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01a00a2c10 0x7f01a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f01a80f0250 con 0x7f01b0102ef0 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01adffb640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] conn(0x7f01a00ac460 0x7f01a00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01a00aef30 con 0x7f01a00ac460 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f01a80f0600 con 0x7f01b0102ef0 2024-09-12T02:29:37.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.712+0000 7f01b4fd6640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01a00a2c10 0x7f01a00a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009c20 tx=0x7f01a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.713+0000 7f01affff640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] conn(0x7f01a00ac460 0x7f01a00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.713+0000 7f01affff640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] conn(0x7f01a00ac460 0x7f01a00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.714+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== osd.11 v2:172.21.15.173:6824/948409302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01a00aef30 con 0x7f01a00ac460 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.728+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 --> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01b0062d40 con 0x7f01a00ac460 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01adffb640 1 -- 172.21.15.1:0/347728058 <== osd.11 v2:172.21.15.173:6824/948409302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f01b0062d40 con 0x7f01a00ac460 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] conn(0x7f01a00ac460 msgr2=0x7f01a00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] conn(0x7f01a00ac460 0x7f01a00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01a00a2c10 msgr2=0x7f01a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01a00a2c10 0x7f01a00a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009c20 tx=0x7f01a4005f90 comp rx=0 tx=0).stop 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 msgr2=0x7f01b00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.729+0000 7f01b723a640 1 --2- 172.21.15.1:0/347728058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01b0102ef0 0x7f01b00fd700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01a8004af0 tx=0x7f01a802f5b0 comp rx=0 tx=0).stop 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.730+0000 7f01b57d7640 1 -- 172.21.15.1:0/347728058 reap_dead start 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.730+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 shutdown_connections 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.730+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 >> 172.21.15.1:0/347728058 conn(0x7f01b00fc7d0 msgr2=0x7f01b006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:37.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.730+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 shutdown_connections 2024-09-12T02:29:37.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:37.730+0000 7f01b723a640 1 -- 172.21.15.1:0/347728058 wait complete. 2024-09-12T02:29:37.833 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:37 smithi001 ceph-mon[31252]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:29:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:37 smithi134 ceph-mon[35091]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:29:37.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:37 smithi173 ceph-mon[35036]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:29:38.440 INFO:teuthology.orchestra.run.smithi001.stdout:103079215167 2024-09-12T02:29:38.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:29:39.099 INFO:teuthology.orchestra.run.smithi001.stdout:133143986234 2024-09-12T02:29:39.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 -- 172.21.15.1:0/4040155846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 msgr2=0x7f3790101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 --2- 172.21.15.1:0/4040155846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f3790101200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3780009900 tx=0x7f378002a480 comp rx=0 tx=0).stop 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 -- 172.21.15.1:0/4040155846 shutdown_connections 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 --2- 172.21.15.1:0/4040155846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3790102ef0 0x7f379010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 --2- 172.21.15.1:0/4040155846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 0x7f37901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 --2- 172.21.15.1:0/4040155846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f3790101200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 -- 172.21.15.1:0/4040155846 >> 172.21.15.1:0/4040155846 conn(0x7f37900fc7d0 msgr2=0x7f37900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 -- 172.21.15.1:0/4040155846 shutdown_connections 2024-09-12T02:29:39.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.282+0000 7f3795e9d640 1 -- 172.21.15.1:0/4040155846 wait complete. 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 Processor -- start 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 -- start start 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f37900fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 0x7f37900fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3790102ef0 0x7f37900fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3790110f80 con 0x7f3790100e20 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3790110e00 con 0x7f3790102ef0 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.283+0000 7f3795e9d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3790111100 con 0x7f3790102570 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f37900fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f37900fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39410/0 (socket says 172.21.15.1:39410) 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 -- 172.21.15.1:0/1530201841 learned_addr learned my addr 172.21.15.1:0/1530201841 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f3786ffd640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 0x7f37900fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378ffff640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3790102ef0 0x7f37900fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 -- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 msgr2=0x7f37900fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 0x7f37900fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 -- 172.21.15.1:0/1530201841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3790102ef0 msgr2=0x7f37900fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3790102ef0 0x7f37900fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901a6990 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f3786ffd640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3790102570 0x7f37900fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378f7fe640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f37900fcc80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3780006010 tx=0x7f3780003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378003f070 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37901a6c20 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3780031c30 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780035030 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.284+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37901a7100 con 0x7f3790100e20 2024-09-12T02:29:39.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.285+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3790062940 con 0x7f3790100e20 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.287+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3780042070 con 0x7f3790100e20 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f378d7fa640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f377c0a2c10 0x7f377c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f3786ffd640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f377c0a2c10 0x7f377c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f37800f0180 con 0x7f3790100e20 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f378d7fa640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] conn(0x7f377c0ac460 0x7f377c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f377c0aef30 con 0x7f377c0ac460 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f37800f0660 con 0x7f3790100e20 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.288+0000 7f3786ffd640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f377c0a2c10 0x7f377c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3778005fd0 tx=0x7f3778005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.289+0000 7f378ffff640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] conn(0x7f377c0ac460 0x7f377c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.289+0000 7f378ffff640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] conn(0x7f377c0ac460 0x7f377c0ae880 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.290+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== osd.5 v2:172.21.15.173:6808/2198908508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f377c0aef30 con 0x7f377c0ac460 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.304+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 --> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3790062dc0 con 0x7f377c0ac460 2024-09-12T02:29:39.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f378d7fa640 1 -- 172.21.15.1:0/1530201841 <== osd.5 v2:172.21.15.173:6808/2198908508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3790062dc0 con 0x7f377c0ac460 2024-09-12T02:29:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] conn(0x7f377c0ac460 msgr2=0x7f377c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] conn(0x7f377c0ac460 0x7f377c0ae880 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f377c0a2c10 msgr2=0x7f377c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f377c0a2c10 0x7f377c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3778005fd0 tx=0x7f3778005ea0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 msgr2=0x7f37900fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 --2- 172.21.15.1:0/1530201841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3790100e20 0x7f37900fcc80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3780006010 tx=0x7f3780003c10 comp rx=0 tx=0).stop 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f378ffff640 1 -- 172.21.15.1:0/1530201841 reap_dead start 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 shutdown_connections 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 >> 172.21.15.1:0/1530201841 conn(0x7f37900fc7d0 msgr2=0x7f379006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 shutdown_connections 2024-09-12T02:29:39.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:39.305+0000 7f3795e9d640 1 -- 172.21.15.1:0/1530201841 wait complete. 2024-09-12T02:29:39.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:39 smithi001 ceph-mon[31252]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:29:39.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:39 smithi134 ceph-mon[35091]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:29:39.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:39 smithi173 ceph-mon[35036]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:29:40.032 INFO:teuthology.orchestra.run.smithi001.stdout:184683593775 2024-09-12T02:29:40.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:29:40.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 -- 172.21.15.1:0/4187721775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0901027a0 msgr2=0x7ff0901067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 --2- 172.21.15.1:0/4187721775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0901027a0 0x7ff0901067f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff080009900 tx=0x7ff08002a410 comp rx=0 tx=0).stop 2024-09-12T02:29:40.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 -- 172.21.15.1:0/4187721775 shutdown_connections 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 --2- 172.21.15.1:0/4187721775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0901027a0 0x7ff0901067f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 --2- 172.21.15.1:0/4187721775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff090106f20 0x7ff09010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 --2- 172.21.15.1:0/4187721775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff090101df0 0x7ff0901021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 -- 172.21.15.1:0/4187721775 >> 172.21.15.1:0/4187721775 conn(0x7ff0900fd8b0 msgr2=0x7ff0900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 -- 172.21.15.1:0/4187721775 shutdown_connections 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.222+0000 7ff097f63640 1 -- 172.21.15.1:0/4187721775 wait complete. 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 Processor -- start 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 -- start start 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 0x7ff090198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0901027a0 0x7ff090198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff090106f20 0x7ff09019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff090111ff0 con 0x7ff090101df0 2024-09-12T02:29:40.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff090111e70 con 0x7ff0901027a0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff097f63640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff090112170 con 0x7ff090106f20 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff095cff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 0x7ff090198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff095cff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 0x7ff090198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39426/0 (socket says 172.21.15.1:39426) 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff095cff640 1 -- 172.21.15.1:0/2118421215 learned_addr learned my addr 172.21.15.1:0/2118421215 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.223+0000 7ff0954fe640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0901027a0 0x7ff090198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff096500640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff090106f20 0x7ff09019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 -- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff090106f20 msgr2=0x7ff09019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff090106f20 0x7ff09019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 -- 172.21.15.1:0/2118421215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0901027a0 msgr2=0x7ff090198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0901027a0 0x7ff090198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09019d3e0 con 0x7ff090101df0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff095cff640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 0x7ff090198430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c920 tx=0x7ff08c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007c70 con 0x7ff090101df0 2024-09-12T02:29:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09019d6d0 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff08c007e10 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c018890 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.224+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0901a4fb0 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.225+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff090062980 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.226+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff08c018a30 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff086ffd640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff07c0a2c10 0x7ff07c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff0954fe640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff07c0a2c10 0x7ff07c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff08c0cf500 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff086ffd640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] conn(0x7ff07c0ac460 0x7ff07c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff07c0aef30 con 0x7ff07c0ac460 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.227+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff08c0cf9e0 con 0x7ff090101df0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.228+0000 7ff0954fe640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff07c0a2c10 0x7ff07c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.228+0000 7ff096500640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] conn(0x7ff07c0ac460 0x7ff07c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.228+0000 7ff096500640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] conn(0x7ff07c0ac460 0x7ff07c0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.229+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== osd.2 v2:172.21.15.173:6800/396057210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff07c0aef30 con 0x7ff07c0ac460 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.243+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 --> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff090062e00 con 0x7ff07c0ac460 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.243+0000 7ff086ffd640 1 -- 172.21.15.1:0/2118421215 <== osd.2 v2:172.21.15.173:6800/396057210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff090062e00 con 0x7ff07c0ac460 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] conn(0x7ff07c0ac460 msgr2=0x7ff07c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] conn(0x7ff07c0ac460 0x7ff07c0ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff07c0a2c10 msgr2=0x7ff07c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff07c0a2c10 0x7ff07c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080005df0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 msgr2=0x7ff090198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 --2- 172.21.15.1:0/2118421215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff090101df0 0x7ff090198430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c920 tx=0x7ff08c00cde0 comp rx=0 tx=0).stop 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff096500640 1 -- 172.21.15.1:0/2118421215 reap_dead start 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 shutdown_connections 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 >> 172.21.15.1:0/2118421215 conn(0x7ff0900fd8b0 msgr2=0x7ff0900feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 shutdown_connections 2024-09-12T02:29:40.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:40.244+0000 7ff097f63640 1 -- 172.21.15.1:0/2118421215 wait complete. 2024-09-12T02:29:40.949 INFO:teuthology.orchestra.run.smithi001.stdout:73014444102 2024-09-12T02:29:40.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:29:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:317827579926 2024-09-12T02:29:41.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:29:41.711 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:41.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:41 smithi001 ceph-mon[31252]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:29:41.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:41 smithi134 ceph-mon[35091]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:29:41.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:41 smithi173 ceph-mon[35036]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:29:42.166 INFO:teuthology.orchestra.run.smithi001.stdout:154618822710 2024-09-12T02:29:42.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:29:42.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 -- 172.21.15.1:0/2536934279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c100a80 msgr2=0x7f941c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 --2- 172.21.15.1:0/2536934279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c100a80 0x7f941c100ee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f940c009930 tx=0x7f940c02a420 comp rx=0 tx=0).stop 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 -- 172.21.15.1:0/2536934279 shutdown_connections 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 --2- 172.21.15.1:0/2536934279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c100a80 0x7f941c100ee0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 --2- 172.21.15.1:0/2536934279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c101420 0x7f941c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 --2- 172.21.15.1:0/2536934279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c106a80 0x7f941c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.664+0000 7f9423b89640 1 -- 172.21.15.1:0/2536934279 >> 172.21.15.1:0/2536934279 conn(0x7f941c0fc7a0 msgr2=0x7f941c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.665+0000 7f9423b89640 1 -- 172.21.15.1:0/2536934279 shutdown_connections 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.665+0000 7f9423b89640 1 -- 172.21.15.1:0/2536934279 wait complete. 2024-09-12T02:29:42.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.665+0000 7f9423b89640 1 Processor -- start 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.665+0000 7f9423b89640 1 -- start start 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c100a80 0x7f941c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 0x7f941c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c106a80 0x7f941c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f941c110e40 con 0x7f941c101420 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f941c110cc0 con 0x7f941c100a80 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9423b89640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f941c110fc0 con 0x7f941c106a80 2024-09-12T02:29:42.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 0x7f941c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 0x7f941c102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46874/0 (socket says 172.21.15.1:46874) 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 -- 172.21.15.1:0/1536236998 learned_addr learned my addr 172.21.15.1:0/1536236998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421925640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c100a80 0x7f941c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9422126640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c106a80 0x7f941c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 -- 172.21.15.1:0/1536236998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c106a80 msgr2=0x7f941c1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c106a80 0x7f941c1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 -- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c100a80 msgr2=0x7f941c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c100a80 0x7f941c102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c1aae00 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.666+0000 7f9421124640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 0x7f941c102b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f940c009230 tx=0x7f940c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c03f030 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f940c003ad0 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c1aafd0 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c035070 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c1ab420 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.667+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f941c06aa60 con 0x7f941c101420 2024-09-12T02:29:42.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.669+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f940c042030 con 0x7f941c101420 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.669+0000 7f9412ffd640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f94080a2c10 0x7f94080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9421925640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f94080a2c10 0x7f94080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f940c0ef860 con 0x7f941c101420 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9412ffd640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] conn(0x7f94080ac460 0x7f94080ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f940c046e50 con 0x7f94080ac460 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f940c0efd40 con 0x7f941c101420 2024-09-12T02:29:42.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9422126640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] conn(0x7f94080ac460 0x7f94080ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9421925640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f94080a2c10 0x7f94080a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f941800bb60 tx=0x7f941800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.670+0000 7f9422126640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] conn(0x7f94080ac460 0x7f94080ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.671+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== osd.10 v2:172.21.15.134:6824/1157717766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f940c046e50 con 0x7f94080ac460 2024-09-12T02:29:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.685+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 --> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f941c1021c0 con 0x7f94080ac460 2024-09-12T02:29:42.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9412ffd640 1 -- 172.21.15.1:0/1536236998 <== osd.10 v2:172.21.15.134:6824/1157717766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f941c1021c0 con 0x7f94080ac460 2024-09-12T02:29:42.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] conn(0x7f94080ac460 msgr2=0x7f94080ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] conn(0x7f94080ac460 0x7f94080ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f94080a2c10 msgr2=0x7f94080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f94080a2c10 0x7f94080a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f941800bb60 tx=0x7f941800b390 comp rx=0 tx=0).stop 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 msgr2=0x7f941c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9423b89640 1 --2- 172.21.15.1:0/1536236998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f941c101420 0x7f941c102b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f940c009230 tx=0x7f940c004270 comp rx=0 tx=0).stop 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.686+0000 7f9422126640 1 -- 172.21.15.1:0/1536236998 reap_dead start 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.687+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 shutdown_connections 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.687+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 >> 172.21.15.1:0/1536236998 conn(0x7f941c0fc7a0 msgr2=0x7f941c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.687+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 shutdown_connections 2024-09-12T02:29:42.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:42.687+0000 7f9423b89640 1 -- 172.21.15.1:0/1536236998 wait complete. 2024-09-12T02:29:43.348 INFO:teuthology.orchestra.run.smithi001.stdout:287762808861 2024-09-12T02:29:43.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:29:43.626 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:43 smithi001 ceph-mon[31252]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:29:43.841 INFO:teuthology.orchestra.run.smithi001.stdout:34359738446 2024-09-12T02:29:43.842 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:29:43.851 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:43.908 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:43.909 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:43.910 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:43.912 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:43 smithi134 ceph-mon[35091]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:29:43.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:43 smithi173 ceph-mon[35036]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:29:44.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 -- 172.21.15.1:0/116779235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408102790 msgr2=0x7f84081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 --2- 172.21.15.1:0/116779235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408102790 0x7f84081067e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009900 tx=0x7f83f802a410 comp rx=0 tx=0).stop 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 -- 172.21.15.1:0/116779235 shutdown_connections 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 --2- 172.21.15.1:0/116779235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408102790 0x7f84081067e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 --2- 172.21.15.1:0/116779235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408106f10 0x7f840810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 --2- 172.21.15.1:0/116779235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f84081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.604+0000 7f840f4c1640 1 -- 172.21.15.1:0/116779235 >> 172.21.15.1:0/116779235 conn(0x7f84080fd8c0 msgr2=0x7f84080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- 172.21.15.1:0/116779235 shutdown_connections 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- 172.21.15.1:0/116779235 wait complete. 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 Processor -- start 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- start start 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f8408198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 0x7f8408198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8408111f70 con 0x7f8408106f10 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8408111df0 con 0x7f8408101de0 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840f4c1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84081120f0 con 0x7f8408102790 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.605+0000 7f840da5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46890/0 (socket says 172.21.15.1:46890) 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 -- 172.21.15.1:0/1952900140 learned_addr learned my addr 172.21.15.1:0/1952900140 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840ca5c640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 0x7f8408198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840d25d640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f8408198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 -- 172.21.15.1:0/1952900140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 msgr2=0x7f8408198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 0x7f8408198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 -- 172.21.15.1:0/1952900140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 msgr2=0x7f8408198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f8408198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 -- 172.21.15.1:0/1952900140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840819d3f0 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840ca5c640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 0x7f8408198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840d25d640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f8408198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840da5e640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f840000eaa0 tx=0x7f840000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840000cdb0 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8400005020 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840819d6e0 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000116b0 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.606+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84081a4fc0 con 0x7f8408106f10 2024-09-12T02:29:44.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.607+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84081021c0 con 0x7f8408106f10 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.608+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8400005560 con 0x7f8408106f10 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.609+0000 7f83fe7fc640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 0x7f83f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.609+0000 7f840d25d640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 0x7f83f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.609+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f84000cf3e0 con 0x7f8408106f10 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.609+0000 7f840d25d640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 0x7f83f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84040058c0 tx=0x7f8404005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.613+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8400016030 con 0x7f8408106f10 2024-09-12T02:29:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.793+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8408109bc0 con 0x7f8408106f10 2024-09-12T02:29:44.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.793+0000 7f83fe7fc640 1 -- 172.21.15.1:0/1952900140 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f840009c290 con 0x7f8408106f10 2024-09-12T02:29:44.793 INFO:teuthology.orchestra.run.smithi001.stdout:236223201318 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 msgr2=0x7f83f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 0x7f83f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84040058c0 tx=0x7f8404005ec0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 msgr2=0x7f840819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f840000eaa0 tx=0x7f840000ef60 comp rx=0 tx=0).stop 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 shutdown_connections 2024-09-12T02:29:44.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f83f40a2c10 0x7f83f40a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8408106f10 0x7f840819cd10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8408102790 0x7f8408198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 --2- 172.21.15.1:0/1952900140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8408101de0 0x7f8408198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 >> 172.21.15.1:0/1952900140 conn(0x7f84080fd8c0 msgr2=0x7f84080fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 shutdown_connections 2024-09-12T02:29:44.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.797+0000 7f840f4c1640 1 -- 172.21.15.1:0/1952900140 wait complete. 2024-09-12T02:29:44.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 -- 172.21.15.1:0/2890417946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc101df0 msgr2=0x7f0ecc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 --2- 172.21.15.1:0/2890417946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc101df0 0x7f0ecc1021d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009900 tx=0x7f0ec802a410 comp rx=0 tx=0).stop 2024-09-12T02:29:44.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 -- 172.21.15.1:0/2890417946 shutdown_connections 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 --2- 172.21.15.1:0/2890417946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc106f20 0x7f0ecc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 --2- 172.21.15.1:0/2890417946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 --2- 172.21.15.1:0/2890417946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc101df0 0x7f0ecc1021d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 -- 172.21.15.1:0/2890417946 >> 172.21.15.1:0/2890417946 conn(0x7f0ecc0fd8f0 msgr2=0x7f0ecc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 -- 172.21.15.1:0/2890417946 shutdown_connections 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.823+0000 7f0ed4254640 1 -- 172.21.15.1:0/2890417946 wait complete. 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 Processor -- start 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 -- start start 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc101df0 0x7f0ecc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc111f40 con 0x7f0ecc106f20 2024-09-12T02:29:44.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc111dc0 con 0x7f0ecc1027a0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed4254640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc1120c0 con 0x7f0ecc101df0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed27f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed27f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46906/0 (socket says 172.21.15.1:46906) 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed27f1640 1 -- 172.21.15.1:0/1834864815 learned_addr learned my addr 172.21.15.1:0/1834864815 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed1ff0640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc101df0 0x7f0ecc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.824+0000 7f0ed17ef640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 -- 172.21.15.1:0/1834864815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc101df0 msgr2=0x7f0ecc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc101df0 0x7f0ecc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 -- 172.21.15.1:0/1834864815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 msgr2=0x7f0ecc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 -- 172.21.15.1:0/1834864815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc19d400 con 0x7f0ecc106f20 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed17ef640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed27f1640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400eaa0 tx=0x7f0ec400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400cdb0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc19d6f0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4005020 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40116b0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.825+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc1a4fd0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.827+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc1021d0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.827+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0ec4011850 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.828+0000 7f0ec2ffd640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 0x7f0eb80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.828+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0ec40cf1d0 con 0x7f0ecc106f20 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.828+0000 7f0ed1ff0640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 0x7f0eb80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.829+0000 7f0ed1ff0640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 0x7f0eb80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009230 tx=0x7f0ec80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:44.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:44.835+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ec4016030 con 0x7f0ecc106f20 2024-09-12T02:29:45.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.014+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0ecc109b70 con 0x7f0ecc106f20 2024-09-12T02:29:45.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.014+0000 7f0ec2ffd640 1 -- 172.21.15.1:0/1834864815 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0ec409c180 con 0x7f0ecc106f20 2024-09-12T02:29:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:317827579927 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 msgr2=0x7f0eb80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 0x7f0eb80a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009230 tx=0x7f0ec80058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 msgr2=0x7f0ecc19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400eaa0 tx=0x7f0ec400ef60 comp rx=0 tx=0).stop 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 shutdown_connections 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0eb80a2c10 0x7f0eb80a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ecc106f20 0x7f0ecc19cd20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ecc1027a0 0x7f0ecc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 --2- 172.21.15.1:0/1834864815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ecc101df0 0x7f0ecc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.016+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 >> 172.21.15.1:0/1834864815 conn(0x7f0ecc0fd8f0 msgr2=0x7f0ecc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.017+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 shutdown_connections 2024-09-12T02:29:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:45.017+0000 7f0ed4254640 1 -- 172.21.15.1:0/1834864815 wait complete. 2024-09-12T02:29:45.317 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:45.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:45 smithi001 ceph-mon[31252]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:29:45.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:45 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1952900140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:29:45.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:45 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1834864815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:29:45.756 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:45.773 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201315 got 236223201318 for osd.8 2024-09-12T02:29:45.773 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:45 smithi134 ceph-mon[35091]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:29:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:45 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1952900140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:29:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:45 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1834864815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:29:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:45 smithi173 ceph-mon[35036]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:29:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:45 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1952900140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:29:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:45 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1834864815' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:29:46.036 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:46.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579926 got 317827579927 for osd.11 2024-09-12T02:29:46.738 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:46.968 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:47.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 -- 172.21.15.1:0/2155408633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102ef0 msgr2=0x7f386810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 --2- 172.21.15.1:0/2155408633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102ef0 0x7f386810da40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3860009ca0 tx=0x7f386002a950 comp rx=0 tx=0).stop 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 -- 172.21.15.1:0/2155408633 shutdown_connections 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 --2- 172.21.15.1:0/2155408633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102ef0 0x7f386810da40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 --2- 172.21.15.1:0/2155408633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102570 0x7f38681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 --2- 172.21.15.1:0/2155408633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f3868101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 -- 172.21.15.1:0/2155408633 >> 172.21.15.1:0/2155408633 conn(0x7f38680fc7d0 msgr2=0x7f38680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 -- 172.21.15.1:0/2155408633 shutdown_connections 2024-09-12T02:29:47.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.686+0000 7f386e94d640 1 -- 172.21.15.1:0/2155408633 wait complete. 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 Processor -- start 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 -- start start 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f386819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102ef0 0x7f3868196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3868110f80 con 0x7f3868102570 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3868110e00 con 0x7f3868100e20 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386e94d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3868111100 con 0x7f3868102ef0 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f38677fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f38677fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46932/0 (socket says 172.21.15.1:46932) 2024-09-12T02:29:47.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f38677fe640 1 -- 172.21.15.1:0/2766522845 learned_addr learned my addr 172.21.15.1:0/2766522845 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.687+0000 7f386ceea640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102ef0 0x7f3868196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f3867fff640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f386819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 -- 172.21.15.1:0/2766522845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102ef0 msgr2=0x7f3868196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102ef0 0x7f3868196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 -- 172.21.15.1:0/2766522845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 msgr2=0x7f386819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f386819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 -- 172.21.15.1:0/2766522845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3868196e70 con 0x7f3868102570 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f3867fff640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f386819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38677fe640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f385c009fd0 tx=0x7f385c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.688+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cde0 con 0x7f3868102570 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.689+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f385c0035f0 con 0x7f3868102570 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.689+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3868197100 con 0x7f3868102570 2024-09-12T02:29:47.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.689+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c0216a0 con 0x7f3868102570 2024-09-12T02:29:47.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.689+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386806bde0 con 0x7f3868102570 2024-09-12T02:29:47.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.690+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38681021b0 con 0x7f3868102570 2024-09-12T02:29:47.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.692+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f385c0037a0 con 0x7f3868102570 2024-09-12T02:29:47.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.693+0000 7f38657fa640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 0x7f38500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.693+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f385c0e0360 con 0x7f3868102570 2024-09-12T02:29:47.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.693+0000 7f3867fff640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 0x7f38500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.694+0000 7f3867fff640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 0x7f38500a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3858009fc0 tx=0x7f3858005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.697+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f385c0ad210 con 0x7f3868102570 2024-09-12T02:29:47.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:47 smithi001 ceph-mon[31252]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:29:47.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 -- 172.21.15.1:0/626251444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28101de0 msgr2=0x7f3f281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 --2- 172.21.15.1:0/626251444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28101de0 0x7f3f281021c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009900 tx=0x7f3f2402a410 comp rx=0 tx=0).stop 2024-09-12T02:29:47.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 -- 172.21.15.1:0/626251444 shutdown_connections 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 --2- 172.21.15.1:0/626251444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28106f10 0x7f3f2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 --2- 172.21.15.1:0/626251444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28102790 0x7f3f281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 --2- 172.21.15.1:0/626251444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28101de0 0x7f3f281021c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 -- 172.21.15.1:0/626251444 >> 172.21.15.1:0/626251444 conn(0x7f3f280fd8c0 msgr2=0x7f3f280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 -- 172.21.15.1:0/626251444 shutdown_connections 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.531+0000 7f3f30505640 1 -- 172.21.15.1:0/626251444 wait complete. 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 Processor -- start 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 -- start start 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28101de0 0x7f3f280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28102790 0x7f3f28074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28111f30 con 0x7f3f28106f10 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28111db0 con 0x7f3f28102790 2024-09-12T02:29:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f30505640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281120b0 con 0x7f3f28101de0 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f2eaa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f2eaa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46912/0 (socket says 172.21.15.1:46912) 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.532+0000 7f3f2eaa2640 1 -- 172.21.15.1:0/1160178688 learned_addr learned my addr 172.21.15.1:0/1160178688 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2e2a1640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28101de0 0x7f3f280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2daa0640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28102790 0x7f3f28074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stdout:287762808862 2024-09-12T02:29:47.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 -- 172.21.15.1:0/1160178688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28101de0 msgr2=0x7f3f280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28101de0 0x7f3f280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 -- 172.21.15.1:0/1160178688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28102790 msgr2=0x7f3f28074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28102790 0x7f3f28074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 -- 172.21.15.1:0/1160178688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f281a6890 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f2eaa2640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000eaa0 tx=0x7f3f2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20004d20 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f20005020 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f281a6b80 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f200116d0 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.533+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f281a7070 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.534+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f281021c0 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.537+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3f200051d0 con 0x7f3f28106f10 2024-09-12T02:29:47.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.538+0000 7f3f1f7fe640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 0x7f3f140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.538+0000 7f3f2e2a1640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 0x7f3f140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.538+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3f200cf5e0 con 0x7f3f28106f10 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.538+0000 7f3f2e2a1640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 0x7f3f140a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009230 tx=0x7f3f240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.541+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f20016030 con 0x7f3f28106f10 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.727+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3f28075a20 con 0x7f3f28106f10 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.728+0000 7f3f1f7fe640 1 -- 172.21.15.1:0/1160178688 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3f28075a20 con 0x7f3f28106f10 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 msgr2=0x7f3f140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 0x7f3f140a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009230 tx=0x7f3f240058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 msgr2=0x7f3f28074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000eaa0 tx=0x7f3f2000eea0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 shutdown_connections 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f140a2c10 0x7f3f140a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f28106f10 0x7f3f28074f70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f28102790 0x7f3f28074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 --2- 172.21.15.1:0/1160178688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f28101de0 0x7f3f280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 >> 172.21.15.1:0/1160178688 conn(0x7f3f280fd8c0 msgr2=0x7f3f280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 shutdown_connections 2024-09-12T02:29:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.730+0000 7f3f30505640 1 -- 172.21.15.1:0/1160178688 wait complete. 2024-09-12T02:29:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.903+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3868101200 con 0x7f3868102570 2024-09-12T02:29:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.903+0000 7f38657fa640 1 -- 172.21.15.1:0/2766522845 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f385c0acb10 con 0x7f3868102570 2024-09-12T02:29:47.904 INFO:teuthology.orchestra.run.smithi001.stdout:133143986237 2024-09-12T02:29:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 msgr2=0x7f38500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 0x7f38500a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3858009fc0 tx=0x7f3858005f90 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 msgr2=0x7f38681963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f385c009fd0 tx=0x7f385c00eec0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 shutdown_connections 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f38500a2c90 0x7f38500a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3868102570 0x7f38681963f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3868102ef0 0x7f3868196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 --2- 172.21.15.1:0/2766522845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3868100e20 0x7f386819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 >> 172.21.15.1:0/2766522845 conn(0x7f38680fc7d0 msgr2=0x7f386806a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 shutdown_connections 2024-09-12T02:29:47.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:47.905+0000 7f386e94d640 1 -- 172.21.15.1:0/2766522845 wait complete. 2024-09-12T02:29:47.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:47 smithi134 ceph-mon[35091]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:29:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:47 smithi173 ceph-mon[35036]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:29:48.259 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:48.259 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:48.669 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:48 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:48.669 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1160178688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:29:48.669 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2766522845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:29:48.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986237 for osd.4 2024-09-12T02:29:48.836 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:48.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 -- 172.21.15.1:0/1094676630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102570 msgr2=0x7f14b81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 --2- 172.21.15.1:0/1094676630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102570 0x7f14b81029b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009900 tx=0x7f14a802a480 comp rx=0 tx=0).stop 2024-09-12T02:29:48.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 -- 172.21.15.1:0/1094676630 shutdown_connections 2024-09-12T02:29:48.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 --2- 172.21.15.1:0/1094676630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102570 0x7f14b81029b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 --2- 172.21.15.1:0/1094676630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102ef0 0x7f14b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 --2- 172.21.15.1:0/1094676630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.480+0000 7f14bf269640 1 -- 172.21.15.1:0/1094676630 >> 172.21.15.1:0/1094676630 conn(0x7f14b80fc7d0 msgr2=0x7f14b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.481+0000 7f14bf269640 1 -- 172.21.15.1:0/1094676630 shutdown_connections 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.481+0000 7f14bf269640 1 -- 172.21.15.1:0/1094676630 wait complete. 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.481+0000 7f14bf269640 1 Processor -- start 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.481+0000 7f14bf269640 1 -- start start 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102570 0x7f14b8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14b8110f80 con 0x7f14b8102ef0 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14b8110e00 con 0x7f14b8100e20 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bf269640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14b8111100 con 0x7f14b8102570 2024-09-12T02:29:48.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46964/0 (socket says 172.21.15.1:46964) 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 -- 172.21.15.1:0/3052188286 learned_addr learned my addr 172.21.15.1:0/3052188286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd005640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bc804640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102570 0x7f14b8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 -- 172.21.15.1:0/3052188286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102570 msgr2=0x7f14b8197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102570 0x7f14b8197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 -- 172.21.15.1:0/3052188286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 msgr2=0x7f14b81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 -- 172.21.15.1:0/3052188286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b819c390 con 0x7f14b8102ef0 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd005640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.482+0000 7f14bd806640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f14b000eb10 tx=0x7f14b000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.483+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0004b20 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stdout:103079215170 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.483+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b0004cc0 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.483+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b819c680 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.483+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0010760 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.483+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b81a3f60 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.484+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b8101200 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.485+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f14b0005020 con 0x7f14b8102ef0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.486+0000 7f14ae7fc640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 0x7f14a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.486+0000 7f14bd005640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 0x7f14a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:48.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.486+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14b00cf600 con 0x7f14b8102ef0 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.486+0000 7f14bd005640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 0x7f14a40a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009fc0 tx=0x7f14b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.491+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14b009c5b0 con 0x7f14b8102ef0 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.669+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f14b8109090 con 0x7f14b8102ef0 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.669+0000 7f14ae7fc640 1 -- 172.21.15.1:0/3052188286 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f14b009beb0 con 0x7f14b8102ef0 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 msgr2=0x7f14a40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 0x7f14a40a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009fc0 tx=0x7f14b4005f90 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 msgr2=0x7f14b819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f14b000eb10 tx=0x7f14b000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 shutdown_connections 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f14a40a2c90 0x7f14a40a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14b8102ef0 0x7f14b819bcb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14b8102570 0x7f14b8197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 --2- 172.21.15.1:0/3052188286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b8100e20 0x7f14b81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 >> 172.21.15.1:0/3052188286 conn(0x7f14b80fc7d0 msgr2=0x7f14b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:48.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 shutdown_connections 2024-09-12T02:29:48.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:48.671+0000 7f14bf269640 1 -- 172.21.15.1:0/3052188286 wait complete. 2024-09-12T02:29:48.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:48 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:48.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:48 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1160178688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:29:48.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:48 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2766522845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:29:48.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:48 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:48.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:48 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1160178688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:29:48.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:48 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2766522845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3052188286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.821 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:49 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3052188286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:49 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 -- 172.21.15.1:0/786000879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0102ef0 msgr2=0x7f05b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/786000879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0102ef0 0x7f05b010da40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009ca0 tx=0x7f05a802a950 comp rx=0 tx=0).stop 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 -- 172.21.15.1:0/786000879 shutdown_connections 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/786000879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0102ef0 0x7f05b010da40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/786000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 0x7f05b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/786000879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0100e20 0x7f05b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 -- 172.21.15.1:0/786000879 >> 172.21.15.1:0/786000879 conn(0x7f05b00fc7d0 msgr2=0x7f05b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:49.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 -- 172.21.15.1:0/786000879 shutdown_connections 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.926+0000 7f05b4d5a640 1 -- 172.21.15.1:0/786000879 wait complete. 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.927+0000 7f05b4d5a640 1 Processor -- start 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.927+0000 7f05b4d5a640 1 -- start start 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 0x7f05b0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0102ef0 0x7f05b019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0110f80 con 0x7f05b0100e20 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0110e00 con 0x7f05b0102ef0 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05b4d5a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0111100 con 0x7f05b0102570 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47006/0 (socket says 172.21.15.1:47006) 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 -- 172.21.15.1:0/3483060492 learned_addr learned my addr 172.21.15.1:0/3483060492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05a5d9b640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 0x7f05b0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05aed9d640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0102ef0 0x7f05b019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 -- 172.21.15.1:0/3483060492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 msgr2=0x7f05b0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 0x7f05b0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 -- 172.21.15.1:0/3483060492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0102ef0 msgr2=0x7f05b019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0102ef0 0x7f05b019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 -- 172.21.15.1:0/3483060492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b019d380 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05ae59c640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c920 tx=0x7f05a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0007c70 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.928+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a0007e10 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.929+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0018890 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.929+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b019d670 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.929+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b01a4f50 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.930+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b0101200 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.931+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f05a0018a50 con 0x7f05b0100e20 2024-09-12T02:29:49.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.931+0000 7f05a7fff640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 0x7f059c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.932+0000 7f05a5d9b640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 0x7f059c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.932+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f05a00cf350 con 0x7f05b0100e20 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.932+0000 7f05a5d9b640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 0x7f059c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05b01051c0 tx=0x7f059800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:49.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.935+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05a0014030 con 0x7f05b0100e20 2024-09-12T02:29:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:29:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3052188286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:29:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:49.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:49 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2266477643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0101de0 msgr2=0x7f1ea01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2266477643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0101de0 0x7f1ea01021c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009900 tx=0x7f1e9002a410 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2266477643 shutdown_connections 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2266477643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0106f10 0x7f1ea010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2266477643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0102790 0x7f1ea01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2266477643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0101de0 0x7f1ea01021c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2266477643 >> 172.21.15.1:0/2266477643 conn(0x7f1ea00fd8c0 msgr2=0x7f1ea00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2266477643 shutdown_connections 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.820+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2266477643 wait complete. 2024-09-12T02:29:50.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 Processor -- start 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 -- start start 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0101de0 0x7f1ea019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0102790 0x7f1ea019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111f90 con 0x7f1ea0106f10 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111e10 con 0x7f1ea0102790 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1ea53dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0112110 con 0x7f1ea0101de0 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1e9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1e9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46982/0 (socket says 172.21.15.1:46982) 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1e9f7fe640 1 -- 172.21.15.1:0/2428377248 learned_addr learned my addr 172.21.15.1:0/2428377248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1e9effd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0101de0 0x7f1ea019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.821+0000 7f1e9e7fc640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0102790 0x7f1ea019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stdout:154618822712 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 -- 172.21.15.1:0/2428377248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0101de0 msgr2=0x7f1ea019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0101de0 0x7f1ea019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 -- 172.21.15.1:0/2428377248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0102790 msgr2=0x7f1ea019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0102790 0x7f1ea019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 -- 172.21.15.1:0/2428377248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea019f6c0 con 0x7f1ea0106f10 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e9f7fe640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009fd0 tx=0x7f1e9800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98017070 con 0x7f1ea0106f10 2024-09-12T02:29:50.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea019f9b0 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e98003e50 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98010460 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.822+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea01a7290 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.823+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea01021c0 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.824+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1e98003970 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.825+0000 7f1e87fff640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 0x7f1e880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.825+0000 7f1e9effd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 0x7f1e880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.825+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f1e980cec40 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.825+0000 7f1e9effd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 0x7f1e880a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009230 tx=0x7f1e900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:49.828+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e9809bbf0 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.006+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1ea01a74c0 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.007+0000 7f1e87fff640 1 -- 172.21.15.1:0/2428377248 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1e9809b4f0 con 0x7f1ea0106f10 2024-09-12T02:29:50.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 msgr2=0x7f1e880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 0x7f1e880a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009230 tx=0x7f1e900058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 msgr2=0x7f1ea019efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009fd0 tx=0x7f1e9800def0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 shutdown_connections 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1e880a2c10 0x7f1e880a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea0106f10 0x7f1ea019efe0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ea0102790 0x7f1ea019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 --2- 172.21.15.1:0/2428377248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ea0101de0 0x7f1ea019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 >> 172.21.15.1:0/2428377248 conn(0x7f1ea00fd8c0 msgr2=0x7f1ea00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.009+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 shutdown_connections 2024-09-12T02:29:50.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.010+0000 7f1ea53dd640 1 -- 172.21.15.1:0/2428377248 wait complete. 2024-09-12T02:29:50.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.113+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f05b0199730 con 0x7f05b0100e20 2024-09-12T02:29:50.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.114+0000 7f05a7fff640 1 -- 172.21.15.1:0/3483060492 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05a009c390 con 0x7f05b0100e20 2024-09-12T02:29:50.114 INFO:teuthology.orchestra.run.smithi001.stdout:34359738449 2024-09-12T02:29:50.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 msgr2=0x7f059c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 0x7f059c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f05b01051c0 tx=0x7f059800b410 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 msgr2=0x7f05b01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c920 tx=0x7f05a000cde0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 shutdown_connections 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f059c0a2c10 0x7f059c0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05b0102ef0 0x7f05b019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102570 0x7f05b0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 --2- 172.21.15.1:0/3483060492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05b0100e20 0x7f05b01983d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 >> 172.21.15.1:0/3483060492 conn(0x7f05b00fc7d0 msgr2=0x7f05b006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 shutdown_connections 2024-09-12T02:29:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:50.116+0000 7f05b4d5a640 1 -- 172.21.15.1:0/3483060492 wait complete. 2024-09-12T02:29:50.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:50 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2428377248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:29:50.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:50 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3483060492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:29:50.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:50 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2428377248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:29:50.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:50 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3483060492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:29:50.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:50 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2428377248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:29:50.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:50 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3483060492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:29:51.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-09-12T02:29:51.246 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:51.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 -- 172.21.15.1:0/2177716104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e81027c0 msgr2=0x7fc7e8106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 --2- 172.21.15.1:0/2177716104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e81027c0 0x7fc7e8106810 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009900 tx=0x7fc7dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:29:51.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 -- 172.21.15.1:0/2177716104 shutdown_connections 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 --2- 172.21.15.1:0/2177716104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e81027c0 0x7fc7e8106810 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 --2- 172.21.15.1:0/2177716104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e8106f40 0x7fc7e810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 --2- 172.21.15.1:0/2177716104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 0x7fc7e81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 -- 172.21.15.1:0/2177716104 >> 172.21.15.1:0/2177716104 conn(0x7fc7e80fd8d0 msgr2=0x7fc7e80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 -- 172.21.15.1:0/2177716104 shutdown_connections 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 -- 172.21.15.1:0/2177716104 wait complete. 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.429+0000 7fc7ef442640 1 Processor -- start 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 -- start start 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 0x7fc7e8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e81027c0 0x7fc7e8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8111f60 con 0x7fc7e8106f40 2024-09-12T02:29:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8111de0 con 0x7fc7e81027c0 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ef442640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e81120e0 con 0x7fc7e8101e10 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57804/0 (socket says 172.21.15.1:57804) 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 -- 172.21.15.1:0/692665136 learned_addr learned my addr 172.21.15.1:0/692665136 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ec9dd640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e81027c0 0x7fc7e8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed1de640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 0x7fc7e8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 -- 172.21.15.1:0/692665136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 msgr2=0x7fc7e8198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 0x7fc7e8198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 -- 172.21.15.1:0/692665136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e81027c0 msgr2=0x7fc7e8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e81027c0 0x7fc7e8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 -- 172.21.15.1:0/692665136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e819d510 con 0x7fc7e8106f40 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.430+0000 7fc7ed9df640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cad0 tx=0x7fc7d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.431+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800ae20 con 0x7fc7e8106f40 2024-09-12T02:29:51.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.431+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7d8005020 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.431+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e819d800 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.431+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800f6f0 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.431+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e81a50e0 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.432+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e81021f0 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.433+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc7d80051d0 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.434+0000 7fc7e67fc640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.434+0000 7fc7ed1de640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.434+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc7d80cf460 con 0x7fc7e8106f40 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.434+0000 7fc7ed1de640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0005fd0 tx=0x7fc7e000b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:51.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.437+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7d8014030 con 0x7fc7e8106f40 2024-09-12T02:29:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.618+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc7e81998c0 con 0x7fc7e8106f40 2024-09-12T02:29:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.618+0000 7fc7e67fc640 1 -- 172.21.15.1:0/692665136 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc7e81998c0 con 0x7fc7e8106f40 2024-09-12T02:29:51.618 INFO:teuthology.orchestra.run.smithi001.stdout:206158430254 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 msgr2=0x7fc7d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0005fd0 tx=0x7fc7e000b590 comp rx=0 tx=0).stop 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 msgr2=0x7fc7e819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cad0 tx=0x7fc7d800cf90 comp rx=0 tx=0).stop 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 shutdown_connections 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7d00a2c10 0x7fc7d00a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc7e8106f40 0x7fc7e819ce30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e81027c0 0x7fc7e8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 --2- 172.21.15.1:0/692665136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7e8101e10 0x7fc7e8198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.620+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 >> 172.21.15.1:0/692665136 conn(0x7fc7e80fd8d0 msgr2=0x7fc7e80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.621+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 shutdown_connections 2024-09-12T02:29:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:51.621+0000 7fc7ef442640 1 -- 172.21.15.1:0/692665136 wait complete. 2024-09-12T02:29:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:51 smithi001 ceph-mon[31252]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:29:51.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:51 smithi134 ceph-mon[35091]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:29:51.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:51 smithi173 ceph-mon[35036]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:29:52.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215167 got 103079215170 for osd.3 2024-09-12T02:29:52.359 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:52.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 -- 172.21.15.1:0/3676952756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c100a80 msgr2=0x7f2f0c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3676952756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c100a80 0x7f2f0c100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009930 tx=0x7f2f0002a420 comp rx=0 tx=0).stop 2024-09-12T02:29:52.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 -- 172.21.15.1:0/3676952756 shutdown_connections 2024-09-12T02:29:52.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3676952756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c100a80 0x7f2f0c100ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3676952756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c101420 0x7f2f0c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3676952756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 0x7f2f0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 -- 172.21.15.1:0/3676952756 >> 172.21.15.1:0/3676952756 conn(0x7f2f0c0fc7a0 msgr2=0x7f2f0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 -- 172.21.15.1:0/3676952756 shutdown_connections 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.784+0000 7f2f128d2640 1 -- 172.21.15.1:0/3676952756 wait complete. 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 Processor -- start 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 -- start start 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c100a80 0x7f2f0c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 0x7f2f0c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c110f20 con 0x7f2f0c101420 2024-09-12T02:29:52.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c110da0 con 0x7f2f0c100a80 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.785+0000 7f2f128d2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1110a0 con 0x7f2f0c106a80 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57832/0 (socket says 172.21.15.1:57832) 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 -- 172.21.15.1:0/3444688636 learned_addr learned my addr 172.21.15.1:0/3444688636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f10e6f640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 0x7f2f0c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0bfff640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c100a80 0x7f2f0c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 -- 172.21.15.1:0/3444688636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 msgr2=0x7f2f0c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 0x7f2f0c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 -- 172.21.15.1:0/3444688636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c100a80 msgr2=0x7f2f0c1974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c100a80 0x7f2f0c1974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 -- 172.21.15.1:0/3444688636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c19c4a0 con 0x7f2f0c101420 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f0b7fe640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009a50 tx=0x7f2f00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0003f030 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c19c730 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f00003ce0 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00035070 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.786+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c1a4070 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.788+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0c100f60 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.789+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2f00042030 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.789+0000 7f2f097fa640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 0x7f2ef40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.789+0000 7f2f0bfff640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 0x7f2ef40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.789+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2f000ef690 con 0x7f2f0c101420 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.790+0000 7f2f0bfff640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 0x7f2ef40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009890 tx=0x7f2efc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:52.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.793+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f000bc640 con 0x7f2f0c101420 2024-09-12T02:29:52.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:52 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/692665136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:29:52.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:52 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/692665136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:29:52.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:52 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/692665136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:29:52.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.971+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2f0c109040 con 0x7f2f0c101420 2024-09-12T02:29:52.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.971+0000 7f2f097fa640 1 -- 172.21.15.1:0/3444688636 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f000bbf40 con 0x7f2f0c101420 2024-09-12T02:29:52.972 INFO:teuthology.orchestra.run.smithi001.stdout:184683593778 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 msgr2=0x7f2ef40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 0x7f2ef40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009890 tx=0x7f2efc008040 comp rx=0 tx=0).stop 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 msgr2=0x7f2f0c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009a50 tx=0x7f2f00004270 comp rx=0 tx=0).stop 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 shutdown_connections 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2ef40a2c10 0x7f2ef40a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f0c101420 0x7f2f0c197a30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f0c106a80 0x7f2f0c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 --2- 172.21.15.1:0/3444688636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f0c100a80 0x7f2f0c1974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:52.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 >> 172.21.15.1:0/3444688636 conn(0x7f2f0c0fc7a0 msgr2=0x7f2f0c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:52.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 shutdown_connections 2024-09-12T02:29:52.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:52.974+0000 7f2f128d2640 1 -- 172.21.15.1:0/3444688636 wait complete. 2024-09-12T02:29:53.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 -- 172.21.15.1:0/1734212968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 msgr2=0x7f0c201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/1734212968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c201029b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009900 tx=0x7f0c0802a480 comp rx=0 tx=0).stop 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 -- 172.21.15.1:0/1734212968 shutdown_connections 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/1734212968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c201029b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/1734212968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 0x7f0c2010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/1734212968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 0x7f0c20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 -- 172.21.15.1:0/1734212968 >> 172.21.15.1:0/1734212968 conn(0x7f0c200fc7d0 msgr2=0x7f0c200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 -- 172.21.15.1:0/1734212968 shutdown_connections 2024-09-12T02:29:53.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 -- 172.21.15.1:0/1734212968 wait complete. 2024-09-12T02:29:53.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.012+0000 7f0c25eb9640 1 Processor -- start 2024-09-12T02:29:53.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 -- start start 2024-09-12T02:29:53.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 0x7f0c20198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20110f80 con 0x7f0c20102570 2024-09-12T02:29:53.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20110e00 con 0x7f0c20102ef0 2024-09-12T02:29:53.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c25eb9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20111100 con 0x7f0c20100e20 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57858/0 (socket says 172.21.15.1:57858) 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 -- 172.21.15.1:0/2104929436 learned_addr learned my addr 172.21.15.1:0/2104929436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c1ffff640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c1f7fe640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 0x7f0c20198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 -- 172.21.15.1:0/2104929436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 msgr2=0x7f0c20198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 0x7f0c20198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 -- 172.21.15.1:0/2104929436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 msgr2=0x7f0c2019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 -- 172.21.15.1:0/2104929436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2019d500 con 0x7f0c20102570 2024-09-12T02:29:53.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.013+0000 7f0c17fff640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c08006010 tx=0x7f0c08003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.014+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0803f070 con 0x7f0c20102570 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.014+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c08031c30 con 0x7f0c20102570 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.014+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2019d790 con 0x7f0c20102570 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.014+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08035030 con 0x7f0c20102570 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.014+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c201a50d0 con 0x7f0c20102570 2024-09-12T02:29:53.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.015+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c201021b0 con 0x7f0c20102570 2024-09-12T02:29:53.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.016+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0c08042070 con 0x7f0c20102570 2024-09-12T02:29:53.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.017+0000 7f0c1d7fa640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 0x7f0c0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.017+0000 7f0c1f7fe640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 0x7f0c0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.017+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0c080ef7e0 con 0x7f0c20102570 2024-09-12T02:29:53.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.017+0000 7f0c1f7fe640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 0x7f0c0c0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000bbe0 tx=0x7f0c1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.021+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c08031de0 con 0x7f0c20102570 2024-09-12T02:29:53.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.198+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0c2010a0a0 con 0x7f0c20102570 2024-09-12T02:29:53.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.198+0000 7f0c1d7fa640 1 -- 172.21.15.1:0/2104929436 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c080bc140 con 0x7f0c20102570 2024-09-12T02:29:53.199 INFO:teuthology.orchestra.run.smithi001.stdout:55834574925 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 msgr2=0x7f0c0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 0x7f0c0c0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000bbe0 tx=0x7f0c1000b390 comp rx=0 tx=0).stop 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 msgr2=0x7f0c20198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c08006010 tx=0x7f0c08003c10 comp rx=0 tx=0).stop 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 shutdown_connections 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0c0c0a2c10 0x7f0c0c0a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102570 0x7f0c20198a90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 --2- 172.21.15.1:0/2104929436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c20100e20 0x7f0c20198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 >> 172.21.15.1:0/2104929436 conn(0x7f0c200fc7d0 msgr2=0x7f0c2006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 shutdown_connections 2024-09-12T02:29:53.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.201+0000 7f0c25eb9640 1 -- 172.21.15.1:0/2104929436 wait complete. 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 -- 172.21.15.1:0/515919822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 msgr2=0x7f801c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 --2- 172.21.15.1:0/515919822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c10da40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8014009ca0 tx=0x7f801402a950 comp rx=0 tx=0).stop 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 -- 172.21.15.1:0/515919822 shutdown_connections 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 --2- 172.21.15.1:0/515919822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c10da40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 --2- 172.21.15.1:0/515919822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 0x7f801c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 --2- 172.21.15.1:0/515919822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 0x7f801c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 -- 172.21.15.1:0/515919822 >> 172.21.15.1:0/515919822 conn(0x7f801c0fc7d0 msgr2=0x7f801c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 -- 172.21.15.1:0/515919822 shutdown_connections 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.257+0000 7f8020d6f640 1 -- 172.21.15.1:0/515919822 wait complete. 2024-09-12T02:29:53.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 Processor -- start 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 -- start start 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 0x7f801c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 0x7f801c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f801c110f80 con 0x7f801c102ef0 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f801c110e00 con 0x7f801c102570 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8020d6f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f801c111100 con 0x7f801c100e20 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57870/0 (socket says 172.21.15.1:57870) 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 -- 172.21.15.1:0/2136820021 learned_addr learned my addr 172.21.15.1:0/2136820021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801a59c640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 0x7f801c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f8019d9b640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 0x7f801c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 -- 172.21.15.1:0/2136820021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 msgr2=0x7f801c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 0x7f801c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 -- 172.21.15.1:0/2136820021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 msgr2=0x7f801c198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 0x7f801c198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.258+0000 7f801ad9d640 1 -- 172.21.15.1:0/2136820021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801c19d4b0 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f801ad9d640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f801402ae70 tx=0x7f801402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014034040 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8014030920 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801c19d740 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014045480 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.259+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801c1a5080 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.260+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801c1021b0 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.261+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8014037020 con 0x7f801c102ef0 2024-09-12T02:29:53.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.262+0000 7f800b7fe640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 0x7f80040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.262+0000 7f801a59c640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 0x7f80040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.262+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f80140efe90 con 0x7f801c102ef0 2024-09-12T02:29:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.263+0000 7f801a59c640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 0x7f80040a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f800c005fd0 tx=0x7f800c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:53.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.266+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80140bcf50 con 0x7f801c102ef0 2024-09-12T02:29:53.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.445+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f801c10a0a0 con 0x7f801c102ef0 2024-09-12T02:29:53.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.445+0000 7f800b7fe640 1 -- 172.21.15.1:0/2136820021 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80140bc850 con 0x7f801c102ef0 2024-09-12T02:29:53.446 INFO:teuthology.orchestra.run.smithi001.stdout:73014444104 2024-09-12T02:29:53.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.447+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 msgr2=0x7f80040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.447+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 0x7f80040a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f800c005fd0 tx=0x7f800c005850 comp rx=0 tx=0).stop 2024-09-12T02:29:53.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.447+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 msgr2=0x7f801c19cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:53.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.447+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f801402ae70 tx=0x7f801402f5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 shutdown_connections 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80040a2c10 0x7f80040a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f801c102ef0 0x7f801c19cdd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801c102570 0x7f801c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 --2- 172.21.15.1:0/2136820021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f801c100e20 0x7f801c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 >> 172.21.15.1:0/2136820021 conn(0x7f801c0fc7d0 msgr2=0x7f801c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 shutdown_connections 2024-09-12T02:29:53.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:53.448+0000 7f8020d6f640 1 -- 172.21.15.1:0/2136820021 wait complete. 2024-09-12T02:29:53.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:53 smithi001 ceph-mon[31252]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:29:53.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:53 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3444688636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:29:53.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:53 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2104929436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:29:53.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:53 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2136820021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:29:53.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430251 got 206158430254 for osd.7 2024-09-12T02:29:53.799 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:53 smithi134 ceph-mon[35091]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:29:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:53 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3444688636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:29:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:53 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2104929436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:29:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:53 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2136820021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:29:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:53 smithi173 ceph-mon[35036]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:29:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:53 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3444688636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:29:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:53 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2104929436' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:29:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:53 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2136820021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:29:54.682 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822710 got 154618822712 for osd.5 2024-09-12T02:29:55.453 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:54 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-12T02:29:55.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:54 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T02:29:55.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-12T02:29:55.456 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T02:29:55.456 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-12T02:29:55.456 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T02:29:55.456 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:54 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-12T02:29:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 -- 172.21.15.1:0/185437789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8106f10 msgr2=0x7f64c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/185437789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8106f10 0x7f64c810ea90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009ca0 tx=0x7f64c002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 -- 172.21.15.1:0/185437789 shutdown_connections 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/185437789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8106f10 0x7f64c810ea90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/185437789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8102790 0x7f64c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/185437789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8101de0 0x7f64c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 -- 172.21.15.1:0/185437789 >> 172.21.15.1:0/185437789 conn(0x7f64c80fd8c0 msgr2=0x7f64c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 -- 172.21.15.1:0/185437789 shutdown_connections 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.862+0000 7f64ce6d6640 1 -- 172.21.15.1:0/185437789 wait complete. 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 Processor -- start 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 -- start start 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 0x7f64c819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 0x7f64c819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f64c8111f70 con 0x7f64c8101de0 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64c8111df0 con 0x7f64c8102790 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64ce6d6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64c81120f0 con 0x7f64c8106f10 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57892/0 (socket says 172.21.15.1:57892) 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.863+0000 7f64c7fff640 1 -- 172.21.15.1:0/80882018 learned_addr learned my addr 172.21.15.1:0/80882018 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c77fe640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 0x7f64c819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64ccc73640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 0x7f64c819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 -- 172.21.15.1:0/80882018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 msgr2=0x7f64c819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 0x7f64c819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 -- 172.21.15.1:0/80882018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 msgr2=0x7f64c819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 0x7f64c819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 -- 172.21.15.1:0/80882018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c819f5b0 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c77fe640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 0x7f64c819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64ccc73640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 0x7f64c819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c7fff640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d950 tx=0x7f64b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8017070 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c819f8a0 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64b8009c30 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b800f6b0 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.864+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c81a7180 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.865+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c81021c0 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.866+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f64b80109d0 con 0x7f64c8101de0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.867+0000 7f64c57fa640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 0x7f64b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.867+0000 7f64c77fe640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 0x7f64b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:55.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.867+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7f64b80cef70 con 0x7f64c8101de0 2024-09-12T02:29:55.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.867+0000 7f64c77fe640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 0x7f64b00a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:55.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:54.872+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64b8009de0 con 0x7f64c8101de0 2024-09-12T02:29:55.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.051+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f64c81a7460 con 0x7f64c8101de0 2024-09-12T02:29:55.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.051+0000 7f64c57fa640 1 -- 172.21.15.1:0/80882018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f64b809bcf0 con 0x7f64c8101de0 2024-09-12T02:29:55.460 INFO:teuthology.orchestra.run.smithi001.stdout:266287972389 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 msgr2=0x7f64b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 0x7f64b00a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc0094d0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 msgr2=0x7f64c819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f64b800d950 tx=0x7f64b800de10 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 shutdown_connections 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f64b00a2c10 0x7f64b00a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64c8106f10 0x7f64c819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.053+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64c8102790 0x7f64c819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.054+0000 7f64ce6d6640 1 --2- 172.21.15.1:0/80882018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f64c8101de0 0x7f64c819a600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.054+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 >> 172.21.15.1:0/80882018 conn(0x7f64c80fd8c0 msgr2=0x7f64c80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.054+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 shutdown_connections 2024-09-12T02:29:55.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:55.054+0000 7f64ce6d6640 1 -- 172.21.15.1:0/80882018 wait complete. 2024-09-12T02:29:55.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593778 for osd.6 2024-09-12T02:29:55.615 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:29:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-12T02:29:55.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:29:55.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:55 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/80882018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:29:55.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:29:55.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:29:55.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:29:55.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T02:29:55.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:29:55.915 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:55 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/80882018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:29:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:29:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-12T02:29:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T02:29:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:29:55.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:55 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/80882018' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:29:56.245 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972389 for osd.9 2024-09-12T02:29:56.246 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:56.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:56 smithi001 ceph-mon[31252]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:29:56.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:56 smithi134 ceph-mon[35091]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:29:56.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:56 smithi173 ceph-mon[35036]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:29:56.982 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574925 for osd.1 2024-09-12T02:29:56.982 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:57.419 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444102 got 73014444104 for osd.2 2024-09-12T02:29:57.419 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:57 smithi001 ceph-mon[31252]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:29:57.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:57 smithi134 ceph-mon[35091]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:29:57.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808861 got 287762808862 for osd.10 2024-09-12T02:29:57.921 DEBUG:teuthology.parallel:result is None 2024-09-12T02:29:57.921 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:29:57.921 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:29:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:57 smithi173 ceph-mon[35036]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:29:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:29:59.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.266+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2396420449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04101de0 msgr2=0x7f7f041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:59.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.266+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2396420449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04101de0 0x7f7f041021c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009900 tx=0x7f7f0002a410 comp rx=0 tx=0).stop 2024-09-12T02:29:59.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2396420449 shutdown_connections 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2396420449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04106f10 0x7f7f0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2396420449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04102790 0x7f7f041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2396420449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04101de0 0x7f7f041021c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2396420449 >> 172.21.15.1:0/2396420449 conn(0x7f7f040fd8c0 msgr2=0x7f7f040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2396420449 shutdown_connections 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2396420449 wait complete. 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 Processor -- start 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 -- start start 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04101de0 0x7f7f041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.267+0000 7f7f0b29c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04102790 0x7f7f04198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:59.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04111f70 con 0x7f7f04106f10 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04111df0 con 0x7f7f04101de0 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041120f0 con 0x7f7f04102790 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57898/0 (socket says 172.21.15.1:57898) 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 -- 172.21.15.1:0/2463875341 learned_addr learned my addr 172.21.15.1:0/2463875341 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09038640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04101de0 0x7f7f041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f08837640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04102790 0x7f7f04198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 -- 172.21.15.1:0/2463875341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04102790 msgr2=0x7f7f04198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:59.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04102790 0x7f7f04198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 -- 172.21.15.1:0/2463875341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04101de0 msgr2=0x7f7f041983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04101de0 0x7f7f041983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 -- 172.21.15.1:0/2463875341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0419d380 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f09839640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cce0 tx=0x7f7efc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f450 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7efc00fad0 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc018c10 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0419d670 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.268+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f041a4f50 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.269+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f041021c0 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.271+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7efc00f5f0 con 0x7f7f04106f10 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.271+0000 7f7efa7fc640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 0x7f7ef00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.271+0000 7f7f09038640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 0x7f7ef00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:59.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.271+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7efc0cf820 con 0x7f7f04106f10 2024-09-12T02:29:59.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.272+0000 7f7f09038640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 0x7f7ef00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009230 tx=0x7f7f000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:59.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.275+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7efc014030 con 0x7f7f04106f10 2024-09-12T02:29:59.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.457+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f04062630 con 0x7f7ef00a2c10 2024-09-12T02:29:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.466+0000 7f7efa7fc640 1 -- 172.21.15.1:0/2463875341 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259004 (secure 0 0 0) 0x7f7f04062630 con 0x7f7ef00a2c10 2024-09-12T02:29:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:29:59.470 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 msgr2=0x7f7ef00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 0x7f7ef00a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009230 tx=0x7f7f000058d0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 msgr2=0x7f7f0419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cce0 tx=0x7f7efc00a620 comp rx=0 tx=0).stop 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 shutdown_connections 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ef00a2c10 0x7f7ef00a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f04106f10 0x7f7f0419cca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f04102790 0x7f7f04198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 --2- 172.21.15.1:0/2463875341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f04101de0 0x7f7f041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:59.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.470+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 >> 172.21.15.1:0/2463875341 conn(0x7f7f040fd8c0 msgr2=0x7f7f040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:59.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.471+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 shutdown_connections 2024-09-12T02:29:59.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:29:59.471+0000 7f7f0b29c640 1 -- 172.21.15.1:0/2463875341 wait complete. 2024-09-12T02:29:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:29:59 smithi001 ceph-mon[31252]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:29:59.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:29:59 smithi134 ceph-mon[35091]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:29:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:29:59 smithi173 ceph-mon[35036]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 13 B/s, 1 objects/s recovering 2024-09-12T02:30:00.188 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-12T02:29:57.967664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659638,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":674,"num_read_kb":456,"num_write":427,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380976,"kb_used_data":10900,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560848,"statfs":{"total":1151940427776,"available":1151550308352,"internally_reserved":0,"allocated":11161600,"data_stored":7064235,"data_compressed":134895,"data_compressed_allocated":172032,"data_compressed_original":1843200,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001839"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592949+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:29:55.592949+0000","last_peered":"2024-09-12T02:29:55.592949+0000","last_clean":"2024-09-12T02:29:55.592949+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:29:55.592949+0000","last_undegraded":"2024-09-12T02:29:55.592949+0000","last_fullsized":"2024-09-12T02:29:55.592949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480535+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:28:53.480535+0000","last_peered":"2024-09-12T02:28:53.480535+0000","last_clean":"2024-09-12T02:28:53.480535+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:28:53.480535+0000","last_undegraded":"2024-09-12T02:28:53.480535+0000","last_fullsized":"2024-09-12T02:28:53.480535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480475+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:28:53.480475+0000","last_peered":"2024-09-12T02:28:53.480475+0000","last_clean":"2024-09-12T02:28:53.480475+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:28:53.480475+0000","last_undegraded":"2024-09-12T02:28:53.480475+0000","last_fullsized":"2024-09-12T02:28:53.480475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.584906+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:29:54.584906+0000","last_peered":"2024-09-12T02:29:54.584906+0000","last_clean":"2024-09-12T02:29:54.584906+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:29:54.584906+0000","last_undegraded":"2024-09-12T02:29:54.584906+0000","last_fullsized":"2024-09-12T02:29:54.584906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587238+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:29:55.587238+0000","last_peered":"2024-09-12T02:29:55.587238+0000","last_clean":"2024-09-12T02:29:55.587238+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:29:55.587238+0000","last_undegraded":"2024-09-12T02:29:55.587238+0000","last_fullsized":"2024-09-12T02:29:55.587238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585074+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:29:54.585074+0000","last_peered":"2024-09-12T02:29:54.585074+0000","last_clean":"2024-09-12T02:29:54.585074+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:29:54.585074+0000","last_undegraded":"2024-09-12T02:29:54.585074+0000","last_fullsized":"2024-09-12T02:29:54.585074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585441+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:29:55.585441+0000","last_peered":"2024-09-12T02:29:55.585441+0000","last_clean":"2024-09-12T02:29:55.585441+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:29:55.585441+0000","last_undegraded":"2024-09-12T02:29:55.585441+0000","last_fullsized":"2024-09-12T02:29:55.585441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.965926+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:28:52.965926+0000","last_peered":"2024-09-12T02:28:52.965926+0000","last_clean":"2024-09-12T02:28:52.965926+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:28:52.965926+0000","last_undegraded":"2024-09-12T02:28:52.965926+0000","last_fullsized":"2024-09-12T02:28:52.965926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588387+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:29:54.588387+0000","last_peered":"2024-09-12T02:29:54.588387+0000","last_clean":"2024-09-12T02:29:54.588387+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:29:54.588387+0000","last_undegraded":"2024-09-12T02:29:54.588387+0000","last_fullsized":"2024-09-12T02:29:54.588387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.586127+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:29:54.586127+0000","last_peered":"2024-09-12T02:29:54.586127+0000","last_clean":"2024-09-12T02:29:54.586127+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:29:54.586127+0000","last_undegraded":"2024-09-12T02:29:54.586127+0000","last_fullsized":"2024-09-12T02:29:54.586127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585748+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:29:55.585748+0000","last_peered":"2024-09-12T02:29:55.585748+0000","last_clean":"2024-09-12T02:29:55.585748+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:29:55.585748+0000","last_undegraded":"2024-09-12T02:29:55.585748+0000","last_fullsized":"2024-09-12T02:29:55.585748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585018+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:29:54.585018+0000","last_peered":"2024-09-12T02:29:54.585018+0000","last_clean":"2024-09-12T02:29:54.585018+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:29:54.585018+0000","last_undegraded":"2024-09-12T02:29:54.585018+0000","last_fullsized":"2024-09-12T02:29:54.585018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581467+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:29:55.581467+0000","last_peered":"2024-09-12T02:29:55.581467+0000","last_clean":"2024-09-12T02:29:55.581467+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:29:55.581467+0000","last_undegraded":"2024-09-12T02:29:55.581467+0000","last_fullsized":"2024-09-12T02:29:55.581467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480739+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:28:53.480739+0000","last_peered":"2024-09-12T02:28:53.480739+0000","last_clean":"2024-09-12T02:28:53.480739+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:28:53.480739+0000","last_undegraded":"2024-09-12T02:28:53.480739+0000","last_fullsized":"2024-09-12T02:28:53.480739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480521+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:28:53.480521+0000","last_peered":"2024-09-12T02:28:53.480521+0000","last_clean":"2024-09-12T02:28:53.480521+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:28:53.480521+0000","last_undegraded":"2024-09-12T02:28:53.480521+0000","last_fullsized":"2024-09-12T02:28:53.480521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588041+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:29:54.588041+0000","last_peered":"2024-09-12T02:29:54.588041+0000","last_clean":"2024-09-12T02:29:54.588041+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:29:54.588041+0000","last_undegraded":"2024-09-12T02:29:54.588041+0000","last_fullsized":"2024-09-12T02:29:54.588041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592989+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:29:55.592989+0000","last_peered":"2024-09-12T02:29:55.592989+0000","last_clean":"2024-09-12T02:29:55.592989+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:29:55.592989+0000","last_undegraded":"2024-09-12T02:29:55.592989+0000","last_fullsized":"2024-09-12T02:29:55.592989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479767+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:28:53.479767+0000","last_peered":"2024-09-12T02:28:53.479767+0000","last_clean":"2024-09-12T02:28:53.479767+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:28:53.479767+0000","last_undegraded":"2024-09-12T02:28:53.479767+0000","last_fullsized":"2024-09-12T02:28:53.479767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585720+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:29:54.585720+0000","last_peered":"2024-09-12T02:29:54.585720+0000","last_clean":"2024-09-12T02:29:54.585720+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:29:54.585720+0000","last_undegraded":"2024-09-12T02:29:54.585720+0000","last_fullsized":"2024-09-12T02:29:54.585720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592005+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:29:55.592005+0000","last_peered":"2024-09-12T02:29:55.592005+0000","last_clean":"2024-09-12T02:29:55.592005+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:29:55.592005+0000","last_undegraded":"2024-09-12T02:29:55.592005+0000","last_fullsized":"2024-09-12T02:29:55.592005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581562+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:29:55.581562+0000","last_peered":"2024-09-12T02:29:55.581562+0000","last_clean":"2024-09-12T02:29:55.581562+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:29:55.581562+0000","last_undegraded":"2024-09-12T02:29:55.581562+0000","last_fullsized":"2024-09-12T02:29:55.581562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.589083+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:29:54.589083+0000","last_peered":"2024-09-12T02:29:54.589083+0000","last_clean":"2024-09-12T02:29:54.589083+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:29:54.589083+0000","last_undegraded":"2024-09-12T02:29:54.589083+0000","last_fullsized":"2024-09-12T02:29:54.589083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966367+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:28:52.966367+0000","last_peered":"2024-09-12T02:28:52.966367+0000","last_clean":"2024-09-12T02:28:52.966367+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:28:52.966367+0000","last_undegraded":"2024-09-12T02:28:52.966367+0000","last_fullsized":"2024-09-12T02:28:52.966367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590605+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:29:55.590605+0000","last_peered":"2024-09-12T02:29:55.590605+0000","last_clean":"2024-09-12T02:29:55.590605+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:29:55.590605+0000","last_undegraded":"2024-09-12T02:29:55.590605+0000","last_fullsized":"2024-09-12T02:29:55.590605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966223+0000","last_change":"2024-09-12T02:28:51.983288+0000","last_active":"2024-09-12T02:28:52.966223+0000","last_peered":"2024-09-12T02:28:52.966223+0000","last_clean":"2024-09-12T02:28:52.966223+0000","last_became_active":"2024-09-12T02:28:51.982982+0000","last_became_peered":"2024-09-12T02:28:51.982982+0000","last_unstale":"2024-09-12T02:28:52.966223+0000","last_undegraded":"2024-09-12T02:28:52.966223+0000","last_fullsized":"2024-09-12T02:28:52.966223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.052613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585924+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:29:54.585924+0000","last_peered":"2024-09-12T02:29:54.585924+0000","last_clean":"2024-09-12T02:29:54.585924+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:29:54.585924+0000","last_undegraded":"2024-09-12T02:29:54.585924+0000","last_fullsized":"2024-09-12T02:29:54.585924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592279+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:29:55.592279+0000","last_peered":"2024-09-12T02:29:55.592279+0000","last_clean":"2024-09-12T02:29:55.592279+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:29:55.592279+0000","last_undegraded":"2024-09-12T02:29:55.592279+0000","last_fullsized":"2024-09-12T02:29:55.592279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581724+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:29:55.581724+0000","last_peered":"2024-09-12T02:29:55.581724+0000","last_clean":"2024-09-12T02:29:55.581724+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:29:55.581724+0000","last_undegraded":"2024-09-12T02:29:55.581724+0000","last_fullsized":"2024-09-12T02:29:55.581724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481016+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:28:53.481016+0000","last_peered":"2024-09-12T02:28:53.481016+0000","last_clean":"2024-09-12T02:28:53.481016+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:28:53.481016+0000","last_undegraded":"2024-09-12T02:28:53.481016+0000","last_fullsized":"2024-09-12T02:28:53.481016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.584828+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:29:54.584828+0000","last_peered":"2024-09-12T02:29:54.584828+0000","last_clean":"2024-09-12T02:29:54.584828+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:29:54.584828+0000","last_undegraded":"2024-09-12T02:29:54.584828+0000","last_fullsized":"2024-09-12T02:29:54.584828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585045+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:29:54.585045+0000","last_peered":"2024-09-12T02:29:54.585045+0000","last_clean":"2024-09-12T02:29:54.585045+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:29:54.585045+0000","last_undegraded":"2024-09-12T02:29:54.585045+0000","last_fullsized":"2024-09-12T02:29:54.585045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592317+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:29:55.592317+0000","last_peered":"2024-09-12T02:29:55.592317+0000","last_clean":"2024-09-12T02:29:55.592317+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:29:55.592317+0000","last_undegraded":"2024-09-12T02:29:55.592317+0000","last_fullsized":"2024-09-12T02:29:55.592317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587310+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:29:55.587310+0000","last_peered":"2024-09-12T02:29:55.587310+0000","last_clean":"2024-09-12T02:29:55.587310+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:29:55.587310+0000","last_undegraded":"2024-09-12T02:29:55.587310+0000","last_fullsized":"2024-09-12T02:29:55.587310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590993+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:29:55.590993+0000","last_peered":"2024-09-12T02:29:55.590993+0000","last_clean":"2024-09-12T02:29:55.590993+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:29:55.590993+0000","last_undegraded":"2024-09-12T02:29:55.590993+0000","last_fullsized":"2024-09-12T02:29:55.590993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590904+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:29:55.590904+0000","last_peered":"2024-09-12T02:29:55.590904+0000","last_clean":"2024-09-12T02:29:55.590904+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:29:55.590904+0000","last_undegraded":"2024-09-12T02:29:55.590904+0000","last_fullsized":"2024-09-12T02:29:55.590904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585194+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:54.585194+0000","last_peered":"2024-09-12T02:29:54.585194+0000","last_clean":"2024-09-12T02:29:54.585194+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:54.585194+0000","last_undegraded":"2024-09-12T02:29:54.585194+0000","last_fullsized":"2024-09-12T02:29:54.585194+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966024+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:28:52.966024+0000","last_peered":"2024-09-12T02:28:52.966024+0000","last_clean":"2024-09-12T02:28:52.966024+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:28:52.966024+0000","last_undegraded":"2024-09-12T02:28:52.966024+0000","last_fullsized":"2024-09-12T02:28:52.966024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.479540+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:28:53.479540+0000","last_peered":"2024-09-12T02:28:53.479540+0000","last_clean":"2024-09-12T02:28:53.479540+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:28:53.479540+0000","last_undegraded":"2024-09-12T02:28:53.479540+0000","last_fullsized":"2024-09-12T02:28:53.479540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585223+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:29:54.585223+0000","last_peered":"2024-09-12T02:29:54.585223+0000","last_clean":"2024-09-12T02:29:54.585223+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:29:54.585223+0000","last_undegraded":"2024-09-12T02:29:54.585223+0000","last_fullsized":"2024-09-12T02:29:54.585223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588473+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:29:54.588473+0000","last_peered":"2024-09-12T02:29:54.588473+0000","last_clean":"2024-09-12T02:29:54.588473+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:29:54.588473+0000","last_undegraded":"2024-09-12T02:29:54.588473+0000","last_fullsized":"2024-09-12T02:29:54.588473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481121+0000","last_change":"2024-09-12T02:28:51.983705+0000","last_active":"2024-09-12T02:28:53.481121+0000","last_peered":"2024-09-12T02:28:53.481121+0000","last_clean":"2024-09-12T02:28:53.481121+0000","last_became_active":"2024-09-12T02:28:51.982525+0000","last_became_peered":"2024-09-12T02:28:51.982525+0000","last_unstale":"2024-09-12T02:28:53.481121+0000","last_undegraded":"2024-09-12T02:28:53.481121+0000","last_fullsized":"2024-09-12T02:28:53.481121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:39.045747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588315+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:29:54.588315+0000","last_peered":"2024-09-12T02:29:54.588315+0000","last_clean":"2024-09-12T02:29:54.588315+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:29:54.588315+0000","last_undegraded":"2024-09-12T02:29:54.588315+0000","last_fullsized":"2024-09-12T02:29:54.588315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585811+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:29:54.585811+0000","last_peered":"2024-09-12T02:29:54.585811+0000","last_clean":"2024-09-12T02:29:54.585811+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:29:54.585811+0000","last_undegraded":"2024-09-12T02:29:54.585811+0000","last_fullsized":"2024-09-12T02:29:54.585811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61828,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":113,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587643+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:29:55.587643+0000","last_peered":"2024-09-12T02:29:55.587643+0000","last_clean":"2024-09-12T02:29:55.587643+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:29:55.587643+0000","last_undegraded":"2024-09-12T02:29:55.587643+0000","last_fullsized":"2024-09-12T02:29:55.587643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585304+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:54.585304+0000","last_peered":"2024-09-12T02:29:54.585304+0000","last_clean":"2024-09-12T02:29:54.585304+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:54.585304+0000","last_undegraded":"2024-09-12T02:29:54.585304+0000","last_fullsized":"2024-09-12T02:29:54.585304+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581245+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:29:55.581245+0000","last_peered":"2024-09-12T02:29:55.581245+0000","last_clean":"2024-09-12T02:29:55.581245+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:29:55.581245+0000","last_undegraded":"2024-09-12T02:29:55.581245+0000","last_fullsized":"2024-09-12T02:29:55.581245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585576+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:29:55.585576+0000","last_peered":"2024-09-12T02:29:55.585576+0000","last_clean":"2024-09-12T02:29:55.585576+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:29:55.585576+0000","last_undegraded":"2024-09-12T02:29:55.585576+0000","last_fullsized":"2024-09-12T02:29:55.585576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585406+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:29:54.585406+0000","last_peered":"2024-09-12T02:29:54.585406+0000","last_clean":"2024-09-12T02:29:54.585406+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:29:54.585406+0000","last_undegraded":"2024-09-12T02:29:54.585406+0000","last_fullsized":"2024-09-12T02:29:54.585406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585402+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:29:55.585402+0000","last_peered":"2024-09-12T02:29:55.585402+0000","last_clean":"2024-09-12T02:29:55.585402+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:29:55.585402+0000","last_undegraded":"2024-09-12T02:29:55.585402+0000","last_fullsized":"2024-09-12T02:29:55.585402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590482+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:29:55.590482+0000","last_peered":"2024-09-12T02:29:55.590482+0000","last_clean":"2024-09-12T02:29:55.590482+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:29:55.590482+0000","last_undegraded":"2024-09-12T02:29:55.590482+0000","last_fullsized":"2024-09-12T02:29:55.590482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640291+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:29:55.640291+0000","last_peered":"2024-09-12T02:29:55.640291+0000","last_clean":"2024-09-12T02:29:55.640291+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:29:55.640291+0000","last_undegraded":"2024-09-12T02:29:55.640291+0000","last_fullsized":"2024-09-12T02:29:55.640291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585767+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:29:55.585767+0000","last_peered":"2024-09-12T02:29:55.585767+0000","last_clean":"2024-09-12T02:29:55.585767+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:29:55.585767+0000","last_undegraded":"2024-09-12T02:29:55.585767+0000","last_fullsized":"2024-09-12T02:29:55.585767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585862+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:29:55.585862+0000","last_peered":"2024-09-12T02:29:55.585862+0000","last_clean":"2024-09-12T02:29:55.585862+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:29:55.585862+0000","last_undegraded":"2024-09-12T02:29:55.585862+0000","last_fullsized":"2024-09-12T02:29:55.585862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585693+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:29:54.585693+0000","last_peered":"2024-09-12T02:29:54.585693+0000","last_clean":"2024-09-12T02:29:54.585693+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:29:54.585693+0000","last_undegraded":"2024-09-12T02:29:54.585693+0000","last_fullsized":"2024-09-12T02:29:54.585693+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585896+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:29:55.585896+0000","last_peered":"2024-09-12T02:29:55.585896+0000","last_clean":"2024-09-12T02:29:55.585896+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:29:55.585896+0000","last_undegraded":"2024-09-12T02:29:55.585896+0000","last_fullsized":"2024-09-12T02:29:55.585896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585610+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585610+0000","last_peered":"2024-09-12T02:29:55.585610+0000","last_clean":"2024-09-12T02:29:55.585610+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585610+0000","last_undegraded":"2024-09-12T02:29:55.585610+0000","last_fullsized":"2024-09-12T02:29:55.585610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585077+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:54.585077+0000","last_peered":"2024-09-12T02:29:54.585077+0000","last_clean":"2024-09-12T02:29:54.585077+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:54.585077+0000","last_undegraded":"2024-09-12T02:29:54.585077+0000","last_fullsized":"2024-09-12T02:29:54.585077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966471+0000","last_change":"2024-09-12T02:28:51.985711+0000","last_active":"2024-09-12T02:28:52.966471+0000","last_peered":"2024-09-12T02:28:52.966471+0000","last_clean":"2024-09-12T02:28:52.966471+0000","last_became_active":"2024-09-12T02:28:51.985376+0000","last_became_peered":"2024-09-12T02:28:51.985376+0000","last_unstale":"2024-09-12T02:28:52.966471+0000","last_undegraded":"2024-09-12T02:28:52.966471+0000","last_fullsized":"2024-09-12T02:28:52.966471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:27.164856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644440+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644440+0000","last_peered":"2024-09-12T02:29:55.644440+0000","last_clean":"2024-09-12T02:29:55.644440+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644440+0000","last_undegraded":"2024-09-12T02:29:55.644440+0000","last_fullsized":"2024-09-12T02:29:55.644440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.589112+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:29:55.589112+0000","last_peered":"2024-09-12T02:29:55.589112+0000","last_clean":"2024-09-12T02:29:55.589112+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:29:55.589112+0000","last_undegraded":"2024-09-12T02:29:55.589112+0000","last_fullsized":"2024-09-12T02:29:55.589112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:56.107567+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:29:56.107567+0000","last_peered":"2024-09-12T02:29:56.107567+0000","last_clean":"2024-09-12T02:29:56.107567+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:29:56.107567+0000","last_undegraded":"2024-09-12T02:29:56.107567+0000","last_fullsized":"2024-09-12T02:29:56.107567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590722+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:29:55.590722+0000","last_peered":"2024-09-12T02:29:55.590722+0000","last_clean":"2024-09-12T02:29:55.590722+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:29:55.590722+0000","last_undegraded":"2024-09-12T02:29:55.590722+0000","last_fullsized":"2024-09-12T02:29:55.590722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:56.596737+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:29:56.596737+0000","last_peered":"2024-09-12T02:29:56.596737+0000","last_clean":"2024-09-12T02:29:56.596737+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:29:56.596737+0000","last_undegraded":"2024-09-12T02:29:56.596737+0000","last_fullsized":"2024-09-12T02:29:56.596737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.586099+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:29:54.586099+0000","last_peered":"2024-09-12T02:29:54.586099+0000","last_clean":"2024-09-12T02:29:54.586099+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:29:54.586099+0000","last_undegraded":"2024-09-12T02:29:54.586099+0000","last_fullsized":"2024-09-12T02:29:54.586099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.591213+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:28:53.591213+0000","last_peered":"2024-09-12T02:28:53.591213+0000","last_clean":"2024-09-12T02:28:53.591213+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:28:53.591213+0000","last_undegraded":"2024-09-12T02:28:53.591213+0000","last_fullsized":"2024-09-12T02:28:53.591213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585759+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:29:54.585759+0000","last_peered":"2024-09-12T02:29:54.585759+0000","last_clean":"2024-09-12T02:29:54.585759+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:29:54.585759+0000","last_undegraded":"2024-09-12T02:29:54.585759+0000","last_fullsized":"2024-09-12T02:29:54.585759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587785+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587785+0000","last_peered":"2024-09-12T02:29:55.587785+0000","last_clean":"2024-09-12T02:29:55.587785+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587785+0000","last_undegraded":"2024-09-12T02:29:55.587785+0000","last_fullsized":"2024-09-12T02:29:55.587785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581807+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:29:55.581807+0000","last_peered":"2024-09-12T02:29:55.581807+0000","last_clean":"2024-09-12T02:29:55.581807+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:29:55.581807+0000","last_undegraded":"2024-09-12T02:29:55.581807+0000","last_fullsized":"2024-09-12T02:29:55.581807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:18.481730+0000","last_change":"2024-09-12T02:28:49.858046+0000","last_active":"2024-09-12T02:29:18.481730+0000","last_peered":"2024-09-12T02:29:18.481730+0000","last_clean":"2024-09-12T02:29:18.481730+0000","last_became_active":"2024-09-12T02:28:49.857728+0000","last_became_peered":"2024-09-12T02:28:49.857728+0000","last_unstale":"2024-09-12T02:29:18.481730+0000","last_undegraded":"2024-09-12T02:29:18.481730+0000","last_fullsized":"2024-09-12T02:29:18.481730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:09.743162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966355+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:28:52.966355+0000","last_peered":"2024-09-12T02:28:52.966355+0000","last_clean":"2024-09-12T02:28:52.966355+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:28:52.966355+0000","last_undegraded":"2024-09-12T02:28:52.966355+0000","last_fullsized":"2024-09-12T02:28:52.966355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585474+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:54.585474+0000","last_peered":"2024-09-12T02:29:54.585474+0000","last_clean":"2024-09-12T02:29:54.585474+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:54.585474+0000","last_undegraded":"2024-09-12T02:29:54.585474+0000","last_fullsized":"2024-09-12T02:29:54.585474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.480887+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:28:53.480887+0000","last_peered":"2024-09-12T02:28:53.480887+0000","last_clean":"2024-09-12T02:28:53.480887+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:28:53.480887+0000","last_undegraded":"2024-09-12T02:28:53.480887+0000","last_fullsized":"2024-09-12T02:28:53.480887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588145+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:54.588145+0000","last_peered":"2024-09-12T02:29:54.588145+0000","last_clean":"2024-09-12T02:29:54.588145+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:54.588145+0000","last_undegraded":"2024-09-12T02:29:54.588145+0000","last_fullsized":"2024-09-12T02:29:54.588145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587181+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:29:55.587181+0000","last_peered":"2024-09-12T02:29:55.587181+0000","last_clean":"2024-09-12T02:29:55.587181+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:29:55.587181+0000","last_undegraded":"2024-09-12T02:29:55.587181+0000","last_fullsized":"2024-09-12T02:29:55.587181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:04.033344+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:04.033344+0000","last_peered":"2024-09-12T02:29:04.033344+0000","last_clean":"2024-09-12T02:29:04.033344+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:04.033344+0000","last_undegraded":"2024-09-12T02:29:04.033344+0000","last_fullsized":"2024-09-12T02:29:04.033344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592076+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:29:55.592076+0000","last_peered":"2024-09-12T02:29:55.592076+0000","last_clean":"2024-09-12T02:29:55.592076+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:29:55.592076+0000","last_undegraded":"2024-09-12T02:29:55.592076+0000","last_fullsized":"2024-09-12T02:29:55.592076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.584952+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:54.584952+0000","last_peered":"2024-09-12T02:29:54.584952+0000","last_clean":"2024-09-12T02:29:54.584952+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:54.584952+0000","last_undegraded":"2024-09-12T02:29:54.584952+0000","last_fullsized":"2024-09-12T02:29:54.584952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966327+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:28:52.966327+0000","last_peered":"2024-09-12T02:28:52.966327+0000","last_clean":"2024-09-12T02:28:52.966327+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:28:52.966327+0000","last_undegraded":"2024-09-12T02:28:52.966327+0000","last_fullsized":"2024-09-12T02:28:52.966327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585574+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:29:55.585574+0000","last_peered":"2024-09-12T02:29:55.585574+0000","last_clean":"2024-09-12T02:29:55.585574+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:29:55.585574+0000","last_undegraded":"2024-09-12T02:29:55.585574+0000","last_fullsized":"2024-09-12T02:29:55.585574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591325+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:29:55.591325+0000","last_peered":"2024-09-12T02:29:55.591325+0000","last_clean":"2024-09-12T02:29:55.591325+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:29:55.591325+0000","last_undegraded":"2024-09-12T02:29:55.591325+0000","last_fullsized":"2024-09-12T02:29:55.591325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.588398+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:29:54.588398+0000","last_peered":"2024-09-12T02:29:54.588398+0000","last_clean":"2024-09-12T02:29:54.588398+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:29:54.588398+0000","last_undegraded":"2024-09-12T02:29:54.588398+0000","last_fullsized":"2024-09-12T02:29:54.588398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.481139+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:28:53.481139+0000","last_peered":"2024-09-12T02:28:53.481139+0000","last_clean":"2024-09-12T02:28:53.481139+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:28:53.481139+0000","last_undegraded":"2024-09-12T02:28:53.481139+0000","last_fullsized":"2024-09-12T02:28:53.481139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:53.485360+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:28:53.485360+0000","last_peered":"2024-09-12T02:28:53.485360+0000","last_clean":"2024-09-12T02:28:53.485360+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:28:53.485360+0000","last_undegraded":"2024-09-12T02:28:53.485360+0000","last_fullsized":"2024-09-12T02:28:53.485360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:28:52.966410+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:28:52.966410+0000","last_peered":"2024-09-12T02:28:52.966410+0000","last_clean":"2024-09-12T02:28:52.966410+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:28:52.966410+0000","last_undegraded":"2024-09-12T02:28:52.966410+0000","last_fullsized":"2024-09-12T02:28:52.966410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T02:29:52.100788+0000","last_change":"2024-09-12T02:28:49.864972+0000","last_active":"2024-09-12T02:29:52.100788+0000","last_peered":"2024-09-12T02:29:52.100788+0000","last_clean":"2024-09-12T02:29:52.100788+0000","last_became_active":"2024-09-12T02:28:49.864553+0000","last_became_peered":"2024-09-12T02:28:49.864553+0000","last_unstale":"2024-09-12T02:29:52.100788+0000","last_undegraded":"2024-09-12T02:29:52.100788+0000","last_fullsized":"2024-09-12T02:29:52.100788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:40.359699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69036,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":548,"num_read_kb":347,"num_write":244,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427273,"data_compressed":2888,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1071764,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":418444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":962560,"data_stored":1028347,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":435838,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":1019386,"data_compressed":39182,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":427174,"data_compressed":2888,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":417986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":481122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":481295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":419500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:00.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:30:00.467 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:00.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:00 smithi001 ceph-mon[31252]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:00.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:00 smithi001 ceph-mon[31252]: overall HEALTH_OK 2024-09-12T02:30:00.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:00 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:00 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:00 smithi134 ceph-mon[35091]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:00 smithi134 ceph-mon[35091]: overall HEALTH_OK 2024-09-12T02:30:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:00 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:00 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:00 smithi173 ceph-mon[35036]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:00.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:00 smithi173 ceph-mon[35036]: overall HEALTH_OK 2024-09-12T02:30:00.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:00 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:00 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:00.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.958+0000 7f57187b1640 1 -- 172.21.15.1:0/4091201254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710101420 msgr2=0x7f571010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.958+0000 7f57187b1640 1 --2- 172.21.15.1:0/4091201254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710101420 0x7f571010d950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5708009cd0 tx=0x7f570802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- 172.21.15.1:0/4091201254 shutdown_connections 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- 172.21.15.1:0/4091201254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710101420 0x7f571010d950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- 172.21.15.1:0/4091201254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 0x7f5710100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- 172.21.15.1:0/4091201254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710106a80 0x7f5710106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- 172.21.15.1:0/4091201254 >> 172.21.15.1:0/4091201254 conn(0x7f57100fc7a0 msgr2=0x7f57100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- 172.21.15.1:0/4091201254 shutdown_connections 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- 172.21.15.1:0/4091201254 wait complete. 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 Processor -- start 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- start start 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 0x7f571019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710101420 0x7f571019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111fa0 con 0x7f5710106a80 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111e20 con 0x7f5710101420 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.959+0000 7f57187b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5710112120 con 0x7f5710100a80 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57914/0 (socket says 172.21.15.1:57914) 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 -- 172.21.15.1:0/2279364431 learned_addr learned my addr 172.21.15.1:0/2279364431 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5715d4c640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710101420 0x7f571019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f571654d640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 0x7f571019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 -- 172.21.15.1:0/2279364431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 msgr2=0x7f571019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 0x7f571019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 -- 172.21.15.1:0/2279364431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710101420 msgr2=0x7f571019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710101420 0x7f571019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:00.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 -- 172.21.15.1:0/2279364431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571019f5e0 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f5716d4e640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5708005cc0 tx=0x7f5708032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708004040 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57080046c0 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571019f870 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708030e00 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.960+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a71b0 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.961+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5710100ee0 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.962+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f57080305a0 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.963+0000 7f57077fe640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.963+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f570802e030 con 0x7f5710106a80 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.963+0000 7f571654d640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.964+0000 7f571654d640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f570c009b50 tx=0x7f570c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:00.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:00.967+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f570804b060 con 0x7f5710106a80 2024-09-12T02:30:01.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.142+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57100fd510 con 0x7f56fc0a2c10 2024-09-12T02:30:01.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.148+0000 7f57077fe640 1 -- 172.21.15.1:0/2279364431 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259039 (secure 0 0 0) 0x7f57100fd510 con 0x7f56fc0a2c10 2024-09-12T02:30:01.151 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:01.152 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 msgr2=0x7f56fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f570c009b50 tx=0x7f570c005f90 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 msgr2=0x7f571019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5708005cc0 tx=0x7f5708032f40 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 shutdown_connections 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5710106a80 0x7f571019ef00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5710101420 0x7f571019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 --2- 172.21.15.1:0/2279364431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710100a80 0x7f571019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:01.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 >> 172.21.15.1:0/2279364431 conn(0x7f57100fc7a0 msgr2=0x7f57100fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:01.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 shutdown_connections 2024-09-12T02:30:01.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:01.151+0000 7f57187b1640 1 -- 172.21.15.1:0/2279364431 wait complete. 2024-09-12T02:30:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:01 smithi001 ceph-mon[31252]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:01 smithi134 ceph-mon[35091]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:01.914 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-12T02:29:59.968260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659638,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":702,"num_read_kb":474,"num_write":427,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381152,"kb_used_data":11036,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560672,"statfs":{"total":1151940427776,"available":1151550128128,"internally_reserved":0,"allocated":11300864,"data_stored":7167827,"data_compressed":169593,"data_compressed_allocated":221184,"data_compressed_original":1941504,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":48,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001949"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592949+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:29:55.592949+0000","last_peered":"2024-09-12T02:29:55.592949+0000","last_clean":"2024-09-12T02:29:55.592949+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:29:55.592949+0000","last_undegraded":"2024-09-12T02:29:55.592949+0000","last_fullsized":"2024-09-12T02:29:55.592949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587139+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:29:55.587139+0000","last_peered":"2024-09-12T02:29:55.587139+0000","last_clean":"2024-09-12T02:29:55.587139+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:29:55.587139+0000","last_undegraded":"2024-09-12T02:29:55.587139+0000","last_fullsized":"2024-09-12T02:29:55.587139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586942+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:29:55.586942+0000","last_peered":"2024-09-12T02:29:55.586942+0000","last_clean":"2024-09-12T02:29:55.586942+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:29:55.586942+0000","last_undegraded":"2024-09-12T02:29:55.586942+0000","last_fullsized":"2024-09-12T02:29:55.586942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.584906+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:29:54.584906+0000","last_peered":"2024-09-12T02:29:54.584906+0000","last_clean":"2024-09-12T02:29:54.584906+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:29:54.584906+0000","last_undegraded":"2024-09-12T02:29:54.584906+0000","last_fullsized":"2024-09-12T02:29:54.584906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587238+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:29:55.587238+0000","last_peered":"2024-09-12T02:29:55.587238+0000","last_clean":"2024-09-12T02:29:55.587238+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:29:55.587238+0000","last_undegraded":"2024-09-12T02:29:55.587238+0000","last_fullsized":"2024-09-12T02:29:55.587238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582274+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:29:55.582274+0000","last_peered":"2024-09-12T02:29:55.582274+0000","last_clean":"2024-09-12T02:29:55.582274+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:29:55.582274+0000","last_undegraded":"2024-09-12T02:29:55.582274+0000","last_fullsized":"2024-09-12T02:29:55.582274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585441+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:29:55.585441+0000","last_peered":"2024-09-12T02:29:55.585441+0000","last_clean":"2024-09-12T02:29:55.585441+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:29:55.585441+0000","last_undegraded":"2024-09-12T02:29:55.585441+0000","last_fullsized":"2024-09-12T02:29:55.585441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585372+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:29:55.585372+0000","last_peered":"2024-09-12T02:29:55.585372+0000","last_clean":"2024-09-12T02:29:55.585372+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:29:55.585372+0000","last_undegraded":"2024-09-12T02:29:55.585372+0000","last_fullsized":"2024-09-12T02:29:55.585372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639994+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:29:55.639994+0000","last_peered":"2024-09-12T02:29:55.639994+0000","last_clean":"2024-09-12T02:29:55.639994+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:29:55.639994+0000","last_undegraded":"2024-09-12T02:29:55.639994+0000","last_fullsized":"2024-09-12T02:29:55.639994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582696+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:29:55.582696+0000","last_peered":"2024-09-12T02:29:55.582696+0000","last_clean":"2024-09-12T02:29:55.582696+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:29:55.582696+0000","last_undegraded":"2024-09-12T02:29:55.582696+0000","last_fullsized":"2024-09-12T02:29:55.582696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585748+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:29:55.585748+0000","last_peered":"2024-09-12T02:29:55.585748+0000","last_clean":"2024-09-12T02:29:55.585748+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:29:55.585748+0000","last_undegraded":"2024-09-12T02:29:55.585748+0000","last_fullsized":"2024-09-12T02:29:55.585748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585018+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:29:54.585018+0000","last_peered":"2024-09-12T02:29:54.585018+0000","last_clean":"2024-09-12T02:29:54.585018+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:29:54.585018+0000","last_undegraded":"2024-09-12T02:29:54.585018+0000","last_fullsized":"2024-09-12T02:29:54.585018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581467+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:29:55.581467+0000","last_peered":"2024-09-12T02:29:55.581467+0000","last_clean":"2024-09-12T02:29:55.581467+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:29:55.581467+0000","last_undegraded":"2024-09-12T02:29:55.581467+0000","last_fullsized":"2024-09-12T02:29:55.581467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586986+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:29:55.586986+0000","last_peered":"2024-09-12T02:29:55.586986+0000","last_clean":"2024-09-12T02:29:55.586986+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:29:55.586986+0000","last_undegraded":"2024-09-12T02:29:55.586986+0000","last_fullsized":"2024-09-12T02:29:55.586986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586446+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:29:55.586446+0000","last_peered":"2024-09-12T02:29:55.586446+0000","last_clean":"2024-09-12T02:29:55.586446+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:29:55.586446+0000","last_undegraded":"2024-09-12T02:29:55.586446+0000","last_fullsized":"2024-09-12T02:29:55.586446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638587+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:29:55.638587+0000","last_peered":"2024-09-12T02:29:55.638587+0000","last_clean":"2024-09-12T02:29:55.638587+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:29:55.638587+0000","last_undegraded":"2024-09-12T02:29:55.638587+0000","last_fullsized":"2024-09-12T02:29:55.638587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592989+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:29:55.592989+0000","last_peered":"2024-09-12T02:29:55.592989+0000","last_clean":"2024-09-12T02:29:55.592989+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:29:55.592989+0000","last_undegraded":"2024-09-12T02:29:55.592989+0000","last_fullsized":"2024-09-12T02:29:55.592989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586004+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:29:55.586004+0000","last_peered":"2024-09-12T02:29:55.586004+0000","last_clean":"2024-09-12T02:29:55.586004+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:29:55.586004+0000","last_undegraded":"2024-09-12T02:29:55.586004+0000","last_fullsized":"2024-09-12T02:29:55.586004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584778+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:29:55.584778+0000","last_peered":"2024-09-12T02:29:55.584778+0000","last_clean":"2024-09-12T02:29:55.584778+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:29:55.584778+0000","last_undegraded":"2024-09-12T02:29:55.584778+0000","last_fullsized":"2024-09-12T02:29:55.584778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592005+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:29:55.592005+0000","last_peered":"2024-09-12T02:29:55.592005+0000","last_clean":"2024-09-12T02:29:55.592005+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:29:55.592005+0000","last_undegraded":"2024-09-12T02:29:55.592005+0000","last_fullsized":"2024-09-12T02:29:55.592005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581562+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:29:55.581562+0000","last_peered":"2024-09-12T02:29:55.581562+0000","last_clean":"2024-09-12T02:29:55.581562+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:29:55.581562+0000","last_undegraded":"2024-09-12T02:29:55.581562+0000","last_fullsized":"2024-09-12T02:29:55.581562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638660+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:29:55.638660+0000","last_peered":"2024-09-12T02:29:55.638660+0000","last_clean":"2024-09-12T02:29:55.638660+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:29:55.638660+0000","last_undegraded":"2024-09-12T02:29:55.638660+0000","last_fullsized":"2024-09-12T02:29:55.638660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585491+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:29:55.585491+0000","last_peered":"2024-09-12T02:29:55.585491+0000","last_clean":"2024-09-12T02:29:55.585491+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:29:55.585491+0000","last_undegraded":"2024-09-12T02:29:55.585491+0000","last_fullsized":"2024-09-12T02:29:55.585491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590605+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:29:55.590605+0000","last_peered":"2024-09-12T02:29:55.590605+0000","last_clean":"2024-09-12T02:29:55.590605+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:29:55.590605+0000","last_undegraded":"2024-09-12T02:29:55.590605+0000","last_fullsized":"2024-09-12T02:29:55.590605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591023+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:29:55.591023+0000","last_peered":"2024-09-12T02:29:55.591023+0000","last_clean":"2024-09-12T02:29:55.591023+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:29:55.591023+0000","last_undegraded":"2024-09-12T02:29:55.591023+0000","last_fullsized":"2024-09-12T02:29:55.591023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585261+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:29:55.585261+0000","last_peered":"2024-09-12T02:29:55.585261+0000","last_clean":"2024-09-12T02:29:55.585261+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:29:55.585261+0000","last_undegraded":"2024-09-12T02:29:55.585261+0000","last_fullsized":"2024-09-12T02:29:55.585261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592279+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:29:55.592279+0000","last_peered":"2024-09-12T02:29:55.592279+0000","last_clean":"2024-09-12T02:29:55.592279+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:29:55.592279+0000","last_undegraded":"2024-09-12T02:29:55.592279+0000","last_fullsized":"2024-09-12T02:29:55.592279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581724+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:29:55.581724+0000","last_peered":"2024-09-12T02:29:55.581724+0000","last_clean":"2024-09-12T02:29:55.581724+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:29:55.581724+0000","last_undegraded":"2024-09-12T02:29:55.581724+0000","last_fullsized":"2024-09-12T02:29:55.581724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586813+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:29:55.586813+0000","last_peered":"2024-09-12T02:29:55.586813+0000","last_clean":"2024-09-12T02:29:55.586813+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:29:55.586813+0000","last_undegraded":"2024-09-12T02:29:55.586813+0000","last_fullsized":"2024-09-12T02:29:55.586813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584851+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:29:55.584851+0000","last_peered":"2024-09-12T02:29:55.584851+0000","last_clean":"2024-09-12T02:29:55.584851+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:29:55.584851+0000","last_undegraded":"2024-09-12T02:29:55.584851+0000","last_fullsized":"2024-09-12T02:29:55.584851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585029+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:29:55.585029+0000","last_peered":"2024-09-12T02:29:55.585029+0000","last_clean":"2024-09-12T02:29:55.585029+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:29:55.585029+0000","last_undegraded":"2024-09-12T02:29:55.585029+0000","last_fullsized":"2024-09-12T02:29:55.585029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592317+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:29:55.592317+0000","last_peered":"2024-09-12T02:29:55.592317+0000","last_clean":"2024-09-12T02:29:55.592317+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:29:55.592317+0000","last_undegraded":"2024-09-12T02:29:55.592317+0000","last_fullsized":"2024-09-12T02:29:55.592317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587310+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:29:55.587310+0000","last_peered":"2024-09-12T02:29:55.587310+0000","last_clean":"2024-09-12T02:29:55.587310+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:29:55.587310+0000","last_undegraded":"2024-09-12T02:29:55.587310+0000","last_fullsized":"2024-09-12T02:29:55.587310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590993+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:29:55.590993+0000","last_peered":"2024-09-12T02:29:55.590993+0000","last_clean":"2024-09-12T02:29:55.590993+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:29:55.590993+0000","last_undegraded":"2024-09-12T02:29:55.590993+0000","last_fullsized":"2024-09-12T02:29:55.590993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590904+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:29:55.590904+0000","last_peered":"2024-09-12T02:29:55.590904+0000","last_clean":"2024-09-12T02:29:55.590904+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:29:55.590904+0000","last_undegraded":"2024-09-12T02:29:55.590904+0000","last_fullsized":"2024-09-12T02:29:55.590904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585454+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:29:55.585454+0000","last_peered":"2024-09-12T02:29:55.585454+0000","last_clean":"2024-09-12T02:29:55.585454+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:29:55.585454+0000","last_undegraded":"2024-09-12T02:29:55.585454+0000","last_fullsized":"2024-09-12T02:29:55.585454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585741+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:29:55.585741+0000","last_peered":"2024-09-12T02:29:55.585741+0000","last_clean":"2024-09-12T02:29:55.585741+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:29:55.585741+0000","last_undegraded":"2024-09-12T02:29:55.585741+0000","last_fullsized":"2024-09-12T02:29:55.585741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:59.110965+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:29:59.110965+0000","last_peered":"2024-09-12T02:29:59.110965+0000","last_clean":"2024-09-12T02:29:59.110965+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:29:59.110965+0000","last_undegraded":"2024-09-12T02:29:59.110965+0000","last_fullsized":"2024-09-12T02:29:59.110965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639528+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:29:55.639528+0000","last_peered":"2024-09-12T02:29:55.639528+0000","last_clean":"2024-09-12T02:29:55.639528+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:29:55.639528+0000","last_undegraded":"2024-09-12T02:29:55.639528+0000","last_fullsized":"2024-09-12T02:29:55.639528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.593437+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:29:55.593437+0000","last_peered":"2024-09-12T02:29:55.593437+0000","last_clean":"2024-09-12T02:29:55.593437+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:29:55.593437+0000","last_undegraded":"2024-09-12T02:29:55.593437+0000","last_fullsized":"2024-09-12T02:29:55.593437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639050+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:29:55.639050+0000","last_peered":"2024-09-12T02:29:55.639050+0000","last_clean":"2024-09-12T02:29:55.639050+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:29:55.639050+0000","last_undegraded":"2024-09-12T02:29:55.639050+0000","last_fullsized":"2024-09-12T02:29:55.639050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":172,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:59.110970+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:29:59.110970+0000","last_peered":"2024-09-12T02:29:59.110970+0000","last_clean":"2024-09-12T02:29:59.110970+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:29:59.110970+0000","last_undegraded":"2024-09-12T02:29:59.110970+0000","last_fullsized":"2024-09-12T02:29:59.110970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61828,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":118,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587643+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:29:55.587643+0000","last_peered":"2024-09-12T02:29:55.587643+0000","last_clean":"2024-09-12T02:29:55.587643+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:29:55.587643+0000","last_undegraded":"2024-09-12T02:29:55.587643+0000","last_fullsized":"2024-09-12T02:29:55.587643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581245+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:29:55.581245+0000","last_peered":"2024-09-12T02:29:55.581245+0000","last_clean":"2024-09-12T02:29:55.581245+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:29:55.581245+0000","last_undegraded":"2024-09-12T02:29:55.581245+0000","last_fullsized":"2024-09-12T02:29:55.581245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585576+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:29:55.585576+0000","last_peered":"2024-09-12T02:29:55.585576+0000","last_clean":"2024-09-12T02:29:55.585576+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:29:55.585576+0000","last_undegraded":"2024-09-12T02:29:55.585576+0000","last_fullsized":"2024-09-12T02:29:55.585576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585406+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:29:54.585406+0000","last_peered":"2024-09-12T02:29:54.585406+0000","last_clean":"2024-09-12T02:29:54.585406+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:29:54.585406+0000","last_undegraded":"2024-09-12T02:29:54.585406+0000","last_fullsized":"2024-09-12T02:29:54.585406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585402+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:29:55.585402+0000","last_peered":"2024-09-12T02:29:55.585402+0000","last_clean":"2024-09-12T02:29:55.585402+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:29:55.585402+0000","last_undegraded":"2024-09-12T02:29:55.585402+0000","last_fullsized":"2024-09-12T02:29:55.585402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590482+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:29:55.590482+0000","last_peered":"2024-09-12T02:29:55.590482+0000","last_clean":"2024-09-12T02:29:55.590482+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:29:55.590482+0000","last_undegraded":"2024-09-12T02:29:55.590482+0000","last_fullsized":"2024-09-12T02:29:55.590482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640291+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:29:55.640291+0000","last_peered":"2024-09-12T02:29:55.640291+0000","last_clean":"2024-09-12T02:29:55.640291+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:29:55.640291+0000","last_undegraded":"2024-09-12T02:29:55.640291+0000","last_fullsized":"2024-09-12T02:29:55.640291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585767+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:29:55.585767+0000","last_peered":"2024-09-12T02:29:55.585767+0000","last_clean":"2024-09-12T02:29:55.585767+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:29:55.585767+0000","last_undegraded":"2024-09-12T02:29:55.585767+0000","last_fullsized":"2024-09-12T02:29:55.585767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585862+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:29:55.585862+0000","last_peered":"2024-09-12T02:29:55.585862+0000","last_clean":"2024-09-12T02:29:55.585862+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:29:55.585862+0000","last_undegraded":"2024-09-12T02:29:55.585862+0000","last_fullsized":"2024-09-12T02:29:55.585862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:58.110248+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:29:58.110248+0000","last_peered":"2024-09-12T02:29:58.110248+0000","last_clean":"2024-09-12T02:29:58.110248+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:29:58.110248+0000","last_undegraded":"2024-09-12T02:29:58.110248+0000","last_fullsized":"2024-09-12T02:29:58.110248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585896+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:29:55.585896+0000","last_peered":"2024-09-12T02:29:55.585896+0000","last_clean":"2024-09-12T02:29:55.585896+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:29:55.585896+0000","last_undegraded":"2024-09-12T02:29:55.585896+0000","last_fullsized":"2024-09-12T02:29:55.585896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585610+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585610+0000","last_peered":"2024-09-12T02:29:55.585610+0000","last_clean":"2024-09-12T02:29:55.585610+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585610+0000","last_undegraded":"2024-09-12T02:29:55.585610+0000","last_fullsized":"2024-09-12T02:29:55.585610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585077+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:54.585077+0000","last_peered":"2024-09-12T02:29:54.585077+0000","last_clean":"2024-09-12T02:29:54.585077+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:54.585077+0000","last_undegraded":"2024-09-12T02:29:54.585077+0000","last_fullsized":"2024-09-12T02:29:54.585077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640119+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:29:55.640119+0000","last_peered":"2024-09-12T02:29:55.640119+0000","last_clean":"2024-09-12T02:29:55.640119+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:29:55.640119+0000","last_undegraded":"2024-09-12T02:29:55.640119+0000","last_fullsized":"2024-09-12T02:29:55.640119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644440+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644440+0000","last_peered":"2024-09-12T02:29:55.644440+0000","last_clean":"2024-09-12T02:29:55.644440+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644440+0000","last_undegraded":"2024-09-12T02:29:55.644440+0000","last_fullsized":"2024-09-12T02:29:55.644440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.589112+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:29:55.589112+0000","last_peered":"2024-09-12T02:29:55.589112+0000","last_clean":"2024-09-12T02:29:55.589112+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:29:55.589112+0000","last_undegraded":"2024-09-12T02:29:55.589112+0000","last_fullsized":"2024-09-12T02:29:55.589112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:56.107567+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:29:56.107567+0000","last_peered":"2024-09-12T02:29:56.107567+0000","last_clean":"2024-09-12T02:29:56.107567+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:29:56.107567+0000","last_undegraded":"2024-09-12T02:29:56.107567+0000","last_fullsized":"2024-09-12T02:29:56.107567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590722+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:29:55.590722+0000","last_peered":"2024-09-12T02:29:55.590722+0000","last_clean":"2024-09-12T02:29:55.590722+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:29:55.590722+0000","last_undegraded":"2024-09-12T02:29:55.590722+0000","last_fullsized":"2024-09-12T02:29:55.590722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'6","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:56.596737+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:29:56.596737+0000","last_peered":"2024-09-12T02:29:56.596737+0000","last_clean":"2024-09-12T02:29:56.596737+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:29:56.596737+0000","last_undegraded":"2024-09-12T02:29:56.596737+0000","last_fullsized":"2024-09-12T02:29:56.596737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582360+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:29:55.582360+0000","last_peered":"2024-09-12T02:29:55.582360+0000","last_clean":"2024-09-12T02:29:55.582360+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:29:55.582360+0000","last_undegraded":"2024-09-12T02:29:55.582360+0000","last_fullsized":"2024-09-12T02:29:55.582360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585850+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.585850+0000","last_peered":"2024-09-12T02:29:55.585850+0000","last_clean":"2024-09-12T02:29:55.585850+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.585850+0000","last_undegraded":"2024-09-12T02:29:55.585850+0000","last_fullsized":"2024-09-12T02:29:55.585850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582468+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:29:55.582468+0000","last_peered":"2024-09-12T02:29:55.582468+0000","last_clean":"2024-09-12T02:29:55.582468+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:29:55.582468+0000","last_undegraded":"2024-09-12T02:29:55.582468+0000","last_fullsized":"2024-09-12T02:29:55.582468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587785+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587785+0000","last_peered":"2024-09-12T02:29:55.587785+0000","last_clean":"2024-09-12T02:29:55.587785+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587785+0000","last_undegraded":"2024-09-12T02:29:55.587785+0000","last_fullsized":"2024-09-12T02:29:55.587785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581807+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:29:55.581807+0000","last_peered":"2024-09-12T02:29:55.581807+0000","last_clean":"2024-09-12T02:29:55.581807+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:29:55.581807+0000","last_undegraded":"2024-09-12T02:29:55.581807+0000","last_fullsized":"2024-09-12T02:29:55.581807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.600546+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:29:55.600546+0000","last_peered":"2024-09-12T02:29:55.600546+0000","last_clean":"2024-09-12T02:29:55.600546+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:29:55.600546+0000","last_undegraded":"2024-09-12T02:29:55.600546+0000","last_fullsized":"2024-09-12T02:29:55.600546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586410+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:29:55.586410+0000","last_peered":"2024-09-12T02:29:55.586410+0000","last_clean":"2024-09-12T02:29:55.586410+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:29:55.586410+0000","last_undegraded":"2024-09-12T02:29:55.586410+0000","last_fullsized":"2024-09-12T02:29:55.586410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:29:54.585474+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:54.585474+0000","last_peered":"2024-09-12T02:29:54.585474+0000","last_clean":"2024-09-12T02:29:54.585474+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:54.585474+0000","last_undegraded":"2024-09-12T02:29:54.585474+0000","last_fullsized":"2024-09-12T02:29:54.585474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587770+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:29:55.587770+0000","last_peered":"2024-09-12T02:29:55.587770+0000","last_clean":"2024-09-12T02:29:55.587770+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:29:55.587770+0000","last_undegraded":"2024-09-12T02:29:55.587770+0000","last_fullsized":"2024-09-12T02:29:55.587770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638722+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638722+0000","last_peered":"2024-09-12T02:29:55.638722+0000","last_clean":"2024-09-12T02:29:55.638722+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638722+0000","last_undegraded":"2024-09-12T02:29:55.638722+0000","last_fullsized":"2024-09-12T02:29:55.638722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587181+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:29:55.587181+0000","last_peered":"2024-09-12T02:29:55.587181+0000","last_clean":"2024-09-12T02:29:55.587181+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:29:55.587181+0000","last_undegraded":"2024-09-12T02:29:55.587181+0000","last_fullsized":"2024-09-12T02:29:55.587181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585664+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585664+0000","last_peered":"2024-09-12T02:29:55.585664+0000","last_clean":"2024-09-12T02:29:55.585664+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585664+0000","last_undegraded":"2024-09-12T02:29:55.585664+0000","last_fullsized":"2024-09-12T02:29:55.585664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.592076+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:29:55.592076+0000","last_peered":"2024-09-12T02:29:55.592076+0000","last_clean":"2024-09-12T02:29:55.592076+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:29:55.592076+0000","last_undegraded":"2024-09-12T02:29:55.592076+0000","last_fullsized":"2024-09-12T02:29:55.592076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584993+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:55.584993+0000","last_peered":"2024-09-12T02:29:55.584993+0000","last_clean":"2024-09-12T02:29:55.584993+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:55.584993+0000","last_undegraded":"2024-09-12T02:29:55.584993+0000","last_fullsized":"2024-09-12T02:29:55.584993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586097+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:29:55.586097+0000","last_peered":"2024-09-12T02:29:55.586097+0000","last_clean":"2024-09-12T02:29:55.586097+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:29:55.586097+0000","last_undegraded":"2024-09-12T02:29:55.586097+0000","last_fullsized":"2024-09-12T02:29:55.586097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585574+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:29:55.585574+0000","last_peered":"2024-09-12T02:29:55.585574+0000","last_clean":"2024-09-12T02:29:55.585574+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:29:55.585574+0000","last_undegraded":"2024-09-12T02:29:55.585574+0000","last_fullsized":"2024-09-12T02:29:55.585574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591325+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:29:55.591325+0000","last_peered":"2024-09-12T02:29:55.591325+0000","last_clean":"2024-09-12T02:29:55.591325+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:29:55.591325+0000","last_undegraded":"2024-09-12T02:29:55.591325+0000","last_fullsized":"2024-09-12T02:29:55.591325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639024+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:29:55.639024+0000","last_peered":"2024-09-12T02:29:55.639024+0000","last_clean":"2024-09-12T02:29:55.639024+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:29:55.639024+0000","last_undegraded":"2024-09-12T02:29:55.639024+0000","last_fullsized":"2024-09-12T02:29:55.639024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587410+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:29:55.587410+0000","last_peered":"2024-09-12T02:29:55.587410+0000","last_clean":"2024-09-12T02:29:55.587410+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:29:55.587410+0000","last_undegraded":"2024-09-12T02:29:55.587410+0000","last_fullsized":"2024-09-12T02:29:55.587410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586772+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586772+0000","last_peered":"2024-09-12T02:29:55.586772+0000","last_clean":"2024-09-12T02:29:55.586772+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586772+0000","last_undegraded":"2024-09-12T02:29:55.586772+0000","last_fullsized":"2024-09-12T02:29:55.586772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586472+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:29:55.586472+0000","last_peered":"2024-09-12T02:29:55.586472+0000","last_clean":"2024-09-12T02:29:55.586472+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:29:55.586472+0000","last_undegraded":"2024-09-12T02:29:55.586472+0000","last_fullsized":"2024-09-12T02:29:55.586472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:56.596247+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:29:56.596247+0000","last_peered":"2024-09-12T02:29:56.596247+0000","last_clean":"2024-09-12T02:29:56.596247+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:29:56.596247+0000","last_undegraded":"2024-09-12T02:29:56.596247+0000","last_fullsized":"2024-09-12T02:29:56.596247+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69036,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":576,"num_read_kb":365,"num_write":244,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":206996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427273,"data_compressed":2888,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":1089048,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972390,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":962560,"data_stored":1028347,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":435838,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":1019386,"data_compressed":39182,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":427174,"data_compressed":2888,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":498294,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":498579,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:01.918 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:30:01.919 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:30:01.919 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:30:01.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:30:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:01 smithi173 ceph-mon[35036]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:30:02.182 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.710+0000 7f903b7f9640 1 -- 172.21.15.1:0/1377189388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034101420 msgr2=0x7f903410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.710+0000 7f903b7f9640 1 --2- 172.21.15.1:0/1377189388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034101420 0x7f903410d950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f902c009cd0 tx=0x7f902c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 -- 172.21.15.1:0/1377189388 shutdown_connections 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 --2- 172.21.15.1:0/1377189388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034101420 0x7f903410d950 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 --2- 172.21.15.1:0/1377189388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034100a80 0x7f9034100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 --2- 172.21.15.1:0/1377189388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 0x7f9034106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 -- 172.21.15.1:0/1377189388 >> 172.21.15.1:0/1377189388 conn(0x7f90340fc7a0 msgr2=0x7f90340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 -- 172.21.15.1:0/1377189388 shutdown_connections 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 -- 172.21.15.1:0/1377189388 wait complete. 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 Processor -- start 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.711+0000 7f903b7f9640 1 -- start start 2024-09-12T02:30:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034101420 0x7f9034102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 0x7f90341030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9034110ea0 con 0x7f9034100a80 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9034110d20 con 0x7f9034106a80 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9034111020 con 0x7f9034101420 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36230/0 (socket says 172.21.15.1:36230) 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 -- 172.21.15.1:0/3623379164 learned_addr learned my addr 172.21.15.1:0/3623379164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039d96640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 0x7f90341030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9038d94640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034101420 0x7f9034102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 -- 172.21.15.1:0/3623379164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034101420 msgr2=0x7f9034102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034101420 0x7f9034102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 -- 172.21.15.1:0/3623379164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 msgr2=0x7f90341030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 0x7f90341030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 -- 172.21.15.1:0/3623379164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90341a6940 con 0x7f9034100a80 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f9039595640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f903000c890 tx=0x7f903000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030004220 con 0x7f9034100a80 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90300043c0 con 0x7f9034100a80 2024-09-12T02:30:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90341a6c30 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90300049e0 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.712+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90341a7170 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.713+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034100ee0 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.715+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f90300079b0 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.715+0000 7f902a7fc640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 0x7f90200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.715+0000 7f9038d94640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 0x7f90200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.715+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f90300cf300 con 0x7f9034100a80 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.716+0000 7f9038d94640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 0x7f90200a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90341040e0 tx=0x7f9024008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.719+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9030014030 con 0x7f9034100a80 2024-09-12T02:30:02.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:02 smithi001 ceph-mon[31252]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:02.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:02 smithi134 ceph-mon[35091]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:02.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.934+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9034103b80 con 0x7f9034100a80 2024-09-12T02:30:02.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.935+0000 7f902a7fc640 1 -- 172.21.15.1:0/3623379164 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9034103b80 con 0x7f9034100a80 2024-09-12T02:30:02.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:02.935 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:30:02.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 msgr2=0x7f90200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 0x7f90200a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90341040e0 tx=0x7f9024008040 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 msgr2=0x7f9034102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f903000c890 tx=0x7f903000cd50 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 shutdown_connections 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f90200a2c10 0x7f90200a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9034106a80 0x7f90341030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034101420 0x7f9034102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 --2- 172.21.15.1:0/3623379164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9034100a80 0x7f9034102650 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 >> 172.21.15.1:0/3623379164 conn(0x7f90340fc7a0 msgr2=0x7f9034104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 shutdown_connections 2024-09-12T02:30:02.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:02.937+0000 7f903b7f9640 1 -- 172.21.15.1:0/3623379164 wait complete. 2024-09-12T02:30:02.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:02 smithi173 ceph-mon[35036]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:03.611 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:30:03.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:03.875 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:03.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:03 smithi001 ceph-mon[31252]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:03.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:03 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3623379164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:30:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:03 smithi134 ceph-mon[35091]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:03 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3623379164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:30:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:03 smithi173 ceph-mon[35036]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 97 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:03 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3623379164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:30:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/2337054415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c01036e0 msgr2=0x7fe9c0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/2337054415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c01036e0 0x7fe9c0107b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009930 tx=0x7fe9b402a420 comp rx=0 tx=0).stop 2024-09-12T02:30:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/2337054415 shutdown_connections 2024-09-12T02:30:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/2337054415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c01036e0 0x7fe9c0107b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/2337054415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01082a0 0x7fe9c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/2337054415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c0102d30 0x7fe9c0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/2337054415 >> 172.21.15.1:0/2337054415 conn(0x7fe9c00fc7d0 msgr2=0x7fe9c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/2337054415 shutdown_connections 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.354+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/2337054415 wait complete. 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 Processor -- start 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 -- start start 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01036e0 0x7fe9c0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c01082a0 0x7fe9c0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c01120a0 con 0x7fe9c0102d30 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0111f20 con 0x7fe9c01082a0 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9c5fbd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0112220 con 0x7fe9c01036e0 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9bf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9bf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36238/0 (socket says 172.21.15.1:36238) 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9bf7fe640 1 -- 172.21.15.1:0/1406441565 learned_addr learned my addr 172.21.15.1:0/1406441565 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9beffd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01036e0 0x7fe9c0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.355+0000 7fe9bffff640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c01082a0 0x7fe9c0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 -- 172.21.15.1:0/1406441565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01036e0 msgr2=0x7fe9c0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01036e0 0x7fe9c0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 -- 172.21.15.1:0/1406441565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c01082a0 msgr2=0x7fe9c0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c01082a0 0x7fe9c0101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 -- 172.21.15.1:0/1406441565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c01a6a10 con 0x7fe9c0102d30 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bf7fe640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c890 tx=0x7fe9b000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0004220 con 0x7fe9c0102d30 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b00043c0 con 0x7fe9c0102d30 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01a6d00 con 0x7fe9c0102d30 2024-09-12T02:30:04.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00049e0 con 0x7fe9c0102d30 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.356+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c01a71c0 con 0x7fe9c0102d30 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.357+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c0103110 con 0x7fe9c0102d30 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.358+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe9b00079b0 con 0x7fe9c0102d30 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.359+0000 7fe9bcff9640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 0x7fe9a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.359+0000 7fe9beffd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 0x7fe9a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.359+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe9b00cf2b0 con 0x7fe9c0102d30 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.359+0000 7fe9beffd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 0x7fe9a80a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4005940 tx=0x7fe9b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:04.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.362+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9b0014030 con 0x7fe9c0102d30 2024-09-12T02:30:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.575+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9c0101ec0 con 0x7fe9c0102d30 2024-09-12T02:30:04.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.576+0000 7fe9bcff9640 1 -- 172.21.15.1:0/1406441565 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7fe9c0101ec0 con 0x7fe9c0102d30 2024-09-12T02:30:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:04.576 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:30:04.576 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:04.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 msgr2=0x7fe9a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 0x7fe9a80a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4005940 tx=0x7fe9b40058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 msgr2=0x7fe9c0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:04.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c890 tx=0x7fe9b000cd50 comp rx=0 tx=0).stop 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 shutdown_connections 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe9a80a2c10 0x7fe9a80a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c01082a0 0x7fe9c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9c01036e0 0x7fe9c0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 --2- 172.21.15.1:0/1406441565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9c0102d30 0x7fe9c0100990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 >> 172.21.15.1:0/1406441565 conn(0x7fe9c00fc7d0 msgr2=0x7fe9c0105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 shutdown_connections 2024-09-12T02:30:04.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:04.578+0000 7fe9c5fbd640 1 -- 172.21.15.1:0/1406441565 wait complete. 2024-09-12T02:30:04.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:04 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1406441565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:04.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:04 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1406441565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:04.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:04 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1406441565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:05.298 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:05.559 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:05 smithi001 ceph-mon[31252]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 83 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:05.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:05 smithi134 ceph-mon[35091]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 83 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:05 smithi173 ceph-mon[35036]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s; 83 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 -- 172.21.15.1:0/2350734922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 msgr2=0x7f4d20103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 --2- 172.21.15.1:0/2350734922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d20103120 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009900 tx=0x7f4d1002a480 comp rx=0 tx=0).stop 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 -- 172.21.15.1:0/2350734922 shutdown_connections 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 --2- 172.21.15.1:0/2350734922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d2010c170 0x7f4d2010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 --2- 172.21.15.1:0/2350734922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d20103660 0x7f4d2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 --2- 172.21.15.1:0/2350734922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d20103120 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 -- 172.21.15.1:0/2350734922 >> 172.21.15.1:0/2350734922 conn(0x7f4d200fc7a0 msgr2=0x7f4d200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 -- 172.21.15.1:0/2350734922 shutdown_connections 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.013+0000 7f4d25b98640 1 -- 172.21.15.1:0/2350734922 wait complete. 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 Processor -- start 2024-09-12T02:30:06.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 -- start start 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d20103660 0x7f4d20198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 0x7f4d2019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20111f70 con 0x7f4d20102d40 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d20111df0 con 0x7f4d20103660 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d25b98640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d201120f0 con 0x7f4d2010c170 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36256/0 (socket says 172.21.15.1:36256) 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 -- 172.21.15.1:0/3911142729 learned_addr learned my addr 172.21.15.1:0/3911142729 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1effd640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d20103660 0x7f4d20198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1ffff640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 0x7f4d2019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 -- 172.21.15.1:0/3911142729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 msgr2=0x7f4d2019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 0x7f4d2019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 -- 172.21.15.1:0/3911142729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d20103660 msgr2=0x7f4d20198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d20103660 0x7f4d20198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1f7fe640 1 -- 172.21.15.1:0/3911142729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2019d3a0 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.014+0000 7f4d1ffff640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 0x7f4d2019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d1f7fe640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006010 tx=0x7f4d100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1003f030 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d10003ce0 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2019d630 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10035070 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.015+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d201a4f70 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.016+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2006b070 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.017+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4d10042030 con 0x7f4d20102d40 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.018+0000 7f4d1cff9640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 0x7f4d080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:06.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.018+0000 7f4d1effd640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 0x7f4d080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:06.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.018+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4d100efa50 con 0x7f4d20102d40 2024-09-12T02:30:06.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.018+0000 7f4d1effd640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 0x7f4d080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d200fed30 tx=0x7f4d1400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:06.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.021+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d100bc8f0 con 0x7f4d20102d40 2024-09-12T02:30:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.235+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d201071e0 con 0x7f4d20102d40 2024-09-12T02:30:06.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.235+0000 7f4d1cff9640 1 -- 172.21.15.1:0/3911142729 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7f4d100bc1f0 con 0x7f4d20102d40 2024-09-12T02:30:06.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:06.236 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:30:06.236 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.238+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 msgr2=0x7f4d080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.238+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 0x7f4d080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d200fed30 tx=0x7f4d1400a250 comp rx=0 tx=0).stop 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.238+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 msgr2=0x7f4d201983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.238+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006010 tx=0x7f4d100042f0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 shutdown_connections 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4d080a2c10 0x7f4d080a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2010c170 0x7f4d2019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d20103660 0x7f4d20198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 --2- 172.21.15.1:0/3911142729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4d20102d40 0x7f4d201983f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:06.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 >> 172.21.15.1:0/3911142729 conn(0x7f4d200fc7a0 msgr2=0x7f4d200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:06.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 shutdown_connections 2024-09-12T02:30:06.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:06.239+0000 7f4d25b98640 1 -- 172.21.15.1:0/3911142729 wait complete. 2024-09-12T02:30:06.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:06 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3911142729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:06.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:06 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3911142729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:06 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3911142729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:06.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:30:07.248 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:07.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.849+0000 7fca4c89f640 1 -- 172.21.15.1:0/2596163328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48101de0 msgr2=0x7fca481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.849+0000 7fca4c89f640 1 --2- 172.21.15.1:0/2596163328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48101de0 0x7fca481021c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca38009900 tx=0x7fca3802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 -- 172.21.15.1:0/2596163328 shutdown_connections 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 --2- 172.21.15.1:0/2596163328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48106f10 0x7fca4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 --2- 172.21.15.1:0/2596163328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48102790 0x7fca481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 --2- 172.21.15.1:0/2596163328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48101de0 0x7fca481021c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 -- 172.21.15.1:0/2596163328 >> 172.21.15.1:0/2596163328 conn(0x7fca480fd8c0 msgr2=0x7fca480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 -- 172.21.15.1:0/2596163328 shutdown_connections 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 -- 172.21.15.1:0/2596163328 wait complete. 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 Processor -- start 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.850+0000 7fca4c89f640 1 -- start start 2024-09-12T02:30:07.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48101de0 0x7fca480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48102790 0x7fca48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fca48111f90 con 0x7fca48106f10 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca48111e10 con 0x7fca48101de0 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112110 con 0x7fca48102790 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36286/0 (socket says 172.21.15.1:36286) 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 -- 172.21.15.1:0/1315787258 learned_addr learned my addr 172.21.15.1:0/1315787258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca3ffff640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48102790 0x7fca48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4659c640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48101de0 0x7fca480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 -- 172.21.15.1:0/1315787258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48102790 msgr2=0x7fca48074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48102790 0x7fca48074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 -- 172.21.15.1:0/1315787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48101de0 msgr2=0x7fca480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:07.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48101de0 0x7fca480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 -- 172.21.15.1:0/1315787258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca481a6890 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca46d9d640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca4000b970 tx=0x7fca4000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40019070 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca481a6b80 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca40014440 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400075d0 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.851+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a7110 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.853+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca481021c0 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.854+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fca4001c070 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.854+0000 7fca3f7fe640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 0x7fca340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.855+0000 7fca4659c640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 0x7fca340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.855+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fca400ceb40 con 0x7fca48106f10 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.855+0000 7fca4659c640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 0x7fca340a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca38000c00 tx=0x7fca380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:07.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:07.858+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca4009b380 con 0x7fca48106f10 2024-09-12T02:30:07.875 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:07 smithi001 ceph-mon[31252]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 75 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:07.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:07 smithi134 ceph-mon[35091]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 75 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:07 smithi173 ceph-mon[35036]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 75 B/s, 0 keys/s, 2 objects/s recovering 2024-09-12T02:30:08.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.036+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca4802d7c0 con 0x7fca48106f10 2024-09-12T02:30:08.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.038+0000 7fca3f7fe640 1 -- 172.21.15.1:0/1315787258 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7fca4009f680 con 0x7fca48106f10 2024-09-12T02:30:08.038 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:08.038 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 msgr2=0x7fca340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 0x7fca340a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca38000c00 tx=0x7fca380058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 msgr2=0x7fca48074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca4000b970 tx=0x7fca4000bd70 comp rx=0 tx=0).stop 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 shutdown_connections 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fca340a2c10 0x7fca340a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca48106f10 0x7fca48074f70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca48102790 0x7fca48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 --2- 172.21.15.1:0/1315787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca48101de0 0x7fca480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 >> 172.21.15.1:0/1315787258 conn(0x7fca480fd8c0 msgr2=0x7fca480fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:08.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 shutdown_connections 2024-09-12T02:30:08.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:08.040+0000 7fca4c89f640 1 -- 172.21.15.1:0/1315787258 wait complete. 2024-09-12T02:30:08.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:08.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:08 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1315787258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:08 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1315787258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:09.035 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:08 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1315787258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:09.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 -- 172.21.15.1:0/1555523099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 msgr2=0x7f6de80748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 --2- 172.21.15.1:0/1555523099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de80748f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009900 tx=0x7f6dd802a480 comp rx=0 tx=0).stop 2024-09-12T02:30:09.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 -- 172.21.15.1:0/1555523099 shutdown_connections 2024-09-12T02:30:09.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 --2- 172.21.15.1:0/1555523099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 0x7f6de8110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 --2- 172.21.15.1:0/1555523099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de810df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 --2- 172.21.15.1:0/1555523099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de80748f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 -- 172.21.15.1:0/1555523099 >> 172.21.15.1:0/1555523099 conn(0x7f6de80fd8c0 msgr2=0x7f6de80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 -- 172.21.15.1:0/1555523099 shutdown_connections 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 -- 172.21.15.1:0/1555523099 wait complete. 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.541+0000 7f6dede40640 1 Processor -- start 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 -- start start 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de81a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 0x7f6de819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6de8114230 con 0x7f6de8074510 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6de81140b0 con 0x7f6de8074e30 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6dede40640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6de81143b0 con 0x7f6de810e440 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36298/0 (socket says 172.21.15.1:36298) 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 -- 172.21.15.1:0/3486836909 learned_addr learned my addr 172.21.15.1:0/3486836909 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de7fff640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 0x7f6de819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 -- 172.21.15.1:0/3486836909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 msgr2=0x7f6de819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 0x7f6de819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 -- 172.21.15.1:0/3486836909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 msgr2=0x7f6de81a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de6ffd640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de81a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de81a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de77fe640 1 -- 172.21.15.1:0/3486836909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de819acf0 con 0x7f6de8074510 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.542+0000 7f6de6ffd640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6de77fe640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8004770 tx=0x7f6dd8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:09.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd803f070 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de819af80 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd8031ca0 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8035030 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.543+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de81a72d0 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.544+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de80748f0 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.545+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6dd8042070 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.546+0000 7f6de4ff9640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 0x7f6dd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.546+0000 7f6de6ffd640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 0x7f6dd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.546+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6dd80efec0 con 0x7f6de8074510 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.546+0000 7f6de6ffd640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 0x7f6dd00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:09.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.549+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dd80bcd50 con 0x7f6de8074510 2024-09-12T02:30:09.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.762+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de819baf0 con 0x7f6de8074510 2024-09-12T02:30:09.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:09 smithi001 ceph-mon[31252]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 65 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T02:30:09.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.763+0000 7f6de4ff9640 1 -- 172.21.15.1:0/3486836909 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7f6dd80bc650 con 0x7f6de8074510 2024-09-12T02:30:09.763 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:30:09.764 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 msgr2=0x7f6dd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 0x7f6dd00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 msgr2=0x7f6de81a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8004770 tx=0x7f6dd8003c10 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 shutdown_connections 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6dd00a2c10 0x7f6dd00a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6de810e440 0x7f6de819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6de8074e30 0x7f6de81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 --2- 172.21.15.1:0/3486836909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6de8074510 0x7f6de81a0400 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.765+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 >> 172.21.15.1:0/3486836909 conn(0x7f6de80fd8c0 msgr2=0x7f6de80fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.766+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 shutdown_connections 2024-09-12T02:30:09.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:09.766+0000 7f6dede40640 1 -- 172.21.15.1:0/3486836909 wait complete. 2024-09-12T02:30:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:09 smithi134 ceph-mon[35091]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 65 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T02:30:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:09 smithi173 ceph-mon[35036]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 65 B/s, 0 keys/s, 1 objects/s recovering 2024-09-12T02:30:10.452 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:28:52.748371+0000', 'modified': '2024-09-12T02:29:05.029439+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24494, 'mds_1': 24475, 'mds_2': 24470, 'mds_3': 24457, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6839/1207631170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 1207631170}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 1207631170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6841/2292917282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6840', 'nonce': 2292917282}, {'type': 'v1', 'addr': '172.21.15.1:6841', 'nonce': 2292917282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24415': {'gid': 24415, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/743947684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 743947684}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 743947684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/1137270315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1137270315}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 1137270315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/4061904482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 4061904482}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4061904482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.173:6835/7391882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 7391882}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 7391882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/2489188498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 2489188498}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 2489188498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.134:6837/2931886461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2931886461}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2931886461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/3274926052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 3274926052}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 3274926052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6839/3689768435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 3689768435}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 3689768435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24494, 24475, 24470, 24457, 24451]} 2024-09-12T02:30:10.452 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:30:10.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T02:30:10.716 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:10.837 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:10 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3486836909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:10.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:10 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3486836909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:10.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:10 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3486836909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:11.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 -- 172.21.15.1:0/1905086001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e50112640 msgr2=0x7f5e50112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 --2- 172.21.15.1:0/1905086001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e50112640 0x7f5e50112a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ca0 tx=0x7f5e4c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 -- 172.21.15.1:0/1905086001 shutdown_connections 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 --2- 172.21.15.1:0/1905086001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010cf30 0x7f5e50119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 --2- 172.21.15.1:0/1905086001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e5010c590 0x7f5e5010c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 --2- 172.21.15.1:0/1905086001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e50112640 0x7f5e50112a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 -- 172.21.15.1:0/1905086001 >> 172.21.15.1:0/1905086001 conn(0x7f5e5006cdc0 msgr2=0x7f5e5006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 -- 172.21.15.1:0/1905086001 shutdown_connections 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.188+0000 7f5e58462640 1 -- 172.21.15.1:0/1905086001 wait complete. 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 Processor -- start 2024-09-12T02:30:11.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 -- start start 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 0x7f5e501a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e50112640 0x7f5e501a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5011c9a0 con 0x7f5e5010cf30 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5011c820 con 0x7f5e50112640 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e58462640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5011cb20 con 0x7f5e5010c590 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56742/0 (socket says 172.21.15.1:56742) 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 -- 172.21.15.1:0/3693312333 learned_addr learned my addr 172.21.15.1:0/3693312333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e561fe640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 0x7f5e501a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 -- 172.21.15.1:0/3693312333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 msgr2=0x7f5e501a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e569ff640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e50112640 0x7f5e501a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 0x7f5e501a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 -- 172.21.15.1:0/3693312333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e50112640 msgr2=0x7f5e501a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e50112640 0x7f5e501a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e559fd640 1 -- 172.21.15.1:0/3693312333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e501a7dd0 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.189+0000 7f5e561fe640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 0x7f5e501a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e559fd640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000d950 tx=0x7f5e4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e477fe640 1 -- 172.21.15.1:0/3693312333 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40017070 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e477fe640 1 -- 172.21.15.1:0/3693312333 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e40009c30 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e501a80c0 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e477fe640 1 -- 172.21.15.1:0/3693312333 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000f6b0 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.190+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e501af9a0 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.192+0000 7f5e477fe640 1 -- 172.21.15.1:0/3693312333 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5e400109d0 con 0x7f5e5010cf30 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.192+0000 7f5e5a83b740 1 Processor -- start 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.192+0000 7f5e5a83b740 1 -- start start 2024-09-12T02:30:11.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c749d0 0x560f24c74db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560f24bdb090 con 0x560f24c752f0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f24b82a70 con 0x560f24c7fbb0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560f24bd7050 con 0x560f24c749d0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56750/0 (socket says 172.21.15.1:56750) 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 -- 172.21.15.1:0/826755366 learned_addr learned my addr 172.21.15.1:0/826755366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e569ff640 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c749d0 0x560f24c74db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e559fd640 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e477fe640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 0x7f5e3c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 -- 172.21.15.1:0/826755366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c749d0 msgr2=0x560f24c74db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c749d0 0x560f24c74db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 -- 172.21.15.1:0/826755366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 msgr2=0x560f24c81fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c81fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 -- 172.21.15.1:0/826755366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f24b8f130 con 0x560f24c752f0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e569ff640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 0x7f5e3c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e477fe640 1 -- 172.21.15.1:0/3693312333 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5e400cee90 con 0x7f5e5010cf30 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.193+0000 7f5e561fe640 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c031040 tx=0x7f5e4c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4011fc5db98eb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e44dea640 1 -- 172.21.15.1:0/826755366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c031e60 con 0x560f24c752f0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e569ff640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 0x7f5e3c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e48004600 tx=0x7f5e480046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e44dea640 1 -- 172.21.15.1:0/826755366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4c036040 con 0x560f24c752f0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e44dea640 1 -- 172.21.15.1:0/826755366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004330 con 0x560f24c752f0 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 -- 172.21.15.1:0/826755366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 msgr2=0x560f24c7f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c031040 tx=0x7f5e4c009880 comp rx=0 tx=0).stop 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 -- 172.21.15.1:0/826755366 shutdown_connections 2024-09-12T02:30:11.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c7f670 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c81fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/826755366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c749d0 0x560f24c74db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.194+0000 7f5e5a83b740 1 -- 172.21.15.1:0/826755366 >> 172.21.15.1:0/826755366 conn(0x560f24c70f60 msgr2=0x560f24c71340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- 172.21.15.1:0/826755366 shutdown_connections 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- 172.21.15.1:0/826755366 wait complete. 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- start start 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 Processor -- start 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c7cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560f24c82780 con 0x560f24c749d0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f24b95f20 con 0x560f24c7fbb0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560f24c82900 con 0x560f24c752f0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e5a83b740 10 client.0 _ll_register_callbacks cb 0x560f24b5f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56766/0 (socket says 172.21.15.1:56766) 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.195+0000 7f5e561fe640 1 -- 172.21.15.1:0/2987673902 learned_addr learned my addr 172.21.15.1:0/2987673902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e569ff640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c7cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 -- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 msgr2=0x560f24c7c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 -- 172.21.15.1:0/2987673902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 msgr2=0x560f24c7cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c7cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 -- 172.21.15.1:0/2987673902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2494c2b0 con 0x560f24c749d0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005e30 tx=0x7f5e4c0318a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5beca506ab11882 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c052020 con 0x560f24c749d0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5e4c003970 con 0x560f24c749d0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e4c036040 con 0x560f24c749d0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e4c05d050 con 0x560f24c749d0 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e5a83b740 10 client.14961 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:11.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560f24c82780 con 0x560f24c749d0 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.196+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4c036040 con 0x560f24c749d0 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e4c04d030 con 0x560f24c749d0 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 10 client.14961 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 10 client.14961 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 20 client.14961 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24c90160 0x560f24c915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 4 client.14961 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f24be8600 con 0x560f24c90160 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.197+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24c90160 0x560f24c915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24c90160 0x560f24c915d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a9efc2c0d01d2dd server_cookie=1c1e46e39f09540 in_seq=0 out_seq=0 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e39ffb640 10 client.14961 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2987673902 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f24be8600 con 0x560f24c90160 2024-09-12T02:30:11.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e39ffb640 10 client.14961 handle_command_reply: tid=0 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e5a83b740 1 client.14961 shutdown 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 msgr2=0x560f24c7f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.198+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005e30 tx=0x7f5e4c0318a0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 shutdown_connections 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24c90160 0x560f24c915d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c7cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2987673902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c7f380 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 >> 172.21.15.1:0/2987673902 conn(0x560f24c70f60 msgr2=0x560f24c76c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e39ffb640 0 client.14961 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 shutdown_connections 2024-09-12T02:30:11.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2987673902 wait complete. 2024-09-12T02:30:11.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.199+0000 7f5e5a83b740 20 client.14961 trim_cache size 0 max 16384 2024-09-12T02:30:11.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 Processor -- start 2024-09-12T02:30:11.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 -- start start 2024-09-12T02:30:11.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c79930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560f24c8f910 con 0x560f24c749d0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f24c8ffe0 con 0x560f24c7fbb0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560f24c906b0 con 0x560f24c752f0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56772/0 (socket says 172.21.15.1:56772) 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 -- 172.21.15.1:0/3915273908 learned_addr learned my addr 172.21.15.1:0/3915273908 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e559fd640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e569ff640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c79930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 -- 172.21.15.1:0/3915273908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 msgr2=0x560f24c7cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 -- 172.21.15.1:0/3915273908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 msgr2=0x560f24c79930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c79930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e561fe640 1 -- 172.21.15.1:0/3915273908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f24c7f6f0 con 0x560f24c749d0 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e559fd640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.217+0000 7f5e569ff640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c79930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e561fe640 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005fa0 tx=0x7f5e4c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c291053e73b7be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3915273908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c052040 con 0x560f24c749d0 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3915273908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4c036040 con 0x560f24c749d0 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3915273908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c04a040 con 0x560f24c749d0 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 -- 172.21.15.1:0/3915273908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 msgr2=0x560f24c90160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005fa0 tx=0x7f5e4c009900 comp rx=0 tx=0).stop 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 -- 172.21.15.1:0/3915273908 shutdown_connections 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c7fbb0 0x560f24c79930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c752f0 0x560f24c7cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/3915273908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c749d0 0x560f24c90160 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 -- 172.21.15.1:0/3915273908 >> 172.21.15.1:0/3915273908 conn(0x560f24c70f60 msgr2=0x560f24c6bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 -- 172.21.15.1:0/3915273908 shutdown_connections 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.218+0000 7f5e5a83b740 1 -- 172.21.15.1:0/3915273908 wait complete. 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 -- start start 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 Processor -- start 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 0x560f24c928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c7fbb0 0x560f24cf8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560f24c91450 con 0x560f24c752f0 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f24c90d80 con 0x560f24c749d0 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560f24c91b20 con 0x560f24c7fbb0 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e5a83b740 10 client.0 _ll_register_callbacks cb 0x7f5e48005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e559fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e559fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56782/0 (socket says 172.21.15.1:56782) 2024-09-12T02:30:11.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e559fd640 1 -- 172.21.15.1:0/2486082487 learned_addr learned my addr 172.21.15.1:0/2486082487 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 0x560f24c928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e559fd640 1 -- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c7fbb0 msgr2=0x560f24cf8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.219+0000 7f5e569ff640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c7fbb0 0x560f24cf8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c7fbb0 0x560f24cf8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e559fd640 1 -- 172.21.15.1:0/2486082487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 msgr2=0x560f24c928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 0x560f24c928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e559fd640 1 -- 172.21.15.1:0/2486082487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f24c936c0 con 0x560f24c752f0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 0x560f24c928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e559fd640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009b270 tx=0x7f5e4000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abed86fdbebf7b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40020040 con 0x560f24c752f0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5e40097be0 con 0x560f24c752f0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e4c036040 con 0x560f24c752f0 2024-09-12T02:30:11.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e4009b570 con 0x560f24c752f0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 10 client.14967 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560f24cf9de0 con 0x560f24c752f0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e4c036040 con 0x560f24c752f0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5e400972c0 con 0x560f24c752f0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 10 client.14967 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 10 client.14967 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 20 client.14967 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.220+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24cfea40 0x560f24cfd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 4 client.14967 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "status"}) -- 0x560f24be2b10 con 0x560f24cfea40 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24cfea40 0x560f24cfd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e561fe640 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24cfea40 0x560f24cfd750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=516f6df08f793326 server_cookie=ff265089dc4dbdbf in_seq=0 out_seq=0 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e39ffb640 10 client.14967 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:11.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e39ffb640 1 -- 172.21.15.1:0/2486082487 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560f24be2b10 con 0x560f24cfea40 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e39ffb640 10 client.14967 handle_command_reply: tid=0 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 client.14967 shutdown 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 msgr2=0x560f24c92e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5e4009b270 tx=0x7f5e4000bf60 comp rx=0 tx=0).stop 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 shutdown_connections 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560f24cfea40 0x560f24cfd750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560f24c752f0 0x560f24c92e30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560f24c7fbb0 0x560f24cf8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 --2- 172.21.15.1:0/2486082487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f24c749d0 0x560f24c928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e39ffb640 0 client.14967 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 >> 172.21.15.1:0/2486082487 conn(0x560f24c70f60 msgr2=0x560f24c7dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.221+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 shutdown_connections 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e5a83b740 1 -- 172.21.15.1:0/2486082487 wait complete. 2024-09-12T02:30:11.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e5a83b740 20 client.14967 trim_cache size 0 max 16384 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 4, 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24451, 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 67.197916082000006, 2024-09-12T02:30:11.235 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:11.236 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:11.236 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:11.236 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 106.30295398 2024-09-12T02:30:11.236 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:11.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 msgr2=0x7f5e3c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 0x7f5e3c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e48004600 tx=0x7f5e480046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 msgr2=0x7f5e501a3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000d950 tx=0x7f5e4000de10 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 shutdown_connections 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5e3c0a2c90 0x7f5e3c0a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e5010cf30 0x7f5e501a3360 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e50112640 0x7f5e501a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 --2- 172.21.15.1:0/3693312333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e5010c590 0x7f5e501a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 >> 172.21.15.1:0/3693312333 conn(0x7f5e5006cdc0 msgr2=0x7f5e5010ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 shutdown_connections 2024-09-12T02:30:11.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:11.222+0000 7f5e58462640 1 -- 172.21.15.1:0/3693312333 wait complete. 2024-09-12T02:30:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:11 smithi001 ceph-mon[31252]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T02:30:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:11 smithi134 ceph-mon[35091]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T02:30:11.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:30:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:11 smithi173 ceph-mon[35036]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T02:30:12.201 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- 172.21.15.1:0/1990784036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1036e0 msgr2=0x7fe36c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 --2- 172.21.15.1:0/1990784036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1036e0 0x7fe36c107b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe354009930 tx=0x7fe35402a420 comp rx=0 tx=0).stop 2024-09-12T02:30:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- 172.21.15.1:0/1990784036 shutdown_connections 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 --2- 172.21.15.1:0/1990784036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1036e0 0x7fe36c107b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 --2- 172.21.15.1:0/1990784036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c1082a0 0x7fe36c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 --2- 172.21.15.1:0/1990784036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c102d30 0x7fe36c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- 172.21.15.1:0/1990784036 >> 172.21.15.1:0/1990784036 conn(0x7fe36c0fc7d0 msgr2=0x7fe36c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- 172.21.15.1:0/1990784036 shutdown_connections 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- 172.21.15.1:0/1990784036 wait complete. 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 Processor -- start 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.707+0000 7fe371956640 1 -- start start 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 0x7fe36c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 0x7fe36c1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1120c0 con 0x7fe36c1082a0 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c111f40 con 0x7fe36c1036e0 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe371956640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c112240 con 0x7fe36c102d30 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56808/0 (socket says 172.21.15.1:56808) 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 -- 172.21.15.1:0/3598522589 learned_addr learned my addr 172.21.15.1:0/3598522589 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36affd640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 0x7fe36c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 0x7fe36c1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 -- 172.21.15.1:0/3598522589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 msgr2=0x7fe36c1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 0x7fe36c1a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 -- 172.21.15.1:0/3598522589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 msgr2=0x7fe36c1a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 0x7fe36c1a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 -- 172.21.15.1:0/3598522589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c19ad30 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36affd640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 0x7fe36c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 0x7fe36c1a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe36b7fe640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b970 tx=0x7fe35c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.708+0000 7fe370954640 1 -- 172.21.15.1:0/3598522589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c019070 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.709+0000 7fe370954640 1 -- 172.21.15.1:0/3598522589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe35c00cb40 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.709+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36c19b020 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.709+0000 7fe370954640 1 -- 172.21.15.1:0/3598522589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c007650 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.709+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36c1a7310 con 0x7fe36c1082a0 2024-09-12T02:30:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.711+0000 7fe370954640 1 -- 172.21.15.1:0/3598522589 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe35c01c070 con 0x7fe36c1082a0 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.711+0000 7fe373d2f740 1 Processor -- start 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.711+0000 7fe373d2f740 1 -- start start 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e69f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a9e5fb090 con 0x558a9e6949d0 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558a9e5a2a70 con 0x558a9e69fbb0 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe373d2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a9e5f7050 con 0x558a9e6952f0 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56822/0 (socket says 172.21.15.1:56822) 2024-09-12T02:30:12.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2773865284 learned_addr learned my addr 172.21.15.1:0/2773865284 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36affd640 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e69f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2773865284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 msgr2=0x558a9e69f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e69f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2773865284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 msgr2=0x558a9e6a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2773865284 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9e5af130 con 0x558a9e6949d0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe370954640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 0x7fe3580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36b7fe640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 0x7fe3580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe354005940 tx=0x7fe3540095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829ff36a9bce2dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.712+0000 7fe370954640 1 -- 172.21.15.1:0/3598522589 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe35c0ce6f0 con 0x7fe36c1082a0 2024-09-12T02:30:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe361ffb640 1 -- 172.21.15.1:0/2773865284 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354035030 con 0x558a9e6949d0 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe361ffb640 1 -- 172.21.15.1:0/2773865284 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe354005500 con 0x558a9e6949d0 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe361ffb640 1 -- 172.21.15.1:0/2773865284 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354004d60 con 0x558a9e6949d0 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 -- 172.21.15.1:0/2773865284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 msgr2=0x558a9e694db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe36b7fe640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 0x7fe3580a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe35c09ae70 tx=0x7fe35c00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe354005940 tx=0x7fe3540095e0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 -- 172.21.15.1:0/2773865284 shutdown_connections 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e69f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2773865284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e694db0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 -- 172.21.15.1:0/2773865284 >> 172.21.15.1:0/2773865284 conn(0x558a9e690f60 msgr2=0x558a9e691340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.713+0000 7fe373d2f740 1 -- 172.21.15.1:0/2773865284 shutdown_connections 2024-09-12T02:30:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 -- 172.21.15.1:0/2773865284 wait complete. 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 -- start start 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 Processor -- start 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e6952f0 0x558a9e69c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e69fbb0 0x558a9e69cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6a2780 con 0x558a9e6949d0 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558a9e5b5f20 con 0x558a9e6952f0 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6a2900 con 0x558a9e69fbb0 2024-09-12T02:30:12.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe373d2f740 10 client.0 _ll_register_callbacks cb 0x558a9e57f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56834/0 (socket says 172.21.15.1:56834) 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.714+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2109966740 learned_addr learned my addr 172.21.15.1:0/2109966740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36affd640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e6952f0 0x558a9e69c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e69fbb0 0x558a9e69cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e69fbb0 msgr2=0x558a9e69cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e69fbb0 0x558a9e69cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2109966740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e6952f0 msgr2=0x558a9e69c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e6952f0 0x558a9e69c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2109966740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9e36c2b0 con 0x558a9e6949d0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe354005790 tx=0x7fe354004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6fd5f328cfd0af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe34affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354035040 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe354004250 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe354005500 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe354005330 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe373d2f740 10 client.14979 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a9e6ae0d0 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.715+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe354005500 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe35404b020 con 0x558a9e6949d0 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 10 client.14979 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 10 client.14979 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 20 client.14979 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e6b01d0 0x558a9e6b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 4 client.14979 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a9e608600 con 0x558a9e6b01d0 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.716+0000 7fe36affd640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e6b01d0 0x558a9e6b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.717+0000 7fe34affd640 10 client.14979 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.717+0000 7fe36affd640 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e6b01d0 0x558a9e6b1640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc5aa7d356190f6 server_cookie=27a5611d16809559 in_seq=0 out_seq=0 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.717+0000 7fe34affd640 1 -- 172.21.15.1:0/2109966740 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a9e608600 con 0x558a9e6b01d0 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.717+0000 7fe34affd640 10 client.14979 handle_command_reply: tid=0 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.717+0000 7fe373d2f740 1 client.14979 shutdown 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 msgr2=0x558a9e69f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe354005790 tx=0x7fe354004a60 comp rx=0 tx=0).stop 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 shutdown_connections 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e6b01d0 0x558a9e6b1640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e69fbb0 0x558a9e69cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e6952f0 0x558a9e69c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2109966740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e69f450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 >> 172.21.15.1:0/2109966740 conn(0x558a9e690f60 msgr2=0x558a9e696c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe34affd640 0 client.14979 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 shutdown_connections 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 1 -- 172.21.15.1:0/2109966740 wait complete. 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.718+0000 7fe373d2f740 20 client.14979 trim_cache size 0 max 16384 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 Processor -- start 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 -- start start 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 0x558a9e6b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6af980 con 0x558a9e6952f0 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6b0050 con 0x558a9e69fbb0 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.736+0000 7fe373d2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6b0720 con 0x558a9e6949d0 2024-09-12T02:30:12.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56844/0 (socket says 172.21.15.1:56844) 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 -- 172.21.15.1:0/1857298414 learned_addr learned my addr 172.21.15.1:0/1857298414 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 0x558a9e6b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 -- 172.21.15.1:0/1857298414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 msgr2=0x558a9e6b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 0x558a9e6b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 -- 172.21.15.1:0/1857298414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 msgr2=0x558a9e6afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 -- 172.21.15.1:0/1857298414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9e69f7c0 con 0x558a9e6952f0 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 0x558a9e6b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe36affd640 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c880 tx=0x7fe364004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6201268deb113a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe3617fa640 1 -- 172.21.15.1:0/1857298414 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364003d20 con 0x558a9e6952f0 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe3617fa640 1 -- 172.21.15.1:0/1857298414 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe364020070 con 0x558a9e6952f0 2024-09-12T02:30:12.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.737+0000 7fe3617fa640 1 -- 172.21.15.1:0/1857298414 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3640118b0 con 0x558a9e6952f0 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- 172.21.15.1:0/1857298414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 msgr2=0x558a9e6b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c880 tx=0x7fe364004410 comp rx=0 tx=0).stop 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- 172.21.15.1:0/1857298414 shutdown_connections 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6952f0 0x558a9e6b08a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 --2- 172.21.15.1:0/1857298414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6949d0 0x558a9e6b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- 172.21.15.1:0/1857298414 >> 172.21.15.1:0/1857298414 conn(0x558a9e690f60 msgr2=0x558a9e68bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- 172.21.15.1:0/1857298414 shutdown_connections 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- 172.21.15.1:0/1857298414 wait complete. 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.738+0000 7fe373d2f740 1 -- start start 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 Processor -- start 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e6b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6b14c0 con 0x558a9e6949d0 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6b0df0 con 0x558a9e69fbb0 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a9e6b1b90 con 0x558a9e6952f0 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe373d2f740 10 client.0 _ll_register_callbacks cb 0x7fe354031930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56858/0 (socket says 172.21.15.1:56858) 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2697192744 learned_addr learned my addr 172.21.15.1:0/2697192744 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:12.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36affd640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e6b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 msgr2=0x558a9e6b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e6b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2697192744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 msgr2=0x558a9e6b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:12.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 -- 172.21.15.1:0/2697192744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9e718ba0 con 0x558a9e6949d0 2024-09-12T02:30:12.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe36a7fc640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe35403b6a0 tx=0x7fe35403b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54add8997052394 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:12.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe34affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:12.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.739+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354035050 con 0x558a9e6949d0 2024-09-12T02:30:12.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe364020070 con 0x558a9e6949d0 2024-09-12T02:30:12.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe354004e50 con 0x558a9e6949d0 2024-09-12T02:30:12.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe354009780 con 0x558a9e6949d0 2024-09-12T02:30:12.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 10 client.14985 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:12.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a9e719ea0 con 0x558a9e6949d0 2024-09-12T02:30:12.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe364020070 con 0x558a9e6949d0 2024-09-12T02:30:12.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe35404b040 con 0x558a9e6949d0 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 3, 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24457, 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:12.768 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 69.725784442000005, 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 105.164574766 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 10 client.14985 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:12.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 10 client.14985 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 20 client.14985 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e71ea30 0x558a9e71d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 4 client.14985 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.740+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "status"}) -- 0x558a9e602b10 con 0x558a9e71ea30 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe36affd640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e71ea30 0x558a9e71d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe34affd640 10 client.14985 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe36affd640 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e71ea30 0x558a9e71d740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=73dfeef61604b436 server_cookie=82d6673a88cf1829 in_seq=0 out_seq=0 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe34affd640 1 -- 172.21.15.1:0/2697192744 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558a9e602b10 con 0x558a9e71ea30 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe34affd640 10 client.14985 handle_command_reply: tid=0 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 client.14985 shutdown 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 msgr2=0x558a9e6b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe35403b6a0 tx=0x7fe35403b900 comp rx=0 tx=0).stop 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 shutdown_connections 2024-09-12T02:30:12.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x558a9e71ea30 0x558a9e71d740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558a9e69fbb0 0x558a9e6b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a9e6952f0 0x558a9e6b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe34affd640 0 client.14985 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 --2- 172.21.15.1:0/2697192744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a9e6949d0 0x558a9e6b2ac0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.741+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 >> 172.21.15.1:0/2697192744 conn(0x558a9e690f60 msgr2=0x558a9e69aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 shutdown_connections 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe373d2f740 1 -- 172.21.15.1:0/2697192744 wait complete. 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe373d2f740 20 client.14985 trim_cache size 0 max 16384 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 msgr2=0x7fe3580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 0x7fe3580a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe35c09ae70 tx=0x7fe35c00e040 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 msgr2=0x7fe36c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b970 tx=0x7fe35c00be30 comp rx=0 tx=0).stop 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 shutdown_connections 2024-09-12T02:30:12.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe3580a2c10 0x7fe3580a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe36c1082a0 0x7fe36c19a600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe36c1036e0 0x7fe36c1a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 --2- 172.21.15.1:0/3598522589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe36c102d30 0x7fe36c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 >> 172.21.15.1:0/3598522589 conn(0x7fe36c0fc7d0 msgr2=0x7fe36c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 shutdown_connections 2024-09-12T02:30:12.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:12.742+0000 7fe371956640 1 -- 172.21.15.1:0/3598522589 wait complete. 2024-09-12T02:30:13.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:30:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:13.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:13 smithi001 ceph-mon[31252]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:13 smithi134 ceph-mon[35091]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:13.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:13 smithi173 ceph-mon[35036]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:14.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- 172.21.15.1:0/1981424790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 msgr2=0x7f861c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 --2- 172.21.15.1:0/1981424790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1021c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8610009900 tx=0x7f861002a410 comp rx=0 tx=0).stop 2024-09-12T02:30:14.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- 172.21.15.1:0/1981424790 shutdown_connections 2024-09-12T02:30:14.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 --2- 172.21.15.1:0/1981424790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 0x7f861c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 --2- 172.21.15.1:0/1981424790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 0x7f861c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 --2- 172.21.15.1:0/1981424790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1021c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- 172.21.15.1:0/1981424790 >> 172.21.15.1:0/1981424790 conn(0x7f861c0fd8c0 msgr2=0x7f861c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- 172.21.15.1:0/1981424790 shutdown_connections 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- 172.21.15.1:0/1981424790 wait complete. 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 Processor -- start 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.215+0000 7f8622e47640 1 -- start start 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 0x7f861c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 0x7f861c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111f70 con 0x7f861c101de0 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111df0 con 0x7f861c106f10 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8622e47640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1120f0 con 0x7f861c102790 2024-09-12T02:30:14.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56866/0 (socket says 172.21.15.1:56866) 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 -- 172.21.15.1:0/3406682354 learned_addr learned my addr 172.21.15.1:0/3406682354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f86213e4640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 0x7f861c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f861bfff640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 0x7f861c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 -- 172.21.15.1:0/3406682354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 msgr2=0x7f861c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 0x7f861c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 -- 172.21.15.1:0/3406682354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 msgr2=0x7f861c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 0x7f861c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 -- 172.21.15.1:0/3406682354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c19d2a0 con 0x7f861c101de0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8620be3640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8610005ab0 tx=0x7f86100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.216+0000 7f8619ffb640 1 -- 172.21.15.1:0/3406682354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861003f030 con 0x7f861c101de0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.217+0000 7f8619ffb640 1 -- 172.21.15.1:0/3406682354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8610003ce0 con 0x7f861c101de0 2024-09-12T02:30:14.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.217+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c19d530 con 0x7f861c101de0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.217+0000 7f8619ffb640 1 -- 172.21.15.1:0/3406682354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610035070 con 0x7f861c101de0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.217+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c1a4e70 con 0x7f861c101de0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.219+0000 7f8619ffb640 1 -- 172.21.15.1:0/3406682354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8610042030 con 0x7f861c101de0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.219+0000 7f8625220740 1 Processor -- start 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.219+0000 7f8625220740 1 -- start start 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a49d0 0x558d5b4a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8619ffb640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 0x7f860c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a52f0 0x558d5b4af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d5b40b090 con 0x558d5b4afbb0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d5b3b2a70 con 0x558d5b4a52f0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8625220740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d5b407050 con 0x558d5b4a49d0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56882/0 (socket says 172.21.15.1:56882) 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 -- 172.21.15.1:0/3822924345 learned_addr learned my addr 172.21.15.1:0/3822924345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8620be3640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 0x7f860c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a49d0 0x558d5b4a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f861bfff640 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a52f0 0x558d5b4af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8619ffb640 1 -- 172.21.15.1:0/3406682354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f86100efb40 con 0x7f861c101de0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 -- 172.21.15.1:0/3822924345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a49d0 msgr2=0x558d5b4a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a49d0 0x558d5b4a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 -- 172.21.15.1:0/3822924345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a52f0 msgr2=0x558d5b4af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a52f0 0x558d5b4af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 -- 172.21.15.1:0/3822924345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5b3bf130 con 0x558d5b4afbb0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f86213e4640 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8614014ca0 tx=0x7f86140079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69557bd8311708ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8620be3640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 0x7f860c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86100b8b90 tx=0x7f861004c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.220+0000 7f8606ffd640 1 -- 172.21.15.1:0/3822924345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614014e50 con 0x558d5b4afbb0 2024-09-12T02:30:14.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8606ffd640 1 -- 172.21.15.1:0/3822924345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86140140d0 con 0x558d5b4afbb0 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8606ffd640 1 -- 172.21.15.1:0/3822924345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614005730 con 0x558d5b4afbb0 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 -- 172.21.15.1:0/3822924345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 msgr2=0x558d5b4b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8614014ca0 tx=0x7f86140079b0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 -- 172.21.15.1:0/3822924345 shutdown_connections 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4b1fa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a52f0 0x558d5b4af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 --2- 172.21.15.1:0/3822924345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a49d0 0x558d5b4a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 -- 172.21.15.1:0/3822924345 >> 172.21.15.1:0/3822924345 conn(0x558d5b4a0f60 msgr2=0x558d5b4a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 -- 172.21.15.1:0/3822924345 shutdown_connections 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.221+0000 7f8625220740 1 -- 172.21.15.1:0/3822924345 wait complete. 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 -- start start 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 Processor -- start 2024-09-12T02:30:14.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4af460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4afbb0 0x558d5b4accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4b2780 con 0x558d5b4a52f0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d5b3c5f20 con 0x558d5b4a49d0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4b2900 con 0x558d5b4afbb0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f8625220740 10 client.0 _ll_register_callbacks cb 0x558d5b38f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f861bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f861bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56886/0 (socket says 172.21.15.1:56886) 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.222+0000 7f861bfff640 1 -- 172.21.15.1:0/2403684505 learned_addr learned my addr 172.21.15.1:0/2403684505 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f86213e4640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f86213e4640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4afbb0 0x558d5b4accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 -- 172.21.15.1:0/2403684505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4afbb0 msgr2=0x558d5b4accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4afbb0 0x558d5b4accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 -- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 msgr2=0x558d5b4af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 -- 172.21.15.1:0/2403684505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5b17c2b0 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f86213e4640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f861bfff640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8608010840 tx=0x7f8608010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4af31c26129ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f85fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860800cd20 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f860801c480 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86140140d0 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f860801c680 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f8625220740 10 client.14997 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d5b4be100 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.223+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86140140d0 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8608011890 con 0x558d5b4a52f0 2024-09-12T02:30:14.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 10 client.14997 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 10 client.14997 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 20 client.14997 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b4c0730 0x558d5b4c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 4 client.14997 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d5b418600 con 0x558d5b4c0730 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f86213e4640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b4c0730 0x558d5b4c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f86213e4640 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b4c0730 0x558d5b4c1ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1758d8f136b5b7c server_cookie=a3894dcf8884616b in_seq=0 out_seq=0 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.224+0000 7f85fbfff640 10 client.14997 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f85fbfff640 1 -- 172.21.15.1:0/2403684505 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d5b418600 con 0x558d5b4c0730 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f85fbfff640 10 client.14997 handle_command_reply: tid=0 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 client.14997 shutdown 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 msgr2=0x558d5b4ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8608010840 tx=0x7f8608010d00 comp rx=0 tx=0).stop 2024-09-12T02:30:14.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 shutdown_connections 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4a52f0 0x558d5b4ac7b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b4c0730 0x558d5b4c1ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4afbb0 0x558d5b4accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 --2- 172.21.15.1:0/2403684505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f85fbfff640 0 client.14997 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.225+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 >> 172.21.15.1:0/2403684505 conn(0x558d5b4a0f60 msgr2=0x558d5b4a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.226+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 shutdown_connections 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.226+0000 7f8625220740 1 -- 172.21.15.1:0/2403684505 wait complete. 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.226+0000 7f8625220740 20 client.14997 trim_cache size 0 max 16384 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.243+0000 7f8625220740 1 Processor -- start 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.243+0000 7f8625220740 1 -- start start 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4bfee0 con 0x558d5b4afbb0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4c05b0 con 0x558d5b4a49d0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f8625220740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4c0c80 con 0x558d5b4a52f0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56888/0 (socket says 172.21.15.1:56888) 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 -- 172.21.15.1:0/1309786346 learned_addr learned my addr 172.21.15.1:0/1309786346 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f861bfff640 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 -- 172.21.15.1:0/1309786346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 msgr2=0x558d5b4c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 -- 172.21.15.1:0/1309786346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 msgr2=0x558d5b4c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 -- 172.21.15.1:0/1309786346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5b4aad20 con 0x558d5b4afbb0 2024-09-12T02:30:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86213e4640 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f86140053c0 tx=0x7f8614007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf79766680cee1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86067fc640 1 -- 172.21.15.1:0/1309786346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614014070 con 0x558d5b4afbb0 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86067fc640 1 -- 172.21.15.1:0/1309786346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8614014e50 con 0x558d5b4afbb0 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.244+0000 7f86067fc640 1 -- 172.21.15.1:0/1309786346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86140056c0 con 0x558d5b4afbb0 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- 172.21.15.1:0/1309786346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 msgr2=0x558d5b4ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f86140053c0 tx=0x7f8614007e50 comp rx=0 tx=0).stop 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- 172.21.15.1:0/1309786346 shutdown_connections 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b4ca3c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 --2- 172.21.15.1:0/1309786346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- 172.21.15.1:0/1309786346 >> 172.21.15.1:0/1309786346 conn(0x558d5b4a0f60 msgr2=0x558d5b4ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- 172.21.15.1:0/1309786346 shutdown_connections 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- 172.21.15.1:0/1309786346 wait complete. 2024-09-12T02:30:14.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 -- start start 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.245+0000 7f8625220740 1 Processor -- start 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4c1a20 con 0x558d5b4afbb0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4c1350 con 0x558d5b4a49d0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d5b4c20f0 con 0x558d5b4a52f0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f8625220740 10 client.0 _ll_register_callbacks cb 0x7f860800e430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56904/0 (socket says 172.21.15.1:56904) 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 -- 172.21.15.1:0/2928511603 learned_addr learned my addr 172.21.15.1:0/2928511603 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f861bfff640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 -- 172.21.15.1:0/2928511603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 msgr2=0x558d5b4c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 -- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 msgr2=0x558d5b4c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 -- 172.21.15.1:0/2928511603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5b5234e0 con 0x558d5b4afbb0 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f861bfff640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f86213e4640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8614007df0 tx=0x7f8614007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d077a545fc2bfe8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.246+0000 7f85fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86140078b0 con 0x558d5b4afbb0 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f861400fe00 con 0x558d5b4afbb0 2024-09-12T02:30:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8614014e50 con 0x558d5b4afbb0 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86140140b0 con 0x558d5b4afbb0 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 10 client.15003 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d5b52a7d0 con 0x558d5b4afbb0 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8614014e50 con 0x558d5b4afbb0 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f861402b420 con 0x558d5b4afbb0 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 10 client.15003 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 10 client.15003 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 20 client.15003 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b52ebd0 0x558d5b52d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 4 client.15003 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:14.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "status"}) -- 0x558d5b412b10 con 0x558d5b52ebd0 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.247+0000 7f861bfff640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b52ebd0 0x558d5b52d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f861bfff640 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b52ebd0 0x558d5b52d8e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbc96ef0fc02c630 server_cookie=cd6f37c34bb28c3a in_seq=0 out_seq=0 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f85fbfff640 10 client.15003 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f85fbfff640 1 -- 172.21.15.1:0/2928511603 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558d5b412b10 con 0x558d5b52ebd0 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f85fbfff640 10 client.15003 handle_command_reply: tid=0 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 client.15003 shutdown 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 msgr2=0x558d5b522e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8614007df0 tx=0x7f8614007770 comp rx=0 tx=0).stop 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 shutdown_connections 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d5b4afbb0 0x558d5b522e70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d5b52ebd0 0x558d5b52d8e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f85fbfff640 0 client.15003 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:14.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d5b4a52f0 0x558d5b4c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 --2- 172.21.15.1:0/2928511603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5b4a49d0 0x558d5b4c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 >> 172.21.15.1:0/2928511603 conn(0x558d5b4a0f60 msgr2=0x558d5b49f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.248+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 shutdown_connections 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8625220740 1 -- 172.21.15.1:0/2928511603 wait complete. 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8625220740 20 client.15003 trim_cache size 0 max 16384 2024-09-12T02:30:14.266 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24470, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 72.238053042000004, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 103.977451695 2024-09-12T02:30:14.267 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:14.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 msgr2=0x7f860c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 0x7f860c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86100b8b90 tx=0x7f861004c000 comp rx=0 tx=0).stop 2024-09-12T02:30:14.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 msgr2=0x7f861c1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.249+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8610005ab0 tx=0x7f86100042f0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 shutdown_connections 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f860c0a2c10 0x7f860c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f861c106f10 0x7f861c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c102790 0x7f861c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 --2- 172.21.15.1:0/3406682354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f861c101de0 0x7f861c1982f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 >> 172.21.15.1:0/3406682354 conn(0x7f861c0fd8c0 msgr2=0x7f861c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 shutdown_connections 2024-09-12T02:30:14.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:14.250+0000 7f8622e47640 1 -- 172.21.15.1:0/3406682354 wait complete. 2024-09-12T02:30:15.042 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:30:15.299 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:15.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:15 smithi001 ceph-mon[31252]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- 172.21.15.1:0/760875669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 msgr2=0x7f0f40101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 --2- 172.21.15.1:0/760875669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40101200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009900 tx=0x7f0f3c02a480 comp rx=0 tx=0).stop 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- 172.21.15.1:0/760875669 shutdown_connections 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 --2- 172.21.15.1:0/760875669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102ef0 0x7f0f4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 --2- 172.21.15.1:0/760875669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102570 0x7f0f401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 --2- 172.21.15.1:0/760875669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40101200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- 172.21.15.1:0/760875669 >> 172.21.15.1:0/760875669 conn(0x7f0f400fc7d0 msgr2=0x7f0f400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- 172.21.15.1:0/760875669 shutdown_connections 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- 172.21.15.1:0/760875669 wait complete. 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 Processor -- start 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.792+0000 7f0f4701d640 1 -- start start 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 0x7f0f401998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 0x7f0f401a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40110fd0 con 0x7f0f40100e20 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40110e50 con 0x7f0f40102570 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f4701d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40111150 con 0x7f0f40102ef0 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56918/0 (socket says 172.21.15.1:56918) 2024-09-12T02:30:15.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 -- 172.21.15.1:0/3271540808 learned_addr learned my addr 172.21.15.1:0/3271540808 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f37fff640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 0x7f0f401998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f455ba640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 0x7f0f401a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 -- 172.21.15.1:0/3271540808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 msgr2=0x7f0f401a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 0x7f0f401a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 -- 172.21.15.1:0/3271540808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 msgr2=0x7f0f401998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 0x7f0f401998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 -- 172.21.15.1:0/3271540808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f401a4920 con 0x7f0f40100e20 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f455ba640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 0x7f0f401a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f37fff640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 0x7f0f401998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c02aa70 tx=0x7f0f3c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.793+0000 7f0f35ffb640 1 -- 172.21.15.1:0/3271540808 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c03f070 con 0x7f0f40100e20 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.794+0000 7f0f35ffb640 1 -- 172.21.15.1:0/3271540808 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c031c20 con 0x7f0f40100e20 2024-09-12T02:30:15.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.794+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f401a4af0 con 0x7f0f40100e20 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.794+0000 7f0f35ffb640 1 -- 172.21.15.1:0/3271540808 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c035030 con 0x7f0f40100e20 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.794+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f401a4f40 con 0x7f0f40100e20 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.796+0000 7f0f35ffb640 1 -- 172.21.15.1:0/3271540808 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0f3c042070 con 0x7f0f40100e20 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.796+0000 7f0f493f6740 1 Processor -- start 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.796+0000 7f0f493f6740 1 -- start start 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58009d0 0x55a8d5800db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 0x55a8d580dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8d5767090 con 0x55a8d58012f0 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a8d570ea70 con 0x55a8d580bbb0 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f493f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a8d5763050 con 0x55a8d58009d0 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56930/0 (socket says 172.21.15.1:56930) 2024-09-12T02:30:15.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 -- 172.21.15.1:0/3553134115 learned_addr learned my addr 172.21.15.1:0/3553134115 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f455ba640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58009d0 0x55a8d5800db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f37fff640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 0x55a8d580dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f35ffb640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 0x7f0f280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 -- 172.21.15.1:0/3553134115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58009d0 msgr2=0x55a8d5800db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58009d0 0x55a8d5800db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 -- 172.21.15.1:0/3553134115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 msgr2=0x55a8d580dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 0x55a8d580dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f44db9640 1 -- 172.21.15.1:0/3553134115 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8d571b130 con 0x55a8d58012f0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f455ba640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 0x7f0f280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f37fff640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 0x55a8d580dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.797+0000 7f0f35ffb640 1 -- 172.21.15.1:0/3271540808 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0f3c0efaf0 con 0x7f0f40100e20 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f44db9640 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c04afb0 tx=0x7f0f3c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe860e622c206730 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f455ba640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 0x7f0f280a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f38004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f26ffd640 1 -- 172.21.15.1:0/3553134115 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0bbcb0 con 0x55a8d58012f0 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f26ffd640 1 -- 172.21.15.1:0/3553134115 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c03cb60 con 0x55a8d58012f0 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f26ffd640 1 -- 172.21.15.1:0/3553134115 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0bbad0 con 0x55a8d58012f0 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 -- 172.21.15.1:0/3553134115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 msgr2=0x55a8d580b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c04afb0 tx=0x7f0f3c04b000 comp rx=0 tx=0).stop 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 -- 172.21.15.1:0/3553134115 shutdown_connections 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d580b670 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d580bbb0 0x55a8d580dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 --2- 172.21.15.1:0/3553134115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58009d0 0x55a8d5800db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.798+0000 7f0f493f6740 1 -- 172.21.15.1:0/3553134115 >> 172.21.15.1:0/3553134115 conn(0x55a8d57fcf60 msgr2=0x55a8d57fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.799+0000 7f0f493f6740 1 -- 172.21.15.1:0/3553134115 shutdown_connections 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.799+0000 7f0f493f6740 1 -- 172.21.15.1:0/3553134115 wait complete. 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.799+0000 7f0f493f6740 1 -- start start 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.799+0000 7f0f493f6740 1 Processor -- start 2024-09-12T02:30:15.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.799+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d580b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 0x55a8d5808710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8d580e540 con 0x55a8d580bbb0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a8d5721f20 con 0x55a8d58009d0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a8d580e6c0 con 0x55a8d58012f0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 10 client.0 _ll_register_callbacks cb 0x55a8d56eb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56946/0 (socket says 172.21.15.1:56946) 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 -- 172.21.15.1:0/1550261289 learned_addr learned my addr 172.21.15.1:0/1550261289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d580b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f37fff640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 0x55a8d5808710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 -- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 msgr2=0x55a8d5808710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 0x55a8d5808710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 -- 172.21.15.1:0/1550261289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 msgr2=0x55a8d580b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d580b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 -- 172.21.15.1:0/1550261289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8d54d82b0 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f37fff640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 0x55a8d5808710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d580b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f455ba640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f380092f0 tx=0x7f0f38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa4e44a267c8f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38023070 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0f3800fd50 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.800+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8d5774600 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0f3802f050 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 10 client.15015 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8d5819df0 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a8d5774600 con 0x55a8d580bbb0 2024-09-12T02:30:15.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0f38027480 con 0x55a8d580bbb0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 10 client.15015 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 10 client.15015 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 20 client.15015 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d581c4e0 0x55a8d581d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 4 client.15015 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8d576eb10 con 0x55a8d581c4e0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.801+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d581c4e0 0x55a8d581d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.802+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d581c4e0 0x55a8d581d950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ddf9dc4d05f88970 server_cookie=b0e0426e62d48210 in_seq=0 out_seq=0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.802+0000 7f0f1ffff640 10 client.15015 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.802+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1550261289 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8d576eb10 con 0x55a8d581c4e0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f1ffff640 10 client.15015 handle_command_reply: tid=0 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 client.15015 shutdown 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 msgr2=0x55a8d5808c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f380092f0 tx=0x7f0f38004ab0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 shutdown_connections 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d581c4e0 0x55a8d581d950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d580bbb0 0x55a8d5808c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d58012f0 0x55a8d5808710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1550261289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d580b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f1ffff640 0 client.15015 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 >> 172.21.15.1:0/1550261289 conn(0x55a8d57fcf60 msgr2=0x55a8d5802c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 shutdown_connections 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 1 -- 172.21.15.1:0/1550261289 wait complete. 2024-09-12T02:30:15.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.803+0000 7f0f493f6740 20 client.15015 trim_cache size 0 max 16384 2024-09-12T02:30:15.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 Processor -- start 2024-09-12T02:30:15.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 -- start start 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58012f0 0x55a8d581d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d5806fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581bc90 con 0x55a8d58009d0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581c360 con 0x55a8d58012f0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f493f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581ca30 con 0x55a8d580bbb0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f44db9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56950/0 (socket says 172.21.15.1:56950) 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.821+0000 7f0f44db9640 1 -- 172.21.15.1:0/2111633375 learned_addr learned my addr 172.21.15.1:0/2111633375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f37fff640 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58012f0 0x55a8d581d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f455ba640 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d5806fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 -- 172.21.15.1:0/2111633375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 msgr2=0x55a8d5806fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d5806fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 -- 172.21.15.1:0/2111633375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58012f0 msgr2=0x55a8d581d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58012f0 0x55a8d581d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 -- 172.21.15.1:0/2111633375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8d57fcd90 con 0x55a8d58009d0 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f44db9640 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0c48b0 tx=0x7f0f3c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb28db4fe246cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f267fc640 1 -- 172.21.15.1:0/2111633375 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c049040 con 0x55a8d58009d0 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f267fc640 1 -- 172.21.15.1:0/2111633375 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c031dd0 con 0x55a8d58009d0 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.822+0000 7f0f267fc640 1 -- 172.21.15.1:0/2111633375 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0ba210 con 0x55a8d58009d0 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- 172.21.15.1:0/2111633375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 msgr2=0x55a8d5817710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0c48b0 tx=0x7f0f3c003f60 comp rx=0 tx=0).stop 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- 172.21.15.1:0/2111633375 shutdown_connections 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d5806fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58012f0 0x55a8d581d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 --2- 172.21.15.1:0/2111633375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58009d0 0x55a8d5817710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- 172.21.15.1:0/2111633375 >> 172.21.15.1:0/2111633375 conn(0x55a8d57fcf60 msgr2=0x55a8d57fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- 172.21.15.1:0/2111633375 shutdown_connections 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- 172.21.15.1:0/2111633375 wait complete. 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 -- start start 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.823+0000 7f0f493f6740 1 Processor -- start 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d581eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d581f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581d7d0 con 0x55a8d58012f0 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581d100 con 0x55a8d58009d0 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a8d581dea0 con 0x55a8d580bbb0 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 10 client.0 _ll_register_callbacks cb 0x7f0f38009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:15.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56954/0 (socket says 172.21.15.1:56954) 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 -- 172.21.15.1:0/1362742870 learned_addr learned my addr 172.21.15.1:0/1362742870 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d581eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f455ba640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d581f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 -- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 msgr2=0x55a8d581f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d581f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 -- 172.21.15.1:0/1362742870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 msgr2=0x55a8d581eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d581eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 -- 172.21.15.1:0/1362742870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8d5884cb0 con 0x55a8d58012f0 2024-09-12T02:30:15.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f37fff640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005fd0 tx=0x7f0f3000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ac53817c8d29e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30012440 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0f300125e0 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.824+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c031dd0 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0f300127e0 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 10 client.15021 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8d5886040 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c031dd0 con 0x55a8d58012f0 2024-09-12T02:30:15.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0f30010b00 con 0x55a8d58012f0 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 10 client.15021 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 10 client.15021 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 20 client.15021 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d588ac90 0x55a8d58899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 4 client.15021 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.825+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "status"}) -- 0x55a8d56eb0e0 con 0x55a8d588ac90 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d588ac90 0x55a8d58899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f1ffff640 10 client.15021 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:15.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f44db9640 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d588ac90 0x55a8d58899a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97e064143a15d2c2 server_cookie=903cc258c9061839 in_seq=0 out_seq=0 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f1ffff640 1 -- 172.21.15.1:0/1362742870 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a8d56eb0e0 con 0x55a8d588ac90 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f1ffff640 10 client.15021 handle_command_reply: tid=0 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 client.15021 shutdown 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 msgr2=0x55a8d581f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005fd0 tx=0x7f0f3000b810 comp rx=0 tx=0).stop 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 shutdown_connections 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a8d588ac90 0x55a8d58899a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8d58012f0 0x55a8d581f090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a8d580bbb0 0x55a8d581f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f1ffff640 0 client.15021 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:15.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 --2- 172.21.15.1:0/1362742870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a8d58009d0 0x55a8d581eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 >> 172.21.15.1:0/1362742870 conn(0x55a8d57fcf60 msgr2=0x55a8d5806fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 shutdown_connections 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.826+0000 7f0f493f6740 1 -- 172.21.15.1:0/1362742870 wait complete. 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f493f6740 20 client.15021 trim_cache size 0 max 16384 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24475, 2024-09-12T02:30:15.841 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 74.823663037000003, 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 102.97635539300001 2024-09-12T02:30:15.842 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 msgr2=0x7f0f280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 0x7f0f280a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005fd0 tx=0x7f0f38004a40 comp rx=0 tx=0).stop 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 msgr2=0x7f0f40199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c02aa70 tx=0x7f0f3c003b60 comp rx=0 tx=0).stop 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 shutdown_connections 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0f280a2c10 0x7f0f280a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f40102ef0 0x7f0f401a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40102570 0x7f0f401998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 --2- 172.21.15.1:0/3271540808 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f40100e20 0x7f0f40199360 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:15.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 >> 172.21.15.1:0/3271540808 conn(0x7f0f400fc7d0 msgr2=0x7f0f400fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:15.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 shutdown_connections 2024-09-12T02:30:15.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:15.827+0000 7f0f4701d640 1 -- 172.21.15.1:0/3271540808 wait complete. 2024-09-12T02:30:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:15 smithi134 ceph-mon[35091]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:15 smithi173 ceph-mon[35036]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:16.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:30:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 -- 172.21.15.1:0/2548126466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101bc0 msgr2=0x7f2a2010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 --2- 172.21.15.1:0/2548126466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101bc0 0x7f2a2010d910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009ca0 tx=0x7f2a1802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 -- 172.21.15.1:0/2548126466 shutdown_connections 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 --2- 172.21.15.1:0/2548126466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101bc0 0x7f2a2010d910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 --2- 172.21.15.1:0/2548126466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20101240 0x7f2a20101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 --2- 172.21.15.1:0/2548126466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20105a90 0x7f2a20105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 -- 172.21.15.1:0/2548126466 >> 172.21.15.1:0/2548126466 conn(0x7f2a20077210 msgr2=0x7f2a200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 -- 172.21.15.1:0/2548126466 shutdown_connections 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.319+0000 7f2a26484640 1 -- 172.21.15.1:0/2548126466 wait complete. 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 Processor -- start 2024-09-12T02:30:17.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 -- start start 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20101bc0 0x7f2a20198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 0x7f2a2019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20111080 con 0x7f2a20101240 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20110f00 con 0x7f2a20105a90 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a26484640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20111200 con 0x7f2a20101bc0 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56978/0 (socket says 172.21.15.1:56978) 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.320+0000 7f2a1ffff640 1 -- 172.21.15.1:0/2150794109 learned_addr learned my addr 172.21.15.1:0/2150794109 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 0x7f2a2019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20101bc0 0x7f2a20198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 -- 172.21.15.1:0/2150794109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20101bc0 msgr2=0x7f2a20198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20101bc0 0x7f2a20198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 -- 172.21.15.1:0/2150794109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 msgr2=0x7f2a2019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 0x7f2a2019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 -- 172.21.15.1:0/2150794109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2019d510 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 0x7f2a2019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b4a0 tx=0x7f2a1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1d7fa640 1 -- 172.21.15.1:0/2150794109 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10014070 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2019d800 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1d7fa640 1 -- 172.21.15.1:0/2150794109 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a10010af0 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a1d7fa640 1 -- 172.21.15.1:0/2150794109 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10017d10 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.321+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201a50e0 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.323+0000 7f2a1d7fa640 1 -- 172.21.15.1:0/2150794109 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2a10017070 con 0x7f2a20101240 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.323+0000 7f2a2885d740 1 Processor -- start 2024-09-12T02:30:17.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 -- start start 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d4adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0d57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561df0cb1090 con 0x561df0d4b2f0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561df0c58a70 con 0x561df0d4a9d0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a2885d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561df0cad050 con 0x561df0d55bb0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56982/0 (socket says 172.21.15.1:56982) 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1611054324 learned_addr learned my addr 172.21.15.1:0/1611054324 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a24a21640 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d4adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0d57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1d7fa640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 0x7f2a080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1611054324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 msgr2=0x561df0d57fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0d57fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 0x7f2a080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1611054324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 msgr2=0x561df0d4adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d4adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.324+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1611054324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df0c65130 con 0x561df0d4b2f0 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a1d7fa640 1 -- 172.21.15.1:0/2150794109 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a100ce560 con 0x7f2a20101240 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a100cbf40 tx=0x7f2a10020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df99ef8c6837a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a067fc640 1 -- 172.21.15.1:0/1611054324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1009a890 con 0x561df0d4b2f0 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 0x7f2a080a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a1802ade0 tx=0x7f2a1802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a067fc640 1 -- 172.21.15.1:0/1611054324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a10052ea0 con 0x561df0d4b2f0 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.325+0000 7f2a067fc640 1 -- 172.21.15.1:0/1611054324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100d1dc0 con 0x561df0d4b2f0 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- 172.21.15.1:0/1611054324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 msgr2=0x561df0d55670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a100cbf40 tx=0x7f2a10020000 comp rx=0 tx=0).stop 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- 172.21.15.1:0/1611054324 shutdown_connections 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d55670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0d57fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 --2- 172.21.15.1:0/1611054324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d4adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- 172.21.15.1:0/1611054324 >> 172.21.15.1:0/1611054324 conn(0x561df0d46f60 msgr2=0x561df0d47340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- 172.21.15.1:0/1611054324 shutdown_connections 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- 172.21.15.1:0/1611054324 wait complete. 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 -- start start 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.326+0000 7f2a2885d740 1 Processor -- start 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d55430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d52780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561df0d58780 con 0x561df0d55bb0 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561df0c6bf20 con 0x561df0d4a9d0 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561df0d58900 con 0x561df0d4b2f0 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a2885d740 10 client.0 _ll_register_callbacks cb 0x561df0c35030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:17.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d55430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56984/0 (socket says 172.21.15.1:56984) 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 -- 172.21.15.1:0/2155361118 learned_addr learned my addr 172.21.15.1:0/2155361118 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d52780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 -- 172.21.15.1:0/2155361118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 msgr2=0x561df0d52780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d52780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 -- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 msgr2=0x561df0d55430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d55430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 -- 172.21.15.1:0/2155361118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df0a222b0 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d55430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f2a24a21640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a180316d0 tx=0x7f2a180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ced0506c61678c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.327+0000 7f29ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18044070 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a18004740 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561df0cbe600 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a180319d0 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561df0d64090 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561df0cbe600 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2a180305c0 con 0x561df0d55bb0 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:17.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 10 client.15033 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 20 client.15033 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0d66710 0x561df0d67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 4 client.15033 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.328+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561df0cb8b10 con 0x561df0d66710 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.329+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0d66710 0x561df0d67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.329+0000 7f29ff7fe640 10 client.15033 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.329+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0d66710 0x561df0d67b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24105c84cc133417 server_cookie=696aff39b989e77f in_seq=0 out_seq=0 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f29ff7fe640 1 -- 172.21.15.1:0/2155361118 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561df0cb8b10 con 0x561df0d66710 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f29ff7fe640 10 client.15033 handle_command_reply: tid=0 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 client.15033 shutdown 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 msgr2=0x561df0d52cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a180316d0 tx=0x7f2a180095c0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 shutdown_connections 2024-09-12T02:30:17.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d55bb0 0x561df0d52cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0d66710 0x561df0d67b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d52780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f29ff7fe640 0 client.15033 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 --2- 172.21.15.1:0/2155361118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d55430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 >> 172.21.15.1:0/2155361118 conn(0x561df0d46f60 msgr2=0x561df0d4cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 shutdown_connections 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 1 -- 172.21.15.1:0/2155361118 wait complete. 2024-09-12T02:30:17.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.330+0000 7f2a2885d740 20 client.15033 trim_cache size 0 max 16384 2024-09-12T02:30:17.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.348+0000 7f2a2885d740 1 Processor -- start 2024-09-12T02:30:17.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.348+0000 7f2a2885d740 1 -- start start 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d51050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 0x561df0d51590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561df0d65ec0 con 0x561df0d4a9d0 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561df0d66590 con 0x561df0d55bb0 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a2885d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561df0d66c60 con 0x561df0d4b2f0 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56994/0 (socket says 172.21.15.1:56994) 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/3701831839 learned_addr learned my addr 172.21.15.1:0/3701831839 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:17.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a24a21640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 0x561df0d51590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d51050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/3701831839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 msgr2=0x561df0d51050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d51050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/3701831839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 msgr2=0x561df0d51590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 0x561df0d51590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/3701831839 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df0d46d90 con 0x561df0d4a9d0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d51050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a24a21640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 0x561df0d51590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2a100093d0 tx=0x7f2a10017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289879f0c279fdf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/3701831839 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10052ca0 con 0x561df0d4a9d0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/3701831839 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a1009ad50 con 0x561df0d4a9d0 2024-09-12T02:30:17.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/3701831839 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1009a6b0 con 0x561df0d4a9d0 2024-09-12T02:30:17.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 -- 172.21.15.1:0/3701831839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 msgr2=0x561df0d67b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2a100093d0 tx=0x7f2a10017730 comp rx=0 tx=0).stop 2024-09-12T02:30:17.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 -- 172.21.15.1:0/3701831839 shutdown_connections 2024-09-12T02:30:17.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d55bb0 0x561df0d51590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d4b2f0 0x561df0d51050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 --2- 172.21.15.1:0/3701831839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4a9d0 0x561df0d67b80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 -- 172.21.15.1:0/3701831839 >> 172.21.15.1:0/3701831839 conn(0x561df0d46f60 msgr2=0x561df0d52740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 -- 172.21.15.1:0/3701831839 shutdown_connections 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.350+0000 7f2a2885d740 1 -- 172.21.15.1:0/3701831839 wait complete. 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 -- start start 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 Processor -- start 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d68e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0dcee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561df0d67a00 con 0x561df0d4b2f0 2024-09-12T02:30:17.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561df0d67330 con 0x561df0d4a9d0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561df0d680d0 con 0x561df0d55bb0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a2885d740 10 client.0 _ll_register_callbacks cb 0x7f2a18005f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57010/0 (socket says 172.21.15.1:57010) 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.351+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/790274797 learned_addr learned my addr 172.21.15.1:0/790274797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a24a21640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0dcee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d68e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/790274797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 msgr2=0x561df0dcee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0dcee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 msgr2=0x561df0d68e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d68e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/790274797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df0d69c10 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d68e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x561df0d482e0 tx=0x7f2a14015ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b20c557fca1bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f29ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14016960 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a14016b00 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a1009ad50 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a14016d00 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a2885d740 10 client.15039 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.352+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561df0dd04b0 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a1009ad50 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2a14013540 con 0x561df0d4b2f0 2024-09-12T02:30:17.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 10 client.15039 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 20 client.15039 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0dd5130 0x561df0dd3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 4 client.15039 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "status"}) -- 0x561df0c350e0 con 0x561df0dd5130 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.353+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0dd5130 0x561df0dd3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0dd5130 0x561df0dd3e40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=757cbbf74a3fbccd server_cookie=82ba2e988fabd338 in_seq=0 out_seq=0 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f29ff7fe640 10 client.15039 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f29ff7fe640 1 -- 172.21.15.1:0/790274797 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561df0c350e0 con 0x561df0dd5130 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f29ff7fe640 10 client.15039 handle_command_reply: tid=0 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 client.15039 shutdown 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 msgr2=0x561df0d69380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x561df0d482e0 tx=0x7f2a14015ad0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 shutdown_connections 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561df0d4b2f0 0x561df0d69380 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561df0dd5130 0x561df0dd3e40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561df0d55bb0 0x561df0dcee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f29ff7fe640 0 client.15039 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 --2- 172.21.15.1:0/790274797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561df0d4a9d0 0x561df0d68e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 >> 172.21.15.1:0/790274797 conn(0x561df0d46f60 msgr2=0x561df0d457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 shutdown_connections 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 1 -- 172.21.15.1:0/790274797 wait complete. 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.354+0000 7f2a2885d740 20 client.15039 trim_cache size 0 max 16384 2024-09-12T02:30:17.360 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24494, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 83.881612892999996, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 95.403653059999996 2024-09-12T02:30:17.361 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 msgr2=0x7f2a080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 0x7f2a080a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a1802ade0 tx=0x7f2a1802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 msgr2=0x7f2a20198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b4a0 tx=0x7f2a1000b960 comp rx=0 tx=0).stop 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 shutdown_connections 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c10 0x7f2a080a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a20105a90 0x7f2a2019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20101bc0 0x7f2a20198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 --2- 172.21.15.1:0/2150794109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20101240 0x7f2a20198560 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 >> 172.21.15.1:0/2150794109 conn(0x7f2a20077210 msgr2=0x7f2a200fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 shutdown_connections 2024-09-12T02:30:17.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:17.355+0000 7f2a26484640 1 -- 172.21.15.1:0/2150794109 wait complete. 2024-09-12T02:30:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:17 smithi134 ceph-mon[35091]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:17 smithi173 ceph-mon[35036]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:17.978 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:17 smithi001 ceph-mon[31252]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:18.048 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:30:18.048 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:30:18.058 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:30:18.058 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:30:18.321 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 -- 172.21.15.1:0/1038978121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38101770 msgr2=0x7f3d38101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 --2- 172.21.15.1:0/1038978121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38101770 0x7f3d38101c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009ca0 tx=0x7f3d3002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 -- 172.21.15.1:0/1038978121 shutdown_connections 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 --2- 172.21.15.1:0/1038978121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38101770 0x7f3d38101c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 --2- 172.21.15.1:0/1038978121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38100dd0 0x7f3d38101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 --2- 172.21.15.1:0/1038978121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d38100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.831+0000 7f3d40230640 1 -- 172.21.15.1:0/1038978121 >> 172.21.15.1:0/1038978121 conn(0x7f3d380fc2a0 msgr2=0x7f3d380fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- 172.21.15.1:0/1038978121 shutdown_connections 2024-09-12T02:30:18.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- 172.21.15.1:0/1038978121 wait complete. 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 Processor -- start 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- start start 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d3819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 0x7f3d381a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3810fa60 con 0x7f3d38100dd0 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3810f8e0 con 0x7f3d38100490 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d40230640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3810fbe0 con 0x7f3d38101770 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d3d7cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d3d7cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57024/0 (socket says 172.21.15.1:57024) 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.832+0000 7f3d3d7cb640 1 -- 172.21.15.1:0/774349490 learned_addr learned my addr 172.21.15.1:0/774349490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3dfcc640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d3819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3e7cd640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 0x7f3d381a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 -- 172.21.15.1:0/774349490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 msgr2=0x7f3d381a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 0x7f3d381a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 -- 172.21.15.1:0/774349490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 msgr2=0x7f3d3819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d3819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 -- 172.21.15.1:0/774349490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d381a1c60 con 0x7f3d38100dd0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3dfcc640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d3819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3e7cd640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 0x7f3d381a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d3d7cb640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800d950 tx=0x7f3d2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28017030 con 0x7f3d38100dd0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d28004020 con 0x7f3d38100dd0 2024-09-12T02:30:18.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d381a1f50 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d280047a0 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.833+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d381a2400 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.834+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3810b1e0 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.835+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3d280041d0 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.836+0000 7f3d2effd640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 0x7f3d240a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.836+0000 7f3d3dfcc640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 0x7f3d240a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.836+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3d280cf270 con 0x7f3d38100dd0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.837+0000 7f3d3dfcc640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 0x7f3d240a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400abe0 tx=0x7f3d3400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:18.839+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d2809c050 con 0x7f3d38100dd0 2024-09-12T02:30:19.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.030+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3d38062630 con 0x7f3d240a2c40 2024-09-12T02:30:19.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.031+0000 7f3d2effd640 1 -- 172.21.15.1:0/774349490 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3d38062630 con 0x7f3d240a2c40 2024-09-12T02:30:19.031 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-12T02:30:19.031 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-12T02:30:19.032 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-12T02:30:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 msgr2=0x7f3d240a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:19.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 0x7f3d240a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400abe0 tx=0x7f3d3400a5c0 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 msgr2=0x7f3d3819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800d950 tx=0x7f3d2800de10 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 shutdown_connections 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3d240a2c40 0x7f3d240a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d38100dd0 0x7f3d3819a570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d38101770 0x7f3d381a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 --2- 172.21.15.1:0/774349490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d38100490 0x7f3d3819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 >> 172.21.15.1:0/774349490 conn(0x7f3d380fc2a0 msgr2=0x7f3d380fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 shutdown_connections 2024-09-12T02:30:19.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:19.033+0000 7f3d40230640 1 -- 172.21.15.1:0/774349490 wait complete. 2024-09-12T02:30:19.751 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:19 smithi001 ceph-mon[31252]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:19.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:30:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:19 smithi134 ceph-mon[35091]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:19 smithi173 ceph-mon[35036]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:20.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- 172.21.15.1:0/1409619676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 msgr2=0x7f4f68102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 --2- 172.21.15.1:0/1409619676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68102000 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009900 tx=0x7f4f5802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:20.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- 172.21.15.1:0/1409619676 shutdown_connections 2024-09-12T02:30:20.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 --2- 172.21.15.1:0/1409619676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f681037c0 0x7f4f6810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 --2- 172.21.15.1:0/1409619676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f68102e00 0x7f4f68103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 --2- 172.21.15.1:0/1409619676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68102000 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- 172.21.15.1:0/1409619676 >> 172.21.15.1:0/1409619676 conn(0x7f4f680fd390 msgr2=0x7f4f680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- 172.21.15.1:0/1409619676 shutdown_connections 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- 172.21.15.1:0/1409619676 wait complete. 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 Processor -- start 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.555+0000 7f4f6e559640 1 -- start start 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f68102e00 0x7f4f68198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f681037c0 0x7f4f6819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810d8e0 con 0x7f4f68101c00 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810d760 con 0x7f4f68102e00 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810da60 con 0x7f4f681037c0 2024-09-12T02:30:20.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57052/0 (socket says 172.21.15.1:57052) 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 -- 172.21.15.1:0/4081045981 learned_addr learned my addr 172.21.15.1:0/4081045981 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 -- 172.21.15.1:0/4081045981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f681037c0 msgr2=0x7f4f6819f4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f681037c0 0x7f4f6819f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 -- 172.21.15.1:0/4081045981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f68102e00 msgr2=0x7f4f68198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f68102e00 0x7f4f68198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 -- 172.21.15.1:0/4081045981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6819fb10 con 0x7f4f68101c00 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f67fff640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4f58031610 tx=0x7f4f580043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5803f030 con 0x7f4f68101c00 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f58003ce0 con 0x7f4f68101c00 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6819fda0 con 0x7f4f68101c00 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.556+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58035070 con 0x7f4f68101c00 2024-09-12T02:30:20.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.557+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f681a02f0 con 0x7f4f68101c00 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.558+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f68109000 con 0x7f4f68101c00 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.559+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4f58042030 con 0x7f4f68101c00 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.559+0000 7f4f657fa640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 0x7f4f500a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.560+0000 7f4f677fe640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 0x7f4f500a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.560+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4f580efa70 con 0x7f4f68101c00 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.560+0000 7f4f677fe640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 0x7f4f500a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f68199400 tx=0x7f4f5c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:20.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.563+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f580bc850 con 0x7f4f68101c00 2024-09-12T02:30:20.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:20 smithi001 ceph-mon[31252]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:20.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.747+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4f68062630 con 0x7f4f500a2cc0 2024-09-12T02:30:20.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.760+0000 7f4f657fa640 1 -- 172.21.15.1:0/4081045981 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f4f68062630 con 0x7f4f500a2cc0 2024-09-12T02:30:20.760 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:30:20.760 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (101s) 20s ago 101s 19.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 440478e73963 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi134 running (99s) 31s ago 98s 25.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 d3cd4fb4624a 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi173 running (113s) 31s ago 113s 20.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 acf29e34348b 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 20s ago 2m 14.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 dd78231229e3 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi134 running (118s) 31s ago 118s 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 6c44906707b2 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi173 running (116s) 31s ago 115s 20.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 ee50058b83db 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (105s) 20s ago 105s 17.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 e40d10457295 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi134 running (110s) 31s ago 110s 16.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 63ebdf50224a 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi173 running (108s) 31s ago 107s 18.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 e9c3f60710fc 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 20s ago 2m 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 ec22af53d3db 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi134 running (2m) 31s ago 2m 18.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 978f48ce8b01 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi173 running (2m) 31s ago 2m 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 f8e251458608 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (9m) 20s ago 9m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 b9ec5984e02b 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi134 *:8443,8765 running (7m) 31s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 72a7fb2405b7 2024-09-12T02:30:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi173 *:8443,8765 running (7m) 31s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 9e8706c71b19 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (9m) 20s ago 9m 51.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 13f59d83b3d2 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi134 running (7m) 31s ago 7m 39.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 3a31a3aa4ef4 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi173 running (7m) 31s ago 7m 39.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 41adee92a20f 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 20s ago 7m 59.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 52c2fd2b9e5e 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi134 running (6m) 31s ago 6m 55.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 405baf79f015 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi173 running (6m) 31s ago 6m 57.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 07ef06c689a3 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (5m) 20s ago 5m 55.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 86e4c89b02ba 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi134 running (5m) 31s ago 5m 55.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 920b89fc9830 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi173 running (5m) 31s ago 5m 43.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a6f8a9a303eb 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 20s ago 4m 44.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 c6112d2b4a1d 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi134 running (4m) 31s ago 4m 43.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7627f385679f 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi173 running (3m) 31s ago 3m 42.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 6d7f42d6decf 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 20s ago 3m 51.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 7a4e6fac8870 2024-09-12T02:30:20.762 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi134 running (2m) 31s ago 2m 52.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 399286c9b51b 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi173 running (2m) 31s ago 2m 40.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a324ef0e28d4 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 msgr2=0x7f4f500a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 0x7f4f500a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f68199400 tx=0x7f4f5c005c70 comp rx=0 tx=0).stop 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 msgr2=0x7f4f68197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4f58031610 tx=0x7f4f580043b0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 shutdown_connections 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f4f500a2cc0 0x7f4f500a5180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f681037c0 0x7f4f6819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f68102e00 0x7f4f68198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 --2- 172.21.15.1:0/4081045981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f68101c00 0x7f4f68197ee0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 >> 172.21.15.1:0/4081045981 conn(0x7f4f680fd390 msgr2=0x7f4f681061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 shutdown_connections 2024-09-12T02:30:20.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:20.763+0000 7f4f6e559640 1 -- 172.21.15.1:0/4081045981 wait complete. 2024-09-12T02:30:20.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:20 smithi134 ceph-mon[35091]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:20.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:20 smithi173 ceph-mon[35036]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:21.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:30:21.770 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:21 smithi001 ceph-mon[31252]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:30:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:21 smithi001 ceph-mon[31252]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:21 smithi134 ceph-mon[35091]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:30:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:21 smithi134 ceph-mon[35091]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:21 smithi173 ceph-mon[35036]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:30:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:21 smithi173 ceph-mon[35036]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2900093384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 msgr2=0x7f48d81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2900093384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81073c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009900 tx=0x7f48cc02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2900093384 shutdown_connections 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2900093384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81073c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2900093384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2900093384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2900093384 >> 172.21.15.1:0/2900093384 conn(0x7f48d80fc2a0 msgr2=0x7f48d80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2900093384 shutdown_connections 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2900093384 wait complete. 2024-09-12T02:30:22.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 Processor -- start 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.247+0000 7f48dfeaa640 1 -- start start 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810d880 con 0x7f48d8104fd0 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810d700 con 0x7f48d8107900 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dfeaa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810da00 con 0x7f48d81026a0 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48ddc46640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55808/0 (socket says 172.21.15.1:55808) 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 -- 172.21.15.1:0/2369354933 learned_addr learned my addr 172.21.15.1:0/2369354933 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48ddc46640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:54062/0 (socket says 172.21.15.1:54062) 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48de447640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 -- 172.21.15.1:0/2369354933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 msgr2=0x7f48d8197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 -- 172.21.15.1:0/2369354933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 msgr2=0x7f48d819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 -- 172.21.15.1:0/2369354933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d819fb90 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48de447640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.248+0000 7f48dd445640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f48cc031610 tx=0x7f48cc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.249+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc03f030 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.249+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48cc003ce0 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.249+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d819fe20 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.249+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc035070 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.249+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d81a0280 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.250+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d80fdd90 con 0x7f48d8104fd0 2024-09-12T02:30:22.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.251+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f48cc042030 con 0x7f48d8104fd0 2024-09-12T02:30:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.252+0000 7f48caffd640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 0x7f48c40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.252+0000 7f48ddc46640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 0x7f48c40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.252+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f48cc0ef980 con 0x7f48d8104fd0 2024-09-12T02:30:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.252+0000 7f48ddc46640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 0x7f48c40a5180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48d400bbc0 tx=0x7f48d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:22.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.255+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48cc0bc700 con 0x7f48d8104fd0 2024-09-12T02:30:22.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.441+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f48d8062630 con 0x7f48c40a2cc0 2024-09-12T02:30:22.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.447+0000 7f48caffd640 1 -- 172.21.15.1:0/2369354933 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f48d8062630 con 0x7f48c40a2cc0 2024-09-12T02:30:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:30:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 33s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T02:30:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 33s ago 7m smithi001=x;smithi134=y;smithi173=z;count:3 2024-09-12T02:30:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 33s ago 7m smithi001:172.21.15.1=a;smithi134:172.21.15.134=b;smithi173:172.21.15.173=c;count:3 2024-09-12T02:30:22.448 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 33s ago - 2024-09-12T02:30:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 msgr2=0x7f48c40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 0x7f48c40a5180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48d400bbc0 tx=0x7f48d400b390 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 msgr2=0x7f48d81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f48cc031610 tx=0x7f48cc0043b0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 shutdown_connections 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48c40a2cc0 0x7f48c40a5180 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48d8104fd0 0x7f48d81984a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48d8107900 0x7f48d819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 --2- 172.21.15.1:0/2369354933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d81026a0 0x7f48d8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 >> 172.21.15.1:0/2369354933 conn(0x7f48d80fc2a0 msgr2=0x7f48d8103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 shutdown_connections 2024-09-12T02:30:22.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:22.449+0000 7f48dfeaa640 1 -- 172.21.15.1:0/2369354933 wait complete. 2024-09-12T02:30:23.238 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:30:23.504 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:23 smithi134 ceph-mon[35091]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:23 smithi134 ceph-mon[35091]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:23 smithi173 ceph-mon[35036]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:23 smithi173 ceph-mon[35036]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:23.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:23 smithi001 ceph-mon[31252]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:23.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:23 smithi001 ceph-mon[31252]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:24.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 -- 172.21.15.1:0/2464813198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8101cd0 msgr2=0x7f95a8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 --2- 172.21.15.1:0/2464813198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8101cd0 0x7f95a8102150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9598009900 tx=0x7f959802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 -- 172.21.15.1:0/2464813198 shutdown_connections 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 --2- 172.21.15.1:0/2464813198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8101cd0 0x7f95a8102150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 --2- 172.21.15.1:0/2464813198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 --2- 172.21.15.1:0/2464813198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8100ad0 0x7f95a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 -- 172.21.15.1:0/2464813198 >> 172.21.15.1:0/2464813198 conn(0x7f95a80fc280 msgr2=0x7f95a80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 -- 172.21.15.1:0/2464813198 shutdown_connections 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.046+0000 7f95af6b1640 1 -- 172.21.15.1:0/2464813198 wait complete. 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 Processor -- start 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 -- start start 2024-09-12T02:30:24.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 0x7f95a8197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810c730 con 0x7f95a8100ad0 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810c5b0 con 0x7f95a8102690 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95af6b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f95a810c8b0 con 0x7f95a8101cd0 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55830/0 (socket says 172.21.15.1:55830) 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 -- 172.21.15.1:0/673669250 learned_addr learned my addr 172.21.15.1:0/673669250 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95adc4e640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95acc4c640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 0x7f95a8197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 -- 172.21.15.1:0/673669250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 msgr2=0x7f95a8197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 0x7f95a8197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 -- 172.21.15.1:0/673669250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 msgr2=0x7f95a819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a819e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95ad44d640 1 -- 172.21.15.1:0/673669250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a819e980 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95adc4e640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.047+0000 7f95acc4c640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 0x7f95a8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f95ad44d640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95a400c970 tx=0x7f95a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4007c10 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95a4007db0 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a819ec70 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a400f940 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.048+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a819f1b0 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.049+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a8107ea0 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.050+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f95a400fae0 con 0x7f95a8100ad0 2024-09-12T02:30:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.051+0000 7f959e7fc640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 0x7f95940a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.051+0000 7f95acc4c640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 0x7f95940a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.051+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f95a40cf980 con 0x7f95a8100ad0 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.051+0000 7f95acc4c640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 0x7f95940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9598000c00 tx=0x7f9598031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:24.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.054+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95a409c820 con 0x7f95a8100ad0 2024-09-12T02:30:24.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.235+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f95a8062630 con 0x7f95940a2c40 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.237+0000 7f959e7fc640 1 -- 172.21.15.1:0/673669250 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f95a8062630 con 0x7f95940a2c40 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stdout:smithi134 172.21.15.134 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stdout:smithi173 172.21.15.173 2024-09-12T02:30:24.237 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 msgr2=0x7f95940a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 0x7f95940a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9598000c00 tx=0x7f9598031400 comp rx=0 tx=0).stop 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 msgr2=0x7f95a8196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95a400c970 tx=0x7f95a400ce30 comp rx=0 tx=0).stop 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 shutdown_connections 2024-09-12T02:30:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95940a2c40 0x7f95940a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a8102690 0x7f95a819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95a8101cd0 0x7f95a8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 --2- 172.21.15.1:0/673669250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95a8100ad0 0x7f95a8196d50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 >> 172.21.15.1:0/673669250 conn(0x7f95a80fc280 msgr2=0x7f95a8105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 shutdown_connections 2024-09-12T02:30:24.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:24.239+0000 7f95af6b1640 1 -- 172.21.15.1:0/673669250 wait complete. 2024-09-12T02:30:25.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:30:25.324 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:25.768 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:25 smithi001 ceph-mon[31252]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:25.768 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:25 smithi001 ceph-mon[31252]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:25.768 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:25 smithi001 ceph-mon[31252]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- 172.21.15.1:0/1546158060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b40102e00 msgr2=0x7f7b40103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 --2- 172.21.15.1:0/1546158060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b40102e00 0x7f7b40103280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009900 tx=0x7f7b3402a410 comp rx=0 tx=0).stop 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- 172.21.15.1:0/1546158060 shutdown_connections 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 --2- 172.21.15.1:0/1546158060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b40102e00 0x7f7b40103280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 --2- 172.21.15.1:0/1546158060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b401037c0 0x7f7b4010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 --2- 172.21.15.1:0/1546158060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40101c00 0x7f7b40102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- 172.21.15.1:0/1546158060 >> 172.21.15.1:0/1546158060 conn(0x7f7b400fd390 msgr2=0x7f7b400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- 172.21.15.1:0/1546158060 shutdown_connections 2024-09-12T02:30:25.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- 172.21.15.1:0/1546158060 wait complete. 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 Processor -- start 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.852+0000 7f7b46287640 1 -- start start 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 0x7f7b40197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40102e00 0x7f7b401984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4010d900 con 0x7f7b401037c0 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4010d780 con 0x7f7b40101c00 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b46287640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4010da80 con 0x7f7b40102e00 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55852/0 (socket says 172.21.15.1:55852) 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 -- 172.21.15.1:0/1624931478 learned_addr learned my addr 172.21.15.1:0/1624931478 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b3ffff640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 0x7f7b40197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:25.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 -- 172.21.15.1:0/1624931478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40102e00 msgr2=0x7f7b401984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40102e00 0x7f7b401984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 -- 172.21.15.1:0/1624931478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 msgr2=0x7f7b40197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 0x7f7b40197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 -- 172.21.15.1:0/1624931478 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4019fbb0 con 0x7f7b401037c0 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b3ffff640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 0x7f7b40197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b44824640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800b970 tx=0x7f7b3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.853+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38019070 con 0x7f7b401037c0 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.854+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b3800cb40 con 0x7f7b401037c0 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.854+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4019fea0 con 0x7f7b401037c0 2024-09-12T02:30:25.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.854+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38007650 con 0x7f7b401037c0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.854+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b401a03e0 con 0x7f7b401037c0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.855+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b40109000 con 0x7f7b401037c0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.856+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7b3801c070 con 0x7f7b401037c0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.857+0000 7f7b3d7fa640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 0x7f7b280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.857+0000 7f7b3ffff640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 0x7f7b280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.857+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7b380ce6a0 con 0x7f7b401037c0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.857+0000 7f7b3ffff640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 0x7f7b280a5070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b300058c0 tx=0x7f7b30005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:25.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:25.861+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b3809b5e0 con 0x7f7b401037c0 2024-09-12T02:30:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:25 smithi173 ceph-mon[35036]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:25 smithi173 ceph-mon[35036]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:25 smithi173 ceph-mon[35036]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:30:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.045+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f7b40062630 con 0x7f7b280a2bb0 2024-09-12T02:30:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.047+0000 7f7b3d7fa640 1 -- 172.21.15.1:0/1624931478 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f7b40062630 con 0x7f7b280a2bb0 2024-09-12T02:30:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:30:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:30:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:30:26.047 INFO:teuthology.orchestra.run.smithi001.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T02:30:26.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 msgr2=0x7f7b280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:26.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 0x7f7b280a5070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b300058c0 tx=0x7f7b30005ec0 comp rx=0 tx=0).stop 2024-09-12T02:30:26.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 msgr2=0x7f7b4019f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:26.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800b970 tx=0x7f7b3800be30 comp rx=0 tx=0).stop 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 shutdown_connections 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b280a2bb0 0x7f7b280a5070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b401037c0 0x7f7b4019f540 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b40102e00 0x7f7b401984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 --2- 172.21.15.1:0/1624931478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b40101c00 0x7f7b40197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 >> 172.21.15.1:0/1624931478 conn(0x7f7b400fd390 msgr2=0x7f7b401061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 shutdown_connections 2024-09-12T02:30:26.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:26.049+0000 7f7b46287640 1 -- 172.21.15.1:0/1624931478 wait complete. 2024-09-12T02:30:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:25 smithi134 ceph-mon[35091]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:25 smithi134 ceph-mon[35091]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:25 smithi134 ceph-mon[35091]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T02:30:26.832 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:30:26.840 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:30:26.840 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:30:27.100 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.584+0000 7ff88d9a5640 1 -- 172.21.15.1:0/3224534863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 msgr2=0x7ff888104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.584+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/3224534863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888104a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff878009900 tx=0x7ff87802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 -- 172.21.15.1:0/3224534863 shutdown_connections 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/3224534863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8881078c0 0x7ff888109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/3224534863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff888104f90 0x7ff888107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/3224534863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888104a50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 -- 172.21.15.1:0/3224534863 >> 172.21.15.1:0/3224534863 conn(0x7ff8880fc280 msgr2=0x7ff8880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 -- 172.21.15.1:0/3224534863 shutdown_connections 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 -- 172.21.15.1:0/3224534863 wait complete. 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 Processor -- start 2024-09-12T02:30:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.585+0000 7ff88d9a5640 1 -- start start 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 0x7ff888100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 0x7ff888100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810d8e0 con 0x7ff888102660 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810d760 con 0x7ff8881078c0 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810da60 con 0x7ff888104f90 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55864/0 (socket says 172.21.15.1:55864) 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 -- 172.21.15.1:0/2059290266 learned_addr learned my addr 172.21.15.1:0/2059290266 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff8877fe640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 0x7ff888100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff8867fc640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 0x7ff888100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 -- 172.21.15.1:0/2059290266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 msgr2=0x7ff888100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 0x7ff888100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 -- 172.21.15.1:0/2059290266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 msgr2=0x7ff888100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 0x7ff888100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 -- 172.21.15.1:0/2059290266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff888101410 con 0x7ff888102660 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff8877fe640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 0x7ff888100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff8867fc640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 0x7ff888100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff886ffd640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff878009230 tx=0x7ff878004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87803f030 con 0x7ff888102660 2024-09-12T02:30:27.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff878003ce0 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8881a20a0 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.586+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878035070 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.587+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881a25d0 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.587+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8880fdd70 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.589+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff878042030 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.590+0000 7ff88c9a3640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 0x7ff8700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.590+0000 7ff8867fc640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 0x7ff8700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.590+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff8780efb00 con 0x7ff888102660 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.590+0000 7ff8867fc640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 0x7ff8700a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff888101d40 tx=0x7ff87c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:27.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.594+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8780bca40 con 0x7ff888102660 2024-09-12T02:30:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.806+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff888062df0 con 0x7ff888102660 2024-09-12T02:30:27.807 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:27 smithi001 ceph-mon[31252]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T02:30:27.807 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:27 smithi001 ceph-mon[31252]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:27.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.807+0000 7ff88c9a3640 1 -- 172.21.15.1:0/2059290266 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3120 (secure 0 0 0) 0x7ff8780bc340 con 0x7ff888102660 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:e27 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-12T02:29:05:029462+0000 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-12T02:30:27.808 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 27 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-12T02:28:52.748371+0000 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-12T02:29:05.029439+0000 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-12T02:30:27.809 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 5 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:in 0,1,2,3,4 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24494,1=24475,2=24470,3=24457,4=24451} 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24494 members: 24494,24475,24470,24457,24451 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24494} state up:active seq 4 addr [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.810 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{0:24446} state up:standby-replay seq 1 addr [v2:172.21.15.134:6834/4061904482,v1:172.21.15.134:6835/4061904482] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{1:24475} state up:active seq 9 addr [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{1:24419} state up:standby-replay seq 1 addr [v2:172.21.15.134:6832/1137270315,v1:172.21.15.134:6833/1137270315] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{2:24470} state up:active seq 9 addr [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{2:24415} state up:standby-replay seq 1 addr [v2:172.21.15.173:6832/743947684,v1:172.21.15.173:6833/743947684] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{3:24457} state up:active seq 10 addr [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{3:14604} state up:standby-replay seq 1 addr [v2:172.21.15.1:6840/2292917282,v1:172.21.15.1:6841/2292917282] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{4:24451} state up:active seq 11 addr [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{4:14592} state up:standby-replay seq 1 addr [v2:172.21.15.1:6838/1207631170,v1:172.21.15.1:6839/1207631170] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.1:6834/1949670850,v1:172.21.15.1:6835/1949670850] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.811 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.1:6836/732674726,v1:172.21.15.1:6837/732674726] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:30:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 msgr2=0x7ff8700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 0x7ff8700a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff888101d40 tx=0x7ff87c005e50 comp rx=0 tx=0).stop 2024-09-12T02:30:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 msgr2=0x7ff888101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:27.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff878009230 tx=0x7ff878004360 comp rx=0 tx=0).stop 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 shutdown_connections 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8700a2b80 0x7ff8700a5040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8881078c0 0x7ff888100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff888104f90 0x7ff888100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 --2- 172.21.15.1:0/2059290266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff888102660 0x7ff888101fc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.809+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 >> 172.21.15.1:0/2059290266 conn(0x7ff8880fc280 msgr2=0x7ff888102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.810+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 shutdown_connections 2024-09-12T02:30:27.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:27.810+0000 7ff88d9a5640 1 -- 172.21.15.1:0/2059290266 wait complete. 2024-09-12T02:30:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:27 smithi173 ceph-mon[35036]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T02:30:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:27 smithi173 ceph-mon[35036]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:27 smithi134 ceph-mon[35091]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T02:30:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:27 smithi134 ceph-mon[35091]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:28.494 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:30:28.755 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:28.765 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2059290266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:30:28.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2059290266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:30:29.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2059290266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:30:29.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 -- 172.21.15.1:0/2292958854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 msgr2=0x7f01e4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:29.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2292958854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4109d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009ca0 tx=0x7f01dc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 -- 172.21.15.1:0/2292958854 shutdown_connections 2024-09-12T02:30:29.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2292958854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4109d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2292958854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4104f90 0x7f01e4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2292958854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4102660 0x7f01e4104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 -- 172.21.15.1:0/2292958854 >> 172.21.15.1:0/2292958854 conn(0x7f01e40fc280 msgr2=0x7f01e40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 -- 172.21.15.1:0/2292958854 shutdown_connections 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.245+0000 7f01ec79a640 1 -- 172.21.15.1:0/2292958854 wait complete. 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 Processor -- start 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 -- start start 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4102660 0x7f01e4101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 0x7f01e4100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01e410d880 con 0x7f01e41078c0 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01e410d700 con 0x7f01e4102660 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ec79a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01e410da00 con 0x7f01e4104f90 2024-09-12T02:30:29.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ead37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ead37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55894/0 (socket says 172.21.15.1:55894) 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ead37640 1 -- 172.21.15.1:0/2888291657 learned_addr learned my addr 172.21.15.1:0/2888291657 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01ea536640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4102660 0x7f01e4101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.246+0000 7f01e9d35640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 0x7f01e4100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 -- 172.21.15.1:0/2888291657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 msgr2=0x7f01e4100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 0x7f01e4100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 -- 172.21.15.1:0/2888291657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4102660 msgr2=0x7f01e4101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4102660 0x7f01e4101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 -- 172.21.15.1:0/2888291657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e4101410 con 0x7f01e41078c0 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01e9d35640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 0x7f01e4100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ead37640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005e30 tx=0x7f01dc031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:29.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc003c30 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01dc003dd0 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e41a1f70 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc02fde0 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.247+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41a2420 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.248+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e40fdd70 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.249+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f01dc004050 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.250+0000 7f01db7fe640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.250+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f01dc0f06b0 con 0x7f01e41078c0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.250+0000 7f01ea536640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.250+0000 7f01ea536640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 0x7f01d00a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005fd0 tx=0x7f01e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:29.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.253+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01dc0bd5f0 con 0x7f01e41078c0 2024-09-12T02:30:29.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.434+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f01e402d7c0 con 0x7f01e41078c0 2024-09-12T02:30:29.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.435+0000 7f01db7fe640 1 -- 172.21.15.1:0/2888291657 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5304 (secure 0 0 0) 0x7f01dc0bcef0 con 0x7f01e41078c0 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 82 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-12T02:21:05.451779+0000 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-12T02:29:55.578131+0000 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-12T02:30:29.436 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/2377919946,v1:172.21.15.1:6803/2377919946] [v2:172.21.15.1:6804/2377919946,v1:172.21.15.1:6805/2377919946] exists,up f91edd80-c796-47b3-a871-e6ebadc51a2a 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3734137838,v1:172.21.15.134:6801/3734137838] [v2:172.21.15.134:6802/3734137838,v1:172.21.15.134:6803/3734137838] exists,up 32978f3c-0f78-4c37-97a5-9dbb4297a1fb 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/396057210,v1:172.21.15.173:6801/396057210] [v2:172.21.15.173:6802/396057210,v1:172.21.15.173:6803/396057210] exists,up 47693d9e-18db-46ef-9f0d-a712049351bc 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 24 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/203292465,v1:172.21.15.1:6811/203292465] [v2:172.21.15.1:6812/203292465,v1:172.21.15.1:6813/203292465] exists,up 8878132e-22e5-4e0c-ab90-ea0d92368b07 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2124784542,v1:172.21.15.134:6809/2124784542] [v2:172.21.15.134:6810/2124784542,v1:172.21.15.134:6811/2124784542] exists,up 5480c4ef-a2ee-44d0-8030-755ba1d6ffb1 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 36 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/2198908508,v1:172.21.15.173:6809/2198908508] [v2:172.21.15.173:6810/2198908508,v1:172.21.15.173:6811/2198908508] exists,up 3d4ea8b6-b7b6-4658-8f9a-270ee7a34436 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/2324171883,v1:172.21.15.1:6819/2324171883] [v2:172.21.15.1:6820/2324171883,v1:172.21.15.1:6821/2324171883] exists,up 3c293b2c-d037-45c2-968d-37a64f6a85cf 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 48 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/1939894500,v1:172.21.15.134:6817/1939894500] [v2:172.21.15.134:6818/1939894500,v1:172.21.15.134:6819/1939894500] exists,up 92cb0e9b-e3fc-4825-8aa8-68673d91e7e9 2024-09-12T02:30:29.437 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 55 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/4264302819,v1:172.21.15.173:6817/4264302819] [v2:172.21.15.173:6818/4264302819,v1:172.21.15.173:6819/4264302819] exists,up 08fe1c54-4fe9-48b4-b42f-4adb8e930d23 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/1141465152,v1:172.21.15.1:6827/1141465152] [v2:172.21.15.1:6828/1141465152,v1:172.21.15.1:6829/1141465152] exists,up 6d65f975-c4d8-4fcd-bfbd-d4ecaa380371 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/1157717766,v1:172.21.15.134:6825/1157717766] [v2:172.21.15.134:6826/1157717766,v1:172.21.15.134:6827/1157717766] exists,up 19f01a8b-155b-4108-9167-20ebbc3d0e97 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/948409302,v1:172.21.15.173:6825/948409302] [v2:172.21.15.173:6826/948409302,v1:172.21.15.173:6827/948409302] exists,up f4ce2444-9e0f-4787-acb8-0594c4671e86 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.0 [8,4] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.6 [8,11] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.b [2,1] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.10 [2,4] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1f [7,11] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1 [4,9] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.2 [3,9] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.e [5,9] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.17 [4,6] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.27 [4,8] 2024-09-12T02:30:29.438 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/556592053 expires 2024-09-13T02:21:53.871193+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3443797048 expires 2024-09-13T02:21:53.871193+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/556592053 expires 2024-09-13T02:21:53.871193+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2237441020 expires 2024-09-13T02:21:29.692093+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/3479905526 expires 2024-09-13T02:21:29.692093+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3977745193 expires 2024-09-13T02:21:53.871193+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/3479905526 expires 2024-09-13T02:21:29.692093+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/434649045 expires 2024-09-13T02:21:29.692093+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3314773164 expires 2024-09-13T02:21:53.871193+0000 2024-09-12T02:30:29.439 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/331955324 expires 2024-09-13T02:21:29.692093+0000 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 msgr2=0x7f01d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 0x7f01d00a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005fd0 tx=0x7f01e0005850 comp rx=0 tx=0).stop 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 msgr2=0x7f01e4100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005e30 tx=0x7f01dc031ee0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 shutdown_connections 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01e41078c0 0x7f01e4100b50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01e4104f90 0x7f01e4100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 --2- 172.21.15.1:0/2888291657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01e4102660 0x7f01e4101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 >> 172.21.15.1:0/2888291657 conn(0x7f01e40fc280 msgr2=0x7f01e4102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 shutdown_connections 2024-09-12T02:30:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:29.437+0000 7f01ec79a640 1 -- 172.21.15.1:0/2888291657 wait complete. 2024-09-12T02:30:29.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:29 smithi173 ceph-mon[35036]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:29.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:29 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2888291657' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:30:30.067 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:29 smithi001 ceph-mon[31252]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:30.067 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:29 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2888291657' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:30:30.098 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:30:30.110 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:30.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:29 smithi134 ceph-mon[35091]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:30.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:29 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2888291657' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:30:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:30.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- 172.21.15.1:0/2595579640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828102790 msgr2=0x7fe8281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:30.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 --2- 172.21.15.1:0/2595579640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828102790 0x7fe8281067e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe81802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:30.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- 172.21.15.1:0/2595579640 shutdown_connections 2024-09-12T02:30:30.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 --2- 172.21.15.1:0/2595579640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828102790 0x7fe8281067e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 --2- 172.21.15.1:0/2595579640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe828106f10 0x7fe82810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 --2- 172.21.15.1:0/2595579640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe8281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- 172.21.15.1:0/2595579640 >> 172.21.15.1:0/2595579640 conn(0x7fe8280fd8c0 msgr2=0x7fe8280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- 172.21.15.1:0/2595579640 shutdown_connections 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- 172.21.15.1:0/2595579640 wait complete. 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 Processor -- start 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.879+0000 7fe830444640 1 -- start start 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe82819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe828102790 0x7fe82819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe828075990 con 0x7fe828106f10 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe828075810 con 0x7fe828101de0 2024-09-12T02:30:30.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe830444640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe828075b10 con 0x7fe828102790 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55906/0 (socket says 172.21.15.1:55906) 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 -- 172.21.15.1:0/1784534262 learned_addr learned my addr 172.21.15.1:0/1784534262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 -- 172.21.15.1:0/1784534262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe828102790 msgr2=0x7fe82819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe828102790 0x7fe82819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 -- 172.21.15.1:0/1784534262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 msgr2=0x7fe82819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e1e0640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe82819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe82819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 -- 172.21.15.1:0/1784534262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82819f5a0 con 0x7fe828106f10 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e1e0640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe82819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.880+0000 7fe82e9e1640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe82000eaa0 tx=0x7fe82000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.881+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82000cdb0 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.881+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82819f890 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.881+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe820005020 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.881+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200116d0 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.881+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8281a7170 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.882+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8281021c0 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.883+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe8200054d0 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.884+0000 7fe81f7fe640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 0x7fe8140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.884+0000 7fe82e1e0640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 0x7fe8140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.884+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe8200cf2c0 con 0x7fe828106f10 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.884+0000 7fe82e1e0640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 0x7fe8140a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe824005d00 tx=0x7fe824009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:30.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:30.888+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe820016030 con 0x7fe828106f10 2024-09-12T02:30:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.101+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8281a7510 con 0x7fe828106f10 2024-09-12T02:30:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.101+0000 7fe81f7fe640 1 -- 172.21.15.1:0/1784534262 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7fe82009c200 con 0x7fe828106f10 2024-09-12T02:30:31.102 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:31.102 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:30:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 msgr2=0x7fe8140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 0x7fe8140a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe824005d00 tx=0x7fe824009550 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 msgr2=0x7fe82819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe82000eaa0 tx=0x7fe82000ef60 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 shutdown_connections 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8140a2b80 0x7fe8140a5040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828106f10 0x7fe82819eec0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe828102790 0x7fe82819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 --2- 172.21.15.1:0/1784534262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe828101de0 0x7fe82819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 >> 172.21.15.1:0/1784534262 conn(0x7fe8280fd8c0 msgr2=0x7fe8280fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.103+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 shutdown_connections 2024-09-12T02:30:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:31.104+0000 7fe830444640 1 -- 172.21.15.1:0/1784534262 wait complete. 2024-09-12T02:30:31.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:32.046 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:31 smithi001 ceph-mon[31252]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:30:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:31 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1784534262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:31 smithi134 ceph-mon[35091]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:30:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:31 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1784534262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:31 smithi173 ceph-mon[35036]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T02:30:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:31 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1784534262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:32.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 -- 172.21.15.1:0/4006992274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0101dd0 msgr2=0x7fe7c01021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4006992274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01021b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009900 tx=0x7fe7bc02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:32.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 -- 172.21.15.1:0/4006992274 shutdown_connections 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4006992274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0106f00 0x7fe7c010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4006992274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0102780 0x7fe7c01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4006992274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01021b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 -- 172.21.15.1:0/4006992274 >> 172.21.15.1:0/4006992274 conn(0x7fe7c00fd8b0 msgr2=0x7fe7c00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 -- 172.21.15.1:0/4006992274 shutdown_connections 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 -- 172.21.15.1:0/4006992274 wait complete. 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.557+0000 7fe7c8311640 1 Processor -- start 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 -- start start 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 0x7fe7c019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0111f80 con 0x7fe7c0102780 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0111e00 con 0x7fe7c0101dd0 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c8311640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0112100 con 0x7fe7c0106f00 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48200/0 (socket says 172.21.15.1:48200) 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 -- 172.21.15.1:0/4165133887 learned_addr learned my addr 172.21.15.1:0/4165133887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c60ad640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c68ae640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 0x7fe7c019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 -- 172.21.15.1:0/4165133887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 msgr2=0x7fe7c019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 0x7fe7c019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 -- 172.21.15.1:0/4165133887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0101dd0 msgr2=0x7fe7c01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 -- 172.21.15.1:0/4165133887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c019d460 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c68ae640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 0x7fe7c019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.558+0000 7fe7c58ac640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b4a0 tx=0x7fe7b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.559+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0014070 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.559+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7b0010af0 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.559+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c019d750 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.559+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0017d10 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.559+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01a5030 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.560+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c01021b0 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.561+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe7b0017070 con 0x7fe7c0102780 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.562+0000 7fe7b77fe640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 0x7fe7ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.562+0000 7fe7c60ad640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 0x7fe7ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.562+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe7b00ce430 con 0x7fe7c0102780 2024-09-12T02:30:32.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.562+0000 7fe7c60ad640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 0x7fe7ac0a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009230 tx=0x7fe7bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.566+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7b009b370 con 0x7fe7c0102780 2024-09-12T02:30:32.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.780+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c002d7c0 con 0x7fe7c0102780 2024-09-12T02:30:32.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.781+0000 7fe7b77fe640 1 -- 172.21.15.1:0/4165133887 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11961 (secure 0 0 0) 0x7fe7b009ac70 con 0x7fe7c0102780 2024-09-12T02:30:32.781 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:32.782 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":27,"btime":"2024-09-12T02:29:05:029462+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:29:05.029439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24470,24457,24451]},"id":1}]} 2024-09-12T02:30:32.782 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 27 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 msgr2=0x7fe7ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 0x7fe7ac0a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009230 tx=0x7fe7bc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 msgr2=0x7fe7c01989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b4a0 tx=0x7fe7b000b960 comp rx=0 tx=0).stop 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 shutdown_connections 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7ac0a2b80 0x7fe7ac0a5040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7c0102780 0x7fe7c01989f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7c0106f00 0x7fe7c019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 --2- 172.21.15.1:0/4165133887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0101dd0 0x7fe7c01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 >> 172.21.15.1:0/4165133887 conn(0x7fe7c00fd8b0 msgr2=0x7fe7c00fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 shutdown_connections 2024-09-12T02:30:32.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:32.784+0000 7fe7c8311640 1 -- 172.21.15.1:0/4165133887 wait complete. 2024-09-12T02:30:33.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:30:33.847 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:33 smithi001 ceph-mon[31252]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:33 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4165133887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:33 smithi134 ceph-mon[35091]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:33 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/4165133887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:33 smithi173 ceph-mon[35036]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:33 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/4165133887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 -- 172.21.15.1:0/2522141080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820106f10 msgr2=0x7fb82010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 --2- 172.21.15.1:0/2522141080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820106f10 0x7fb82010ea90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb818009ca0 tx=0x7fb81802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 -- 172.21.15.1:0/2522141080 shutdown_connections 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 --2- 172.21.15.1:0/2522141080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820106f10 0x7fb82010ea90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 --2- 172.21.15.1:0/2522141080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820102790 0x7fb8201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 --2- 172.21.15.1:0/2522141080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820101de0 0x7fb8201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 -- 172.21.15.1:0/2522141080 >> 172.21.15.1:0/2522141080 conn(0x7fb8200fd8c0 msgr2=0x7fb8200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 -- 172.21.15.1:0/2522141080 shutdown_connections 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.363+0000 7fb8267c0640 1 -- 172.21.15.1:0/2522141080 wait complete. 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 Processor -- start 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 -- start start 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820101de0 0x7fb8200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820106f10 0x7fb820074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb820111f90 con 0x7fb820102790 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb820111e10 con 0x7fb820106f10 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb8267c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb820112110 con 0x7fb820101de0 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb81f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb81f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48212/0 (socket says 172.21.15.1:48212) 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.364+0000 7fb81f7fe640 1 -- 172.21.15.1:0/135442934 learned_addr learned my addr 172.21.15.1:0/135442934 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:34.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81ffff640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820101de0 0x7fb8200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb824d5d640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820106f10 0x7fb820074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 -- 172.21.15.1:0/135442934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820101de0 msgr2=0x7fb8200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820101de0 0x7fb8200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 -- 172.21.15.1:0/135442934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820106f10 msgr2=0x7fb820074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820106f10 0x7fb820074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 -- 172.21.15.1:0/135442934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8201a6930 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81f7fe640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b4a0 tx=0x7fb81400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814014070 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb814010af0 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8201a6c20 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814017d10 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.365+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8201a7160 con 0x7fb820102790 2024-09-12T02:30:34.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.366+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8201021c0 con 0x7fb820102790 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.367+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb814017070 con 0x7fb820102790 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.368+0000 7fb81d7fa640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 0x7fb8080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.368+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb8140ce320 con 0x7fb820102790 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.368+0000 7fb81ffff640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 0x7fb8080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.369+0000 7fb81ffff640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 0x7fb8080a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb81000bbe0 tx=0x7fb81000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:34.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.372+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb81409ac10 con 0x7fb820102790 2024-09-12T02:30:34.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.548+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb82010a0f0 con 0x7fb820102790 2024-09-12T02:30:34.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.551+0000 7fb81d7fa640 1 -- 172.21.15.1:0/135442934 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7fb81409ef10 con 0x7fb820102790 2024-09-12T02:30:34.551 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:34.551 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:30:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 msgr2=0x7fb8080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 0x7fb8080a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb81000bbe0 tx=0x7fb81000b390 comp rx=0 tx=0).stop 2024-09-12T02:30:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 msgr2=0x7fb820074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b4a0 tx=0x7fb81400b960 comp rx=0 tx=0).stop 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 shutdown_connections 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb8080a2b80 0x7fb8080a5040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb820102790 0x7fb820074a30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb820106f10 0x7fb820074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 --2- 172.21.15.1:0/135442934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb820101de0 0x7fb8200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 >> 172.21.15.1:0/135442934 conn(0x7fb8200fd8c0 msgr2=0x7fb8200fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 shutdown_connections 2024-09-12T02:30:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:34.553+0000 7fb8267c0640 1 -- 172.21.15.1:0/135442934 wait complete. 2024-09-12T02:30:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:34 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/135442934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:35.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:34 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/135442934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:35.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:34 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/135442934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:35.423 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:28:52.748371+0000', 'modified': '2024-09-12T02:29:05.029439+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24494, 'mds_1': 24475, 'mds_2': 24470, 'mds_3': 24457, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6839/1207631170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 1207631170}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 1207631170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6841/2292917282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6840', 'nonce': 2292917282}, {'type': 'v1', 'addr': '172.21.15.1:6841', 'nonce': 2292917282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24415': {'gid': 24415, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/743947684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 743947684}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 743947684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/1137270315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1137270315}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 1137270315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/4061904482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 4061904482}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4061904482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.173:6835/7391882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 7391882}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 7391882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/2489188498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 2489188498}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 2489188498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.134:6837/2931886461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2931886461}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2931886461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/3274926052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 3274926052}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 3274926052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6839/3689768435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 3689768435}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 3689768435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24494, 24475, 24470, 24457, 24451]} 2024-09-12T02:30:35.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:30:35.424 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T02:30:35.688 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:35.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:35 smithi001 ceph-mon[31252]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:36.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:35 smithi134 ceph-mon[35091]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 -- 172.21.15.1:0/2757022726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 msgr2=0x7f0cec10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/2757022726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec10d910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009900 tx=0x7f0ce402a410 comp rx=0 tx=0).stop 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 -- 172.21.15.1:0/2757022726 shutdown_connections 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/2757022726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec10d910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/2757022726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/2757022726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 -- 172.21.15.1:0/2757022726 >> 172.21.15.1:0/2757022726 conn(0x7f0cec077210 msgr2=0x7f0cec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 -- 172.21.15.1:0/2757022726 shutdown_connections 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 -- 172.21.15.1:0/2757022726 wait complete. 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.159+0000 7f0cf1a18640 1 Processor -- start 2024-09-12T02:30:36.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 -- start start 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec111030 con 0x7f0cec101bc0 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec110eb0 con 0x7f0cec101240 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cf1a18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec1111b0 con 0x7f0cec105a90 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48242/0 (socket says 172.21.15.1:48242) 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 -- 172.21.15.1:0/1232112862 learned_addr learned my addr 172.21.15.1:0/1232112862 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 -- 172.21.15.1:0/1232112862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 msgr2=0x7f0cec0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 -- 172.21.15.1:0/1232112862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 msgr2=0x7f0cec0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 -- 172.21.15.1:0/1232112862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec1a6a00 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.160+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b4a0 tx=0x7f0ce000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.161+0000 7f0cf0a16640 1 -- 172.21.15.1:0/1232112862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0014070 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.161+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec1a6cf0 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.161+0000 7f0cf0a16640 1 -- 172.21.15.1:0/1232112862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ce0010af0 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.161+0000 7f0cf0a16640 1 -- 172.21.15.1:0/1232112862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0017d10 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.161+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1a71d0 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.163+0000 7f0cf0a16640 1 -- 172.21.15.1:0/1232112862 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0ce0017070 con 0x7f0cec101bc0 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 Processor -- start 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 -- start start 2024-09-12T02:30:36.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c8a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c8cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9be6090 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9b8da70 con 0x55c6a9c8abb0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9be2050 con 0x55c6a9c802f0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf0a16640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 0x7f0cd40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0ceb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cea7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c8cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0ceb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48250/0 (socket says 172.21.15.1:48250) 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/4175128337 learned_addr learned my addr 172.21.15.1:0/4175128337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c8a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 0x7f0cd40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.164+0000 7f0cf0a16640 1 -- 172.21.15.1:0/1232112862 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0ce00ce480 con 0x7f0cec101bc0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/4175128337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 msgr2=0x55c6a9c8a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c8a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/4175128337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 msgr2=0x55c6a9c8cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c8cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/4175128337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a9b9a130 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c8cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4033000 tx=0x7f0ce4003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0da9bb2dd176f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 0x7f0cd40a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4003b70 tx=0x7f0ce4041000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0cd1ffb640 1 -- 172.21.15.1:0/4175128337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4035050 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0cd1ffb640 1 -- 172.21.15.1:0/4175128337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ce404e070 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.165+0000 7f0cd1ffb640 1 -- 172.21.15.1:0/4175128337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce403e6c0 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- 172.21.15.1:0/4175128337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 msgr2=0x55c6a9c7fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4033000 tx=0x7f0ce4003b00 comp rx=0 tx=0).stop 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- 172.21.15.1:0/4175128337 shutdown_connections 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c8cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c8a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/4175128337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c7fdb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- 172.21.15.1:0/4175128337 >> 172.21.15.1:0/4175128337 conn(0x55c6a9c7bf60 msgr2=0x55c6a9c7c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- 172.21.15.1:0/4175128337 shutdown_connections 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- 172.21.15.1:0/4175128337 wait complete. 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.166+0000 7f0cf3df1740 1 -- start start 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 Processor -- start 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c87d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c8d780 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9ba0f20 con 0x55c6a9c8abb0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c8d900 con 0x55c6a9c802f0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cf3df1740 10 client.0 _ll_register_callbacks cb 0x55c6a9b6a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48256/0 (socket says 172.21.15.1:48256) 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 -- 172.21.15.1:0/3331922699 learned_addr learned my addr 172.21.15.1:0/3331922699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c87d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 -- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 msgr2=0x55c6a9c877d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c877d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 -- 172.21.15.1:0/3331922699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 msgr2=0x55c6a9c87d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c87d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 -- 172.21.15.1:0/3331922699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a99572b0 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00ce20 tx=0x7f0cdc007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74f69fda0352b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.167+0000 7f0ccaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc01c060 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0cdc017420 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ce404e070 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc017620 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 10 client.15111 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6a9c99130 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ce404e070 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0cdc00a400 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 10 client.15111 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 20 client.15111 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:36.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9c9b770 0x55c6a9c9cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 4 client.15111 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.168+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a9bf3600 con 0x55c6a9c9b770 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.169+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9c9b770 0x55c6a9c9cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.169+0000 7f0ccaffd640 10 client.15111 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.169+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9c9b770 0x55c6a9c9cbe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f34bcec31ebb5910 server_cookie=7b064c7fc8f96370 in_seq=0 out_seq=0 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3331922699 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6a9bf3600 con 0x55c6a9c9b770 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0ccaffd640 10 client.15111 handle_command_reply: tid=0 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 client.15111 shutdown 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 msgr2=0x55c6a9c8a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00ce20 tx=0x7f0cdc007680 comp rx=0 tx=0).stop 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 shutdown_connections 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9c9b770 0x55c6a9c9cbe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9c87d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9c877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3331922699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c8a480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 >> 172.21.15.1:0/3331922699 conn(0x55c6a9c7bf60 msgr2=0x55c6a9c81c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0ccaffd640 0 client.15111 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 shutdown_connections 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.170+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3331922699 wait complete. 2024-09-12T02:30:36.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.171+0000 7f0cf3df1740 20 client.15111 trim_cache size 0 max 16384 2024-09-12T02:30:36.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.188+0000 7f0cf3df1740 1 Processor -- start 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.188+0000 7f0cf3df1740 1 -- start start 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.188+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.188+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9af20 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9b5f0 con 0x55c6a9c8abb0 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9bcc0 con 0x55c6a9c802f0 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48266/0 (socket says 172.21.15.1:48266) 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 -- 172.21.15.1:0/2662930724 learned_addr learned my addr 172.21.15.1:0/2662930724 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 -- 172.21.15.1:0/2662930724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 msgr2=0x55c6a9ca4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 -- 172.21.15.1:0/2662930724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 msgr2=0x55c6a9ca5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 -- 172.21.15.1:0/2662930724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a9c8d890 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009740 tx=0x7f0cdc0175b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea182c9009ce53e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cd17fa640 1 -- 172.21.15.1:0/2662930724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc02f070 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cd17fa640 1 -- 172.21.15.1:0/2662930724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc00c0d0 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.189+0000 7f0cd17fa640 1 -- 172.21.15.1:0/2662930724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00aa60 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- 172.21.15.1:0/2662930724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 msgr2=0x55c6a9c9be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009740 tx=0x7f0cdc0175b0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- 172.21.15.1:0/2662930724 shutdown_connections 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/2662930724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9c9be40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- 172.21.15.1:0/2662930724 >> 172.21.15.1:0/2662930724 conn(0x55c6a9c7bf60 msgr2=0x55c6a9c860a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- 172.21.15.1:0/2662930724 shutdown_connections 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- 172.21.15.1:0/2662930724 wait complete. 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.190+0000 7f0cf3df1740 1 -- start start 2024-09-12T02:30:36.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 Processor -- start 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9ca5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9ca60 con 0x55c6a9c802f0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9c390 con 0x55c6a9c7f9d0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9c9d130 con 0x55c6a9c8abb0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cf3df1740 10 client.0 _ll_register_callbacks cb 0x7f0cdc009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48268/0 (socket says 172.21.15.1:48268) 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 -- 172.21.15.1:0/3058568920 learned_addr learned my addr 172.21.15.1:0/3058568920 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9ca5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0ceb7fe640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 -- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c8abb0 msgr2=0x55c6a9ca03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 -- 172.21.15.1:0/3058568920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c7f9d0 msgr2=0x55c6a9ca5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9ca5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.191+0000 7f0cea7fc640 1 -- 172.21.15.1:0/3058568920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a9ca0bf0 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cea7fc640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009420 tx=0x7f0ce0013310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8900fef89cc53568 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce009f070 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0ce0098fc0 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cdc00c0d0 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ce00a3930 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 10 client.15117 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c6a9d05970 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc00c0d0 con 0x55c6a9c802f0 2024-09-12T02:30:36.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0ce0063030 con 0x55c6a9c802f0 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 10 client.15117 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 20 client.15117 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9d0a510 0x55c6a9d09220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 4 client.15117 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.192+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "status"}) -- 0x55c6a9bedb10 con 0x55c6a9d0a510 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9d0a510 0x55c6a9d09220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0ceaffd640 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9d0a510 0x55c6a9d09220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=919cf6c969aad3a7 server_cookie=c1fd4b1d30aae4db in_seq=0 out_seq=0 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0ccaffd640 10 client.15117 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0ccaffd640 1 -- 172.21.15.1:0/3058568920 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c6a9bedb10 con 0x55c6a9d0a510 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0ccaffd640 10 client.15117 handle_command_reply: tid=0 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.193+0000 7f0cf3df1740 1 client.15117 shutdown 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 msgr2=0x55c6a9ca5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009420 tx=0x7f0ce0013310 comp rx=0 tx=0).stop 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 shutdown_connections 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55c6a9d0a510 0x55c6a9d09220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c6a9c802f0 0x55c6a9ca5540 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c6a9c8abb0 0x55c6a9ca03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 --2- 172.21.15.1:0/3058568920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6a9c7f9d0 0x55c6a9ca5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 >> 172.21.15.1:0/3058568920 conn(0x55c6a9c7bf60 msgr2=0x55c6a9c7a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0ccaffd640 0 client.15117 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 shutdown_connections 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 1 -- 172.21.15.1:0/3058568920 wait complete. 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf3df1740 20 client.15117 trim_cache size 0 max 16384 2024-09-12T02:30:36.199 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 4, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24451, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 92.170084274000004, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 131.27512275199999 2024-09-12T02:30:36.200 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 msgr2=0x7f0cd40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 0x7f0cd40a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4003b70 tx=0x7f0ce4041000 comp rx=0 tx=0).stop 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 msgr2=0x7f0cec0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000b4a0 tx=0x7f0ce000b960 comp rx=0 tx=0).stop 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 shutdown_connections 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0cd40a2b80 0x7f0cd40a5040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec101bc0 0x7f0cec0fcbd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cec105a90 0x7f0cec0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 --2- 172.21.15.1:0/1232112862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cec101240 0x7f0cec0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.194+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 >> 172.21.15.1:0/1232112862 conn(0x7f0cec077210 msgr2=0x7f0cec1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.195+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 shutdown_connections 2024-09-12T02:30:36.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:36.195+0000 7f0cf1a18640 1 -- 172.21.15.1:0/1232112862 wait complete. 2024-09-12T02:30:36.202 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:35 smithi173 ceph-mon[35036]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:30:36.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:30:37.169 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 -- 172.21.15.1:0/536938521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 msgr2=0x7f3f54106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 --2- 172.21.15.1:0/536938521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f54106e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009930 tx=0x7f3f4402a420 comp rx=0 tx=0).stop 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 -- 172.21.15.1:0/536938521 shutdown_connections 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 --2- 172.21.15.1:0/536938521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54101420 0x7f3f5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 --2- 172.21.15.1:0/536938521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54100a80 0x7f3f54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 --2- 172.21.15.1:0/536938521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f54106e60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 -- 172.21.15.1:0/536938521 >> 172.21.15.1:0/536938521 conn(0x7f3f540fc7a0 msgr2=0x7f3f540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 -- 172.21.15.1:0/536938521 shutdown_connections 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 -- 172.21.15.1:0/536938521 wait complete. 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.676+0000 7f3f592a3640 1 Processor -- start 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 -- start start 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 0x7f3f54198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 0x7f3f54198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54112020 con 0x7f3f54106a80 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54111ea0 con 0x7f3f54100a80 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f592a3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f541121a0 con 0x7f3f54101420 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48294/0 (socket says 172.21.15.1:48294) 2024-09-12T02:30:37.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 -- 172.21.15.1:0/3040827660 learned_addr learned my addr 172.21.15.1:0/3040827660 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 0x7f3f54198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f527fc640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 0x7f3f54198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 -- 172.21.15.1:0/3040827660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 msgr2=0x7f3f54198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 0x7f3f54198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 -- 172.21.15.1:0/3040827660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 msgr2=0x7f3f54198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 0x7f3f54198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f537fe640 1 -- 172.21.15.1:0/3040827660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5419d5d0 con 0x7f3f54106a80 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f527fc640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 0x7f3f54198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.677+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 0x7f3f54198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f537fe640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b970 tx=0x7f3f4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f3bfff640 1 -- 172.21.15.1:0/3040827660 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c019070 con 0x7f3f54106a80 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5419d8c0 con 0x7f3f54106a80 2024-09-12T02:30:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f3bfff640 1 -- 172.21.15.1:0/3040827660 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f4c00cb40 con 0x7f3f54106a80 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f3bfff640 1 -- 172.21.15.1:0/3040827660 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c007650 con 0x7f3f54106a80 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.678+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f541a51a0 con 0x7f3f54106a80 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.680+0000 7f3f3bfff640 1 -- 172.21.15.1:0/3040827660 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3f4c01c070 con 0x7f3f54106a80 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.680+0000 7f3f5b67c740 1 Processor -- start 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.680+0000 7f3f5b67c740 1 -- start start 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ca22b31090 con 0x55ca22bca9d0 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca22ad8a70 con 0x55ca22bcb2f0 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ca22b2d050 con 0x55ca22bd5bb0 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f3bfff640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 0x7f3f3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48304/0 (socket says 172.21.15.1:48304) 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 -- 172.21.15.1:0/1711579959 learned_addr learned my addr 172.21.15.1:0/1711579959 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f537fe640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 0x7f3f3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f3bfff640 1 -- 172.21.15.1:0/3040827660 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3f4c0ce780 con 0x7f3f54106a80 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 -- 172.21.15.1:0/1711579959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 msgr2=0x55ca22bd7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 -- 172.21.15.1:0/1711579959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 msgr2=0x55ca22bd5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 -- 172.21.15.1:0/1711579959 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca22ae5130 con 0x55ca22bca9d0 2024-09-12T02:30:37.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800af10 tx=0x7f3f4800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee075ab5118e9d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f537fe640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 0x7f3f3c0a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06dff0 tx=0x7f3f4c0c5af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.681+0000 7f3f397fa640 1 -- 172.21.15.1:0/1711579959 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4801b070 con 0x55ca22bca9d0 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f397fa640 1 -- 172.21.15.1:0/1711579959 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f4800ce30 con 0x55ca22bca9d0 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f397fa640 1 -- 172.21.15.1:0/1711579959 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48015a90 con 0x55ca22bca9d0 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1711579959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 msgr2=0x55ca22bcadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800af10 tx=0x7f3f4800a6a0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1711579959 shutdown_connections 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1711579959 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bcadb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1711579959 >> 172.21.15.1:0/1711579959 conn(0x55ca22bc6f60 msgr2=0x55ca22bc7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1711579959 shutdown_connections 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.682+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1711579959 wait complete. 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 -- start start 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 Processor -- start 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ca22bd8780 con 0x55ca22bca9d0 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca22aebf20 con 0x55ca22bcb2f0 2024-09-12T02:30:37.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ca22bd8900 con 0x55ca22bd5bb0 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f5b67c740 10 client.0 _ll_register_callbacks cb 0x55ca22ab5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48318/0 (socket says 172.21.15.1:48318) 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 -- 172.21.15.1:0/152682273 learned_addr learned my addr 172.21.15.1:0/152682273 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 -- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 msgr2=0x55ca22bd2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 -- 172.21.15.1:0/152682273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 msgr2=0x55ca22bd27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.683+0000 7f3f527fc640 1 -- 172.21.15.1:0/152682273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca228a22b0 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f527fc640 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f48004810 tx=0x7f3f4800a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337f0dbc66c2261c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48023070 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f4800ce30 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3f48015b90 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3f4802f050 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca22be40d0 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f4800ce30 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3f4801e050 con 0x55ca22bca9d0 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:37.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 10 client.15129 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 20 client.15129 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22be6450 0x55ca22be78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 4 client.15129 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.684+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca22b3e600 con 0x55ca22be6450 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.685+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22be6450 0x55ca22be78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.685+0000 7f3f36ff5640 10 client.15129 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.685+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22be6450 0x55ca22be78c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=93bb1d6c742769f1 server_cookie=354077fae208d97a in_seq=0 out_seq=0 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f36ff5640 1 -- 172.21.15.1:0/152682273 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca22b3e600 con 0x55ca22be6450 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f36ff5640 10 client.15129 handle_command_reply: tid=0 2024-09-12T02:30:37.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 client.15129 shutdown 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 msgr2=0x55ca22bd5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f48004810 tx=0x7f3f4800a490 comp rx=0 tx=0).stop 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 shutdown_connections 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22be6450 0x55ca22be78c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bd5bb0 0x55ca22bd2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bcb2f0 0x55ca22bd27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/152682273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22bd5470 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f36ff5640 0 client.15129 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:37.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 >> 172.21.15.1:0/152682273 conn(0x55ca22bc6f60 msgr2=0x55ca22bccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 shutdown_connections 2024-09-12T02:30:37.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 1 -- 172.21.15.1:0/152682273 wait complete. 2024-09-12T02:30:37.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.686+0000 7f3f5b67c740 20 client.15129 trim_cache size 0 max 16384 2024-09-12T02:30:37.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 Processor -- start 2024-09-12T02:30:37.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 -- start start 2024-09-12T02:30:37.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bcb2f0 0x55ca22bc5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22bcfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be5c00 con 0x55ca22bca9d0 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be62d0 con 0x55ca22bd5bb0 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be69a0 con 0x55ca22bcb2f0 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48322/0 (socket says 172.21.15.1:48322) 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 -- 172.21.15.1:0/3757141163 learned_addr learned my addr 172.21.15.1:0/3757141163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bcb2f0 0x55ca22bc5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 -- 172.21.15.1:0/3757141163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bcb2f0 msgr2=0x55ca22bc5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bcb2f0 0x55ca22bc5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 -- 172.21.15.1:0/3757141163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 msgr2=0x55ca22bcfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22bcfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.705+0000 7f3f527fc640 1 -- 172.21.15.1:0/3757141163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca22bcb120 con 0x55ca22bca9d0 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.706+0000 7f3f527fc640 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800a950 tx=0x7f3f4801f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ada806b72e2bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.706+0000 7f3f38ff9640 1 -- 172.21.15.1:0/3757141163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48023040 con 0x55ca22bca9d0 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.706+0000 7f3f38ff9640 1 -- 172.21.15.1:0/3757141163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f4800a030 con 0x55ca22bca9d0 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.706+0000 7f3f38ff9640 1 -- 172.21.15.1:0/3757141163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4801b040 con 0x55ca22bca9d0 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- 172.21.15.1:0/3757141163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 msgr2=0x55ca22be78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800a950 tx=0x7f3f4801f630 comp rx=0 tx=0).stop 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- 172.21.15.1:0/3757141163 shutdown_connections 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22bcfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bcb2f0 0x55ca22bc5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/3757141163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bca9d0 0x55ca22be78c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- 172.21.15.1:0/3757141163 >> 172.21.15.1:0/3757141163 conn(0x55ca22bc6f60 msgr2=0x55ca22bc5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- 172.21.15.1:0/3757141163 shutdown_connections 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- 172.21.15.1:0/3757141163 wait complete. 2024-09-12T02:30:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- start start 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 Processor -- start 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 0x55ca22beb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22c48b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be7740 con 0x55ca22bcb2f0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be7070 con 0x55ca22bd5bb0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.707+0000 7f3f5b67c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ca22be7e10 con 0x55ca22bca9d0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f5b67c740 10 client.0 _ll_register_callbacks cb 0x7f3f48019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48332/0 (socket says 172.21.15.1:48332) 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 -- 172.21.15.1:0/1908693342 learned_addr learned my addr 172.21.15.1:0/1908693342 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 0x55ca22beb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22c48b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 -- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 msgr2=0x55ca22beb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 0x55ca22beb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 -- 172.21.15.1:0/1908693342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 msgr2=0x55ca22c48b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22c48b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 -- 172.21.15.1:0/1908693342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca22c491d0 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 0x55ca22beb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f52ffd640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f4402a940 tx=0x7f3f44031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12a352cef6c7afd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44035040 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3f44004250 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f4800a030 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3f44050070 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f5b67c740 10 client.15135 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.708+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca22c50540 con 0x55ca22bcb2f0 2024-09-12T02:30:37.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f4800a030 con 0x55ca22bcb2f0 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3f4403b690 con 0x55ca22bcb2f0 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 10 client.15135 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 10 client.15135 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 20 client.15135 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22c55140 0x55ca22c53e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 4 client.15135 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "status"}) -- 0x55ca22b38b10 con 0x55ca22c55140 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.709+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22c55140 0x55ca22c53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f527fc640 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22c55140 0x55ca22c53e50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4a2168688640c71 server_cookie=61a3c8aa8908ed2f in_seq=0 out_seq=0 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f36ff5640 10 client.15135 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f36ff5640 1 -- 172.21.15.1:0/1908693342 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ca22b38b10 con 0x55ca22c55140 2024-09-12T02:30:37.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f36ff5640 10 client.15135 handle_command_reply: tid=0 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 client.15135 shutdown 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 msgr2=0x55ca22beb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f4402a940 tx=0x7f3f44031930 comp rx=0 tx=0).stop 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 shutdown_connections 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55ca22c55140 0x55ca22c53e50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ca22bcb2f0 0x55ca22beb7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ca22bd5bb0 0x55ca22c48b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f36ff5640 0 client.15135 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 --2- 172.21.15.1:0/1908693342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ca22bca9d0 0x55ca22beb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 >> 172.21.15.1:0/1908693342 conn(0x55ca22bc6f60 msgr2=0x55ca22bc6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 shutdown_connections 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 1 -- 172.21.15.1:0/1908693342 wait complete. 2024-09-12T02:30:37.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.710+0000 7f3f5b67c740 20 client.15135 trim_cache size 0 max 16384 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 3, 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24457, 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 94.694333725000007, 2024-09-12T02:30:37.718 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:37.719 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:37.719 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:37.719 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 130.13312322600001 2024-09-12T02:30:37.719 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:37.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 msgr2=0x7f3f3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 0x7f3f3c0a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c06dff0 tx=0x7f3f4c0c5af0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 msgr2=0x7f3f5419cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b970 tx=0x7f3f4c00be30 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 shutdown_connections 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3f3c0a2b80 0x7f3f3c0a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f54106a80 0x7f3f5419cef0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f54101420 0x7f3f54198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 --2- 172.21.15.1:0/3040827660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f54100a80 0x7f3f54198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 >> 172.21.15.1:0/3040827660 conn(0x7f3f540fc7a0 msgr2=0x7f3f540fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 shutdown_connections 2024-09-12T02:30:37.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:37.711+0000 7f3f592a3640 1 -- 172.21.15.1:0/3040827660 wait complete. 2024-09-12T02:30:37.877 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:37 smithi001 ceph-mon[31252]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-09-12T02:30:37.999 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:37 smithi173 ceph-mon[35036]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-09-12T02:30:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:37 smithi134 ceph-mon[35091]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-09-12T02:30:38.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:30:39.068 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 -- 172.21.15.1:0/3748522411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4100d00 msgr2=0x7f80f4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 --2- 172.21.15.1:0/3748522411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4100d00 0x7f80f4106840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009930 tx=0x7f80e802a420 comp rx=0 tx=0).stop 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 -- 172.21.15.1:0/3748522411 shutdown_connections 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 --2- 172.21.15.1:0/3748522411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4100d00 0x7f80f4106840 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 --2- 172.21.15.1:0/3748522411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4106f50 0x7f80f410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 --2- 172.21.15.1:0/3748522411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 -- 172.21.15.1:0/3748522411 >> 172.21.15.1:0/3748522411 conn(0x7f80f4077210 msgr2=0x7f80f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 -- 172.21.15.1:0/3748522411 shutdown_connections 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.544+0000 7f80fc574640 1 -- 172.21.15.1:0/3748522411 wait complete. 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 Processor -- start 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 -- start start 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4100d00 0x7f80f4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4112030 con 0x7f80f4106f50 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4111eb0 con 0x7f80f4100d00 2024-09-12T02:30:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fc574640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41121b0 con 0x7f80f4100350 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fab11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fab11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48352/0 (socket says 172.21.15.1:48352) 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.545+0000 7f80fab11640 1 -- 172.21.15.1:0/3977444232 learned_addr learned my addr 172.21.15.1:0/3977444232 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fa310640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4100d00 0x7f80f4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 -- 172.21.15.1:0/3977444232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 msgr2=0x7f80f4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 -- 172.21.15.1:0/3977444232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4100d00 msgr2=0x7f80f4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4100d00 0x7f80f4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 -- 172.21.15.1:0/3977444232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f419d4d0 con 0x7f80f4106f50 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fa310640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fab11640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b970 tx=0x7f80ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80e77fe640 1 -- 172.21.15.1:0/3977444232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec019070 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80e77fe640 1 -- 172.21.15.1:0/3977444232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ec00cb40 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f419d7c0 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80e77fe640 1 -- 172.21.15.1:0/3977444232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec007650 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.546+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41a50a0 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.548+0000 7f80e77fe640 1 -- 172.21.15.1:0/3977444232 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f80ec01c070 con 0x7f80f4106f50 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 Processor -- start 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 -- start start 2024-09-12T02:30:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce39670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce3bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56417cd95090 con 0x56417ce2e9d0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56417cd3ca70 con 0x56417ce39bb0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fe94d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56417cd91050 con 0x56417ce2f2f0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80e77fe640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 0x7f80e00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48358/0 (socket says 172.21.15.1:48358) 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80f9b0f640 1 -- 172.21.15.1:0/191329661 learned_addr learned my addr 172.21.15.1:0/191329661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fab11640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 0x7f80e00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.549+0000 7f80fa310640 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce39670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80e77fe640 1 -- 172.21.15.1:0/3977444232 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f80ec0ce6f0 con 0x7f80f4106f50 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 -- 172.21.15.1:0/191329661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 msgr2=0x56417ce39670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce39670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 -- 172.21.15.1:0/191329661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 msgr2=0x56417ce3bfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce3bfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 -- 172.21.15.1:0/191329661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417cd49130 con 0x56417ce2e9d0 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80fab11640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 0x7f80e00a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80ec09abd0 tx=0x7f80ec065b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f80e8005ab0 tx=0x7f80e80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f4e212f07ac76c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80e4ff9640 1 -- 172.21.15.1:0/191329661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e803f070 con 0x56417ce2e9d0 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80e4ff9640 1 -- 172.21.15.1:0/191329661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e8005500 con 0x56417ce2e9d0 2024-09-12T02:30:39.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.550+0000 7f80e4ff9640 1 -- 172.21.15.1:0/191329661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8035070 con 0x56417ce2e9d0 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- 172.21.15.1:0/191329661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 msgr2=0x56417ce2edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f80e8005ab0 tx=0x7f80e80040f0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- 172.21.15.1:0/191329661 shutdown_connections 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce3bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce39670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 --2- 172.21.15.1:0/191329661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce2edb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- 172.21.15.1:0/191329661 >> 172.21.15.1:0/191329661 conn(0x56417ce2af60 msgr2=0x56417ce2b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- 172.21.15.1:0/191329661 shutdown_connections 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- 172.21.15.1:0/191329661 wait complete. 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 -- start start 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.551+0000 7f80fe94d740 1 Processor -- start 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce3e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56417ce3c780 con 0x56417ce2e9d0 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56417cd4ff20 con 0x56417ce39bb0 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56417ce3c900 con 0x56417ce2f2f0 2024-09-12T02:30:39.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 10 client.0 _ll_register_callbacks cb 0x56417cd19030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48368/0 (socket says 172.21.15.1:48368) 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 -- 172.21.15.1:0/1361850032 learned_addr learned my addr 172.21.15.1:0/1361850032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 -- 172.21.15.1:0/1361850032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 msgr2=0x56417ce3e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce3e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 -- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 msgr2=0x56417ce423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 -- 172.21.15.1:0/1361850032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417cb062b0 con 0x56417ce2e9d0 2024-09-12T02:30:39.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8b2dd3a2afcfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e803f030 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e8005500 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.552+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f80e80315b0 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80e8055070 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56417ce4c4d0 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e8005500 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f80e80037f0 con 0x56417ce2e9d0 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:39.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 10 client.15147 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 20 client.15147 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417ce4e640 0x56417ce4fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 4 client.15147 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56417cda2600 con 0x56417ce4e640 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.553+0000 7f80fa310640 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417ce4e640 0x56417ce4fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.554+0000 7f80fa310640 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417ce4e640 0x56417ce4fab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3043b8e21b2fcc22 server_cookie=2051ddb63c1edd0f in_seq=0 out_seq=0 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.554+0000 7f80ddffb640 10 client.15147 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.554+0000 7f80ddffb640 1 -- 172.21.15.1:0/1361850032 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56417cda2600 con 0x56417ce4e640 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.554+0000 7f80ddffb640 10 client.15147 handle_command_reply: tid=0 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.554+0000 7f80fe94d740 1 client.15147 shutdown 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 msgr2=0x56417ce3ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e80045d0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 shutdown_connections 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417ce4e640 0x56417ce4fab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce3e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80ddffb640 0 client.15147 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 --2- 172.21.15.1:0/1361850032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce3ddc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 >> 172.21.15.1:0/1361850032 conn(0x56417ce2af60 msgr2=0x56417ce30c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 shutdown_connections 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 1 -- 172.21.15.1:0/1361850032 wait complete. 2024-09-12T02:30:39.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.555+0000 7f80fe94d740 20 client.15147 trim_cache size 0 max 16384 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 Processor -- start 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 -- start start 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce2f2f0 0x56417ce42350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce39bb0 0x56417ce394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56417ce4ddf0 con 0x56417ce2e9d0 2024-09-12T02:30:39.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56417ce4e4c0 con 0x56417ce2f2f0 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80fe94d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56417ce4eb90 con 0x56417ce39bb0 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48372/0 (socket says 172.21.15.1:48372) 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 -- 172.21.15.1:0/977257512 learned_addr learned my addr 172.21.15.1:0/977257512 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 -- 172.21.15.1:0/977257512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce39bb0 msgr2=0x56417ce394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce39bb0 0x56417ce394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 -- 172.21.15.1:0/977257512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce2f2f0 msgr2=0x56417ce42350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce2f2f0 0x56417ce42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 -- 172.21.15.1:0/977257512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417ce2bbf0 con 0x56417ce2e9d0 2024-09-12T02:30:39.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f80e8003bc0 tx=0x7f80e8004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253bf2e070a1156 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.573+0000 7f80dffff640 1 -- 172.21.15.1:0/977257512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e803f070 con 0x56417ce2e9d0 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80dffff640 1 -- 172.21.15.1:0/977257512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e8004e40 con 0x56417ce2e9d0 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80dffff640 1 -- 172.21.15.1:0/977257512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8035040 con 0x56417ce2e9d0 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 -- 172.21.15.1:0/977257512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 msgr2=0x56417ce4ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f80e8003bc0 tx=0x7f80e8004d50 comp rx=0 tx=0).stop 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 -- 172.21.15.1:0/977257512 shutdown_connections 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce39bb0 0x56417ce394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce2f2f0 0x56417ce42350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 --2- 172.21.15.1:0/977257512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce4ed10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 -- 172.21.15.1:0/977257512 >> 172.21.15.1:0/977257512 conn(0x56417ce2af60 msgr2=0x56417ce3d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 -- 172.21.15.1:0/977257512 shutdown_connections 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.574+0000 7f80fe94d740 1 -- 172.21.15.1:0/977257512 wait complete. 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 -- start start 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 Processor -- start 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce43450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce43990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56417ce4f930 con 0x56417ce2e9d0 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56417ce4f260 con 0x56417ce39bb0 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56417ce50000 con 0x56417ce2f2f0 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fe94d740 10 client.0 _ll_register_callbacks cb 0x7f80f0008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48382/0 (socket says 172.21.15.1:48382) 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 -- 172.21.15.1:0/3626336705 learned_addr learned my addr 172.21.15.1:0/3626336705 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:39.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80fa310640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce43450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 -- 172.21.15.1:0/3626336705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 msgr2=0x56417ce43450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce43450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 -- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 msgr2=0x56417ce43990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.575+0000 7f80f9b0f640 1 -- 172.21.15.1:0/3626336705 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417ce43f00 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80f9b0f640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004d20 tx=0x7f80e8004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba41217f2b0e789 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8035030 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f80e80512d0 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e8004e40 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80e8069070 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56417ce48910 con 0x56417ce2e9d0 2024-09-12T02:30:39.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e8004e40 con 0x56417ce2e9d0 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f80e8051c10 con 0x56417ce2e9d0 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 10 client.15153 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 20 client.15153 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417cebd230 0x56417cebbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 4 client.15153 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.576+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "status"}) -- 0x56417cd9cb10 con 0x56417cebd230 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80fa310640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417cebd230 0x56417cebbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80fa310640 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417cebd230 0x56417cebbf40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6caf686b2d6274f server_cookie=1c98ab1763aeda47 in_seq=0 out_seq=0 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80ddffb640 10 client.15153 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80ddffb640 1 -- 172.21.15.1:0/3626336705 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56417cd9cb10 con 0x56417cebd230 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80ddffb640 10 client.15153 handle_command_reply: tid=0 2024-09-12T02:30:39.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.577+0000 7f80fe94d740 1 client.15153 shutdown 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 msgr2=0x56417ce49fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004d20 tx=0x7f80e8004c30 comp rx=0 tx=0).stop 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 shutdown_connections 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x56417cebd230 0x56417cebbf40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56417ce39bb0 0x56417ce43990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56417ce2f2f0 0x56417ce43450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 --2- 172.21.15.1:0/3626336705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56417ce2e9d0 0x56417ce49fd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 >> 172.21.15.1:0/3626336705 conn(0x56417ce2af60 msgr2=0x56417ce3d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80ddffb640 0 client.15153 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 shutdown_connections 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 1 -- 172.21.15.1:0/3626336705 wait complete. 2024-09-12T02:30:39.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fe94d740 20 client.15153 trim_cache size 0 max 16384 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24470, 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 97.567415460000007, 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:39.586 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 129.30681372999999 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 msgr2=0x7f80e00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 0x7f80e00a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f80ec09abd0 tx=0x7f80ec065b50 comp rx=0 tx=0).stop 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 msgr2=0x7f80f419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00b970 tx=0x7f80ec00be30 comp rx=0 tx=0).stop 2024-09-12T02:30:39.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 shutdown_connections 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80e00a2c00 0x7f80e00a50c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f4106f50 0x7f80f419cdf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f4100d00 0x7f80f4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 --2- 172.21.15.1:0/3977444232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f4100350 0x7f80f4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 >> 172.21.15.1:0/3977444232 conn(0x7f80f4077210 msgr2=0x7f80f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.578+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 shutdown_connections 2024-09-12T02:30:39.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:39.579+0000 7f80fc574640 1 -- 172.21.15.1:0/3977444232 wait complete. 2024-09-12T02:30:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:39 smithi001 ceph-mon[31252]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:30:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:39 smithi134 ceph-mon[35091]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:30:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:39 smithi173 ceph-mon[35036]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:30:40.263 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:30:40.518 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 -- 172.21.15.1:0/3496530818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 msgr2=0x7f32a0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 --2- 172.21.15.1:0/3496530818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a0103110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3290009930 tx=0x7f329002a440 comp rx=0 tx=0).stop 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 -- 172.21.15.1:0/3496530818 shutdown_connections 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 --2- 172.21.15.1:0/3496530818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 0x7f32a010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 --2- 172.21.15.1:0/3496530818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 --2- 172.21.15.1:0/3496530818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a0103110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 -- 172.21.15.1:0/3496530818 >> 172.21.15.1:0/3496530818 conn(0x7f32a00fc7d0 msgr2=0x7f32a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 -- 172.21.15.1:0/3496530818 shutdown_connections 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.046+0000 7f32a4a44640 1 -- 172.21.15.1:0/3496530818 wait complete. 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 Processor -- start 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 -- start start 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 0x7f32a019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32a01120e0 con 0x7f32a0102d30 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32a0111f60 con 0x7f32a01036e0 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f32a4a44640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32a0112260 con 0x7f32a01082a0 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f329e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f329e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48388/0 (socket says 172.21.15.1:48388) 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.047+0000 7f329e59c640 1 -- 172.21.15.1:0/1826215476 learned_addr learned my addr 172.21.15.1:0/1826215476 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 0x7f32a019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329dd9b640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 -- 172.21.15.1:0/1826215476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 msgr2=0x7f32a019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 0x7f32a019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 -- 172.21.15.1:0/1826215476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 msgr2=0x7f32a0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 -- 172.21.15.1:0/1826215476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a019d550 con 0x7f32a0102d30 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329dd9b640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f329e59c640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3290009a50 tx=0x7f3290004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f328f7fe640 1 -- 172.21.15.1:0/1826215476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329003f030 con 0x7f32a0102d30 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f328f7fe640 1 -- 172.21.15.1:0/1826215476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3290003ce0 con 0x7f32a0102d30 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a019d7e0 con 0x7f32a0102d30 2024-09-12T02:30:41.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f328f7fe640 1 -- 172.21.15.1:0/1826215476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290035070 con 0x7f32a0102d30 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.048+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a01a5120 con 0x7f32a0102d30 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.050+0000 7f328f7fe640 1 -- 172.21.15.1:0/1826215476 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3290042030 con 0x7f32a0102d30 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 Processor -- start 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 -- start start 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760615c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56376057c090 con 0x5637606161d0 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563760523a70 con 0x563760624fc0 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563760578050 con 0x5637606158b0 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f329e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f329e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48392/0 (socket says 172.21.15.1:48392) 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f329e59c640 1 -- 172.21.15.1:0/1084920543 learned_addr learned my addr 172.21.15.1:0/1084920543 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:41.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760615c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.051+0000 7f329dd9b640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 -- 172.21.15.1:0/1084920543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 msgr2=0x563760615c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760615c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 -- 172.21.15.1:0/1084920543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 msgr2=0x5637606273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 -- 172.21.15.1:0/1084920543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563760530130 con 0x5637606161d0 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329dd9b640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f328f7fe640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 0x7f32880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 0x7f32880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f329e59c640 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32900f5c10 tx=0x7f32900f5d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca3b3164bf916b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f328f7fe640 1 -- 172.21.15.1:0/1826215476 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f32900ef690 con 0x7f32a0102d30 2024-09-12T02:30:41.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f328cff9640 1 -- 172.21.15.1:0/1084920543 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290049030 con 0x5637606161d0 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f328cff9640 1 -- 172.21.15.1:0/1084920543 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32900bc5d0 con 0x5637606161d0 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.052+0000 7f328cff9640 1 -- 172.21.15.1:0/1084920543 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32900b8170 con 0x5637606161d0 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1084920543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 msgr2=0x563760624a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 0x7f32880a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3298007ed0 tx=0x7f3298007680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32900f5c10 tx=0x7f32900f5d00 comp rx=0 tx=0).stop 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1084920543 shutdown_connections 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x563760624a80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1084920543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760615c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1084920543 >> 172.21.15.1:0/1084920543 conn(0x563760611f60 msgr2=0x563760612340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1084920543 shutdown_connections 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1084920543 wait complete. 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.053+0000 7f32a6e1d740 1 -- start start 2024-09-12T02:30:41.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 Processor -- start 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760624890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637606161d0 0x563760621be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563760627950 con 0x563760624fc0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563760536f20 con 0x5637606161d0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563760627ad0 con 0x5637606158b0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f32a6e1d740 10 client.0 _ll_register_callbacks cb 0x563760500030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39214/0 (socket says 172.21.15.1:39214) 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 -- 172.21.15.1:0/1870567548 learned_addr learned my addr 172.21.15.1:0/1870567548 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329dd9b640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637606161d0 0x563760621be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329e59c640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760624890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 -- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 msgr2=0x563760624890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760624890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 -- 172.21.15.1:0/1870567548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637606161d0 msgr2=0x563760621be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637606161d0 0x563760621be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.054+0000 7f329ed9d640 1 -- 172.21.15.1:0/1870567548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637602ed2b0 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f329ed9d640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f329800ed30 tx=0x7f3298004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec8fdd57fff6a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329801cd30 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32900bc5d0 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f329801d410 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f329802e070 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5637606331f0 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32900bc5d0 con 0x563760624fc0 2024-09-12T02:30:41.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3298028780 con 0x563760624fc0 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 10 client.15165 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 20 client.15165 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x563760635840 0x563760636cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 4 client.15165 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.055+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563760589600 con 0x563760635840 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.056+0000 7f329e59c640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x563760635840 0x563760636cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.058+0000 7f329e59c640 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x563760635840 0x563760636cb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85566fb9c62c166 server_cookie=a332f1cdbe78c27e in_seq=0 out_seq=0 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.058+0000 7f3285ffb640 10 client.15165 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.061+0000 7f3285ffb640 1 -- 172.21.15.1:0/1870567548 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563760589600 con 0x563760635840 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.061+0000 7f3285ffb640 10 client.15165 handle_command_reply: tid=0 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.061+0000 7f32a6e1d740 1 client.15165 shutdown 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 msgr2=0x563760622120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f329800ed30 tx=0x7f3298004a40 comp rx=0 tx=0).stop 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 shutdown_connections 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x563760635840 0x563760636cb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563760624fc0 0x563760622120 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637606161d0 0x563760621be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f3285ffb640 0 client.15165 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/1870567548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760624890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 >> 172.21.15.1:0/1870567548 conn(0x563760611f60 msgr2=0x563760617cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 shutdown_connections 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 1 -- 172.21.15.1:0/1870567548 wait complete. 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.062+0000 7f32a6e1d740 20 client.15165 trim_cache size 0 max 16384 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.079+0000 7f32a6e1d740 1 Processor -- start 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.079+0000 7f32a6e1d740 1 -- start start 2024-09-12T02:30:41.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760635f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563760634ff0 con 0x5637606161d0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5637606356c0 con 0x563760624fc0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563760635d90 con 0x5637606158b0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39218/0 (socket says 172.21.15.1:39218) 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 -- 172.21.15.1:0/559379437 learned_addr learned my addr 172.21.15.1:0/559379437 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329ed9d640 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329e59c640 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760635f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 -- 172.21.15.1:0/559379437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 msgr2=0x563760635f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760635f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 -- 172.21.15.1:0/559379437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 msgr2=0x5637606204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606204b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 -- 172.21.15.1:0/559379437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563760620130 con 0x5637606161d0 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.080+0000 7f329dd9b640 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f32a006a370 tx=0x7f329400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c45cba9238901d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f3287fff640 1 -- 172.21.15.1:0/559379437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294010d30 con 0x5637606161d0 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f3287fff640 1 -- 172.21.15.1:0/559379437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3294013910 con 0x5637606161d0 2024-09-12T02:30:41.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f3287fff640 1 -- 172.21.15.1:0/559379437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329401cae0 con 0x5637606161d0 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 -- 172.21.15.1:0/559379437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 msgr2=0x5637606214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f32a006a370 tx=0x7f329400be60 comp rx=0 tx=0).stop 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 -- 172.21.15.1:0/559379437 shutdown_connections 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x5637606214a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x5637606204b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/559379437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x563760635f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 -- 172.21.15.1:0/559379437 >> 172.21.15.1:0/559379437 conn(0x563760611f60 msgr2=0x563760612340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 -- 172.21.15.1:0/559379437 shutdown_connections 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.081+0000 7f32a6e1d740 1 -- 172.21.15.1:0/559379437 wait complete. 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 -- start start 2024-09-12T02:30:41.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 Processor -- start 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x56376063f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x563760638450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563760636b30 con 0x5637606161d0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563760636460 con 0x563760624fc0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563760637200 con 0x5637606158b0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f32a6e1d740 10 client.0 _ll_register_callbacks cb 0x7f3298007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f329dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39230/0 (socket says 172.21.15.1:39230) 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f329dd9b640 1 -- 172.21.15.1:0/4226368021 learned_addr learned my addr 172.21.15.1:0/4226368021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.082+0000 7f329e59c640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x56376063f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329ed9d640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x563760638450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 -- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 msgr2=0x56376063f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x56376063f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 -- 172.21.15.1:0/4226368021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 msgr2=0x563760638450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x563760638450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 -- 172.21.15.1:0/4226368021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563760638bc0 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f329dd9b640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f329401c5e0 tx=0x7f32940136e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b04324df50162b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f3285ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329401c7e0 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3294013910 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f329401c980 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f329401cb80 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f32a6e1d740 10 client.15171 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.083+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56376063d610 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3294013910 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f32940060b0 con 0x5637606161d0 2024-09-12T02:30:41.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 10 client.15171 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 10 client.15171 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 20 client.15171 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x5637606a4170 0x5637606a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 4 client.15171 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "status"}) -- 0x563760583b10 con 0x5637606a4170 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f329e59c640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x5637606a4170 0x5637606a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f329e59c640 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x5637606a4170 0x5637606a2e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b1f6e584c8e4117 server_cookie=38baa128e66b4e57 in_seq=0 out_seq=0 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.084+0000 7f3285ffb640 10 client.15171 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f3285ffb640 1 -- 172.21.15.1:0/4226368021 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x563760583b10 con 0x5637606a4170 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f3285ffb640 10 client.15171 handle_command_reply: tid=0 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 client.15171 shutdown 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 msgr2=0x56376063f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f329401c5e0 tx=0x7f32940136e0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 shutdown_connections 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x5637606a4170 0x5637606a2e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637606161d0 0x56376063f5d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563760624fc0 0x563760638450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 --2- 172.21.15.1:0/4226368021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637606158b0 0x56376063f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 >> 172.21.15.1:0/4226368021 conn(0x563760611f60 msgr2=0x563760621430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f3285ffb640 0 client.15171 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 shutdown_connections 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 1 -- 172.21.15.1:0/4226368021 wait complete. 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a6e1d740 20 client.15171 trim_cache size 0 max 16384 2024-09-12T02:30:41.104 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24475, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 100.082239433, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 128.234929225 2024-09-12T02:30:41.105 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.085+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 msgr2=0x7f32880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 0x7f32880a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3298007ed0 tx=0x7f3298007680 comp rx=0 tx=0).stop 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 msgr2=0x7f32a01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3290009a50 tx=0x7f3290004270 comp rx=0 tx=0).stop 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 shutdown_connections 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f32880a2b80 0x7f32880a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a01082a0 0x7f32a019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32a01036e0 0x7f32a0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 --2- 172.21.15.1:0/1826215476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32a0102d30 0x7f32a01985a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:41.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 >> 172.21.15.1:0/1826215476 conn(0x7f32a00fc7d0 msgr2=0x7f32a0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:41.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 shutdown_connections 2024-09-12T02:30:41.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:41.086+0000 7f32a4a44640 1 -- 172.21.15.1:0/1826215476 wait complete. 2024-09-12T02:30:41.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:41 smithi001 ceph-mon[31252]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T02:30:41.990 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:30:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:41 smithi134 ceph-mon[35091]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T02:30:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:41 smithi173 ceph-mon[35036]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:42.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 -- 172.21.15.1:0/1374336252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614101de0 msgr2=0x7f16141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 --2- 172.21.15.1:0/1374336252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614101de0 0x7f16141021c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1610009900 tx=0x7f161002a410 comp rx=0 tx=0).stop 2024-09-12T02:30:42.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 -- 172.21.15.1:0/1374336252 shutdown_connections 2024-09-12T02:30:42.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 --2- 172.21.15.1:0/1374336252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 --2- 172.21.15.1:0/1374336252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614102790 0x7f16141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 --2- 172.21.15.1:0/1374336252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614101de0 0x7f16141021c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 -- 172.21.15.1:0/1374336252 >> 172.21.15.1:0/1374336252 conn(0x7f16140fd8c0 msgr2=0x7f16140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 -- 172.21.15.1:0/1374336252 shutdown_connections 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.757+0000 7f161bef1640 1 -- 172.21.15.1:0/1374336252 wait complete. 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 Processor -- start 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 -- start start 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614101de0 0x7f16141982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1614111f70 con 0x7f1614102790 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1614111df0 con 0x7f1614101de0 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161bef1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f16141120f0 con 0x7f1614106f10 2024-09-12T02:30:42.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39250/0 (socket says 172.21.15.1:39250) 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.758+0000 7f161948c640 1 -- 172.21.15.1:0/3739132091 learned_addr learned my addr 172.21.15.1:0/3739132091 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161a48e640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614101de0 0x7f16141982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 -- 172.21.15.1:0/3739132091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 msgr2=0x7f161419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 -- 172.21.15.1:0/3739132091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614101de0 msgr2=0x7f16141982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614101de0 0x7f16141982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 -- 172.21.15.1:0/3739132091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161419d2a0 con 0x7f1614102790 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161a48e640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161948c640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f160800c920 tx=0x7f160800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f1606ffd640 1 -- 172.21.15.1:0/3739132091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608007c70 con 0x7f1614102790 2024-09-12T02:30:42.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f1606ffd640 1 -- 172.21.15.1:0/3739132091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1608007e10 con 0x7f1614102790 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161419d590 con 0x7f1614102790 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f1606ffd640 1 -- 172.21.15.1:0/3739132091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608018890 con 0x7f1614102790 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.759+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16141a4e70 con 0x7f1614102790 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.761+0000 7f1606ffd640 1 -- 172.21.15.1:0/3739132091 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1608018a50 con 0x7f1614102790 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 Processor -- start 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 -- start start 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d5268adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d52695670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d525f1090 con 0x563d52695bb0 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d52598a70 con 0x563d5268a9d0 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161e2ca740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563d525ed050 con 0x563d5268b2f0 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f1606ffd640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 0x7f16000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39252/0 (socket says 172.21.15.1:39252) 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161948c640 1 -- 172.21.15.1:0/1656448218 learned_addr learned my addr 172.21.15.1:0/1656448218 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.762+0000 7f161a48e640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 0x7f16000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161a48e640 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d5268adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f1606ffd640 1 -- 172.21.15.1:0/3739132091 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f16080cf240 con 0x7f1614102790 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f1619c8d640 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d52695670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 -- 172.21.15.1:0/1656448218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 msgr2=0x563d52695670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d52695670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 -- 172.21.15.1:0/1656448218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 msgr2=0x563d5268adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d5268adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 -- 172.21.15.1:0/1656448218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d525a5130 con 0x563d52695bb0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161a48e640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 0x7f16000a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f160c012a40 tx=0x7f160c00ac90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f161948c640 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f160800c8f0 tx=0x7f160800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b419d9c54a6e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f15fffff640 1 -- 172.21.15.1:0/1656448218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160809ba20 con 0x563d52695bb0 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f15fffff640 1 -- 172.21.15.1:0/1656448218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16080ce070 con 0x563d52695bb0 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.763+0000 7f15fffff640 1 -- 172.21.15.1:0/1656448218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608018d40 con 0x563d52695bb0 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- 172.21.15.1:0/1656448218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 msgr2=0x563d52697fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f160800c8f0 tx=0x7f160800cf90 comp rx=0 tx=0).stop 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- 172.21.15.1:0/1656448218 shutdown_connections 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d52697fa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d52695670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 --2- 172.21.15.1:0/1656448218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d5268adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- 172.21.15.1:0/1656448218 >> 172.21.15.1:0/1656448218 conn(0x563d52686f60 msgr2=0x563d52687340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- 172.21.15.1:0/1656448218 shutdown_connections 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- 172.21.15.1:0/1656448218 wait complete. 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 -- start start 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.764+0000 7f161e2ca740 1 Processor -- start 2024-09-12T02:30:42.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 0x563d52695420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d52692cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d52698780 con 0x563d5268b2f0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d525abf20 con 0x563d52695bb0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563d52698900 con 0x563d5268a9d0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161e2ca740 10 client.0 _ll_register_callbacks cb 0x563d52575030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39264/0 (socket says 172.21.15.1:39264) 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 -- 172.21.15.1:0/3353143923 learned_addr learned my addr 172.21.15.1:0/3353143923 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 0x563d52695420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161a48e640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d52692cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 -- 172.21.15.1:0/3353143923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 msgr2=0x563d52695420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 0x563d52695420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 -- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 msgr2=0x563d52692cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d52692cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 -- 172.21.15.1:0/3353143923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d523622b0 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 0x563d52695420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f161948c640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16080983f0 tx=0x7f1608099f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e0a0823114970c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.765+0000 7f15fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080a4690 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f160800fb30 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16080ce070 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f160809ba20 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d526a4070 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16080ce070 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f16080860d0 con 0x563d5268b2f0 2024-09-12T02:30:42.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 10 client.15183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 20 client.15183 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d526a53c0 0x563d526a7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 4 client.15183 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.766+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d525fe600 con 0x563d526a53c0 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.767+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d526a53c0 0x563d526a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.767+0000 7f15fd7fa640 10 client.15183 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.767+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d526a53c0 0x563d526a7540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991cf60214448b2d server_cookie=950084da56249b0b in_seq=0 out_seq=0 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f15fd7fa640 1 -- 172.21.15.1:0/3353143923 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d525fe600 con 0x563d526a53c0 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f15fd7fa640 10 client.15183 handle_command_reply: tid=0 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 client.15183 shutdown 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 msgr2=0x563d52692770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16080983f0 tx=0x7f1608099f30 comp rx=0 tx=0).stop 2024-09-12T02:30:42.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 shutdown_connections 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268b2f0 0x563d52692770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d526a53c0 0x563d526a7540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d52692cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3353143923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268a9d0 0x563d52695420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f15fd7fa640 0 client.15183 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 >> 172.21.15.1:0/3353143923 conn(0x563d52686f60 msgr2=0x563d5268cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 shutdown_connections 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 1 -- 172.21.15.1:0/3353143923 wait complete. 2024-09-12T02:30:42.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.768+0000 7f161e2ca740 20 client.15183 trim_cache size 0 max 16384 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.786+0000 7f161e2ca740 1 Processor -- start 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.786+0000 7f161e2ca740 1 -- start start 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d5268dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d526a5880 con 0x563d5268a9d0 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d526a5f50 con 0x563d52695bb0 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161e2ca740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563d526a6620 con 0x563d5268b2f0 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39280/0 (socket says 172.21.15.1:39280) 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 -- 172.21.15.1:0/3806936203 learned_addr learned my addr 172.21.15.1:0/3806936203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161a48e640 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d5268dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 -- 172.21.15.1:0/3806936203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 msgr2=0x563d526a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 -- 172.21.15.1:0/3806936203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 msgr2=0x563d5268dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d5268dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 -- 172.21.15.1:0/3806936203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d52695040 con 0x563d5268a9d0 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f161a48e640 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d5268dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f1619c8d640 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1610009900 tx=0x7f1610004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c86c2b4f4a95a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f15ff7fe640 1 -- 172.21.15.1:0/3806936203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161004a070 con 0x563d5268a9d0 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f15ff7fe640 1 -- 172.21.15.1:0/3806936203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1610005520 con 0x563d5268a9d0 2024-09-12T02:30:42.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.787+0000 7f15ff7fe640 1 -- 172.21.15.1:0/3806936203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610035040 con 0x563d5268a9d0 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 -- 172.21.15.1:0/3806936203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 msgr2=0x563d526a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1610009900 tx=0x7f1610004260 comp rx=0 tx=0).stop 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 -- 172.21.15.1:0/3806936203 shutdown_connections 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d52695bb0 0x563d5268dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 --2- 172.21.15.1:0/3806936203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d5268a9d0 0x563d526a5a00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 -- 172.21.15.1:0/3806936203 >> 172.21.15.1:0/3806936203 conn(0x563d52686f60 msgr2=0x563d5268d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 -- 172.21.15.1:0/3806936203 shutdown_connections 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.788+0000 7f161e2ca740 1 -- 172.21.15.1:0/3806936203 wait complete. 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 -- start start 2024-09-12T02:30:42.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 Processor -- start 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d526afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d526a73c0 con 0x563d52695bb0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563d526a6cf0 con 0x563d5268a9d0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563d526a7a90 con 0x563d5268b2f0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161e2ca740 10 client.0 _ll_register_callbacks cb 0x7f160c012550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161a48e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161a48e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39292/0 (socket says 172.21.15.1:39292) 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161a48e640 1 -- 172.21.15.1:0/2478338444 learned_addr learned my addr 172.21.15.1:0/2478338444 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f1619c8d640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d526afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.789+0000 7f161948c640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 -- 172.21.15.1:0/2478338444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 msgr2=0x563d526b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 -- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 msgr2=0x563d526afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d526afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 -- 172.21.15.1:0/2478338444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d526a9970 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161a48e640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f160c012650 tx=0x7f160c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d54d5234397db09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c011e00 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f160c01f440 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1610005520 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f160c01f640 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161e2ca740 10 client.15189 fetch_fsmap learned FSMap version 27 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d526ae340 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1610005520 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.790+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f160c026070 con 0x563d52695bb0 2024-09-12T02:30:42.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 10 client.15189 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 10 client.15189 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 20 client.15189 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d52715100 0x563d52713e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 4 client.15189 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "status"}) -- 0x563d525f8b10 con 0x563d52715100 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f1619c8d640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d52715100 0x563d52713e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f1619c8d640 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d52715100 0x563d52713e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bfa40bfc5796643 server_cookie=d1fdfbc22b4273f7 in_seq=0 out_seq=0 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f15fd7fa640 10 client.15189 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f15fd7fa640 1 -- 172.21.15.1:0/2478338444 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x563d525f8b10 con 0x563d52715100 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f15fd7fa640 10 client.15189 handle_command_reply: tid=0 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 1 client.15189 shutdown 2024-09-12T02:30:42.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 msgr2=0x563d526a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.791+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f160c012650 tx=0x7f160c019000 comp rx=0 tx=0).stop 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 shutdown_connections 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d52695bb0 0x563d526a9140 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563d52715100 0x563d52713e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563d5268b2f0 0x563d526b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 --2- 172.21.15.1:0/2478338444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563d5268a9d0 0x563d526afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f15fd7fa640 0 client.15189 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 >> 172.21.15.1:0/2478338444 conn(0x563d52686f60 msgr2=0x563d5268dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 shutdown_connections 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 1 -- 172.21.15.1:0/2478338444 wait complete. 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161e2ca740 20 client.15189 trim_cache size 0 max 16384 2024-09-12T02:30:42.797 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24494, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 109.318996704, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 27, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 120.841037517 2024-09-12T02:30:42.798 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 msgr2=0x7f16000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 0x7f16000a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f160c012a40 tx=0x7f160c00ac90 comp rx=0 tx=0).stop 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 msgr2=0x7f1614198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f160800c920 tx=0x7f160800cde0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 shutdown_connections 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f16000a2c00 0x7f16000a50c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1614102790 0x7f1614198830 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1614106f10 0x7f161419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 --2- 172.21.15.1:0/3739132091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1614101de0 0x7f16141982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.792+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 >> 172.21.15.1:0/3739132091 conn(0x7f16140fd8c0 msgr2=0x7f16140ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.793+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 shutdown_connections 2024-09-12T02:30:42.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:42.793+0000 7f161bef1640 1 -- 172.21.15.1:0/3739132091 wait complete. 2024-09-12T02:30:43.736 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:30:43.749 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:30:43.749 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:30:43.750 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:30:43.750 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:30:43.897 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:30:43.897 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:30:43.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:43.898 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-12T02:30:43.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:43.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-12T02:30:43.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:43 smithi001 ceph-mon[31252]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:43.997 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-12T02:30:43.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:30:43.999 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T02:30:43.999 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:30:43.999 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:43.999 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:30:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:43 smithi134 ceph-mon[35091]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:43 smithi173 ceph-mon[35036]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:30:44.306 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:44.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.792+0000 7f33d35a3640 1 -- 172.21.15.1:0/1361203830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc102990 msgr2=0x7f33cc102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.792+0000 7f33d35a3640 1 --2- 172.21.15.1:0/1361203830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc102990 0x7f33cc102d70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009900 tx=0x7f33c802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 -- 172.21.15.1:0/1361203830 shutdown_connections 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 --2- 172.21.15.1:0/1361203830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33cc1004e0 0x7f33cc110b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 --2- 172.21.15.1:0/1361203830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 0x7f33cc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 --2- 172.21.15.1:0/1361203830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc102990 0x7f33cc102d70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 -- 172.21.15.1:0/1361203830 >> 172.21.15.1:0/1361203830 conn(0x7f33cc0fba90 msgr2=0x7f33cc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 -- 172.21.15.1:0/1361203830 shutdown_connections 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 -- 172.21.15.1:0/1361203830 wait complete. 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 Processor -- start 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.793+0000 7f33d35a3640 1 -- start start 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 0x7f33cc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33cc102990 0x7f33cc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc114170 con 0x7f33cc1004e0 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc113ff0 con 0x7f33cc102990 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d35a3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc1142f0 con 0x7f33cc0ffb60 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39300/0 (socket says 172.21.15.1:39300) 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 -- 172.21.15.1:0/587223549 learned_addr learned my addr 172.21.15.1:0/587223549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d133f640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 0x7f33cc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 -- 172.21.15.1:0/587223549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 msgr2=0x7f33cc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 0x7f33cc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 -- 172.21.15.1:0/587223549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33cc102990 msgr2=0x7f33cc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33cc102990 0x7f33cc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 -- 172.21.15.1:0/587223549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc19f620 con 0x7f33cc1004e0 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33d0b3e640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b4a0 tx=0x7f33bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc014070 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.794+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33bc010af0 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.795+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc19f910 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.795+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc017d10 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.795+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc1a71f0 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.795+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc0fffa0 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.797+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f33bc017070 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.797+0000 7f33c27fc640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 0x7f33b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.797+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f33bc0ce870 con 0x7f33cc1004e0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.797+0000 7f33d133f640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 0x7f33b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.798+0000 7f33d133f640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 0x7f33b80a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f33c8005ab0 tx=0x7f33c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:44.800+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33bc09b7b0 con 0x7f33cc1004e0 2024-09-12T02:30:45.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.014+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33cc19b9d0 con 0x7f33cc1004e0 2024-09-12T02:30:45.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.015+0000 7f33c27fc640 1 -- 172.21.15.1:0/587223549 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f33cc19b9d0 con 0x7f33cc1004e0 2024-09-12T02:30:45.015 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T02:30:45.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 msgr2=0x7f33b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 0x7f33b80a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f33c8005ab0 tx=0x7f33c8005a20 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 msgr2=0x7f33cc19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b4a0 tx=0x7f33bc00b960 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 shutdown_connections 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f33b80a2c00 0x7f33b80a50c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33cc1004e0 0x7f33cc19abb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33cc102990 0x7f33cc19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 --2- 172.21.15.1:0/587223549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33cc0ffb60 0x7f33cc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 >> 172.21.15.1:0/587223549 conn(0x7f33cc0fba90 msgr2=0x7f33cc0fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 shutdown_connections 2024-09-12T02:30:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45.017+0000 7f33d35a3640 1 -- 172.21.15.1:0/587223549 wait complete. 2024-09-12T02:30:45.787 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:30:45.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:30:45.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-12T02:30:45.787 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:30:45.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:45.788 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:30:45.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:30:45.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:30:45.788 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:30:45.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:45.788 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:45.806 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42208sec preferred_lft 42208sec 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:30:45.807 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-12T02:30:45.808 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:30:45.808 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-12T02:30:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:45.988 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:45 smithi001 ceph-mon[31252]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:45.988 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:45 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/587223549' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:46.030 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:46.058 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-12T02:30:46.129 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:30:46.317 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-12T02:30:46.318 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:45 smithi173 ceph-mon[35036]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:46.318 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:45 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/587223549' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:30:46.318 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:45 smithi134 ceph-mon[35091]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:30:46.318 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:45 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/587223549' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:46.575 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:46.591 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-12T02:30:46.647 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:46.647 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-12T02:30:46.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:30:46.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:30:46.647 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:46.768 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:30:46.769 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:46.897 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:30:46.898 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-12T02:30:46.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-12T02:30:46.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:30:46.898 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:30:46.978 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:30:46.994 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:47.050 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:30:47.050 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:30:47.050 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/437002fb-a25f-434d-87c2-b5dab40e23bf 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:47.050 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/437002fb-a25f-434d-87c2-b5dab40e23bf /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:3300,172.21.15.134:3300,172.21.15.173:3300" 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.1:3300,172.21.15.134:3300,172.21.15.173:3300:/volumes/qa/sv_1/437002fb-a25f-434d-87c2-b5dab40e23bf 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=877143dc-70ad-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:30:47.293 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:30:47.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:30:47.324 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi001.stdout:client15198 2024-09-12T02:30:47.424 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:30:47.424 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:30:47.441 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi001.stdout:client15198 2024-09-12T02:30:47.541 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi001.stdout:client15198 2024-09-12T02:30:47.600 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/877143dc-70ad-11ef-bcea-c7b262605968.client15198/status') 2024-09-12T02:30:47.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:30:47.661 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.15198 (3)192.168.0.1:0/1271954919 2024-09-12T02:30:47.662 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-12T02:30:47.662 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-12T02:30:47.662 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-12T02:30:47.662 INFO:teuthology.orchestra.run.smithi001.stderr:70 bytes copied, 2.5136e-05 s, 2.8 MB/s 2024-09-12T02:30:47.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:30:47.669 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:30:47.679 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:30:47.679 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:30:47.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T02:30:47.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 -- 172.21.15.1:0/2795714222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc100a40 msgr2=0x7faefc100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 --2- 172.21.15.1:0/2795714222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc100a40 0x7faefc100e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faeec009900 tx=0x7faeec02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 -- 172.21.15.1:0/2795714222 shutdown_connections 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 --2- 172.21.15.1:0/2795714222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc1025f0 0x7faefc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 --2- 172.21.15.1:0/2795714222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc101c30 0x7faefc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 --2- 172.21.15.1:0/2795714222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc100a40 0x7faefc100e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 -- 172.21.15.1:0/2795714222 >> 172.21.15.1:0/2795714222 conn(0x7faefc0fc1e0 msgr2=0x7faefc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 -- 172.21.15.1:0/2795714222 shutdown_connections 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.785+0000 7faf02523640 1 -- 172.21.15.1:0/2795714222 wait complete. 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 Processor -- start 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 -- start start 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc100a40 0x7faefc104960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc101c30 0x7faefc103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faefc10c770 con 0x7faefc1025f0 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faefc10c5f0 con 0x7faefc101c30 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf02523640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faefc10c8f0 con 0x7faefc100a40 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf00ac0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf00ac0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39318/0 (socket says 172.21.15.1:39318) 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faf00ac0640 1 -- 172.21.15.1:0/2556169965 learned_addr learned my addr 172.21.15.1:0/2556169965 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.786+0000 7faefbfff640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc100a40 0x7faefc104960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faefb7fe640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc101c30 0x7faefc103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 -- 172.21.15.1:0/2556169965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc100a40 msgr2=0x7faefc104960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc100a40 0x7faefc104960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 -- 172.21.15.1:0/2556169965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc101c30 msgr2=0x7faefc103010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc101c30 0x7faefc103010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 -- 172.21.15.1:0/2556169965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc103d70 con 0x7faefc1025f0 2024-09-12T02:30:47.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf00ac0640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faef400cad0 tx=0x7faef400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400ae20 con 0x7faefc1025f0 2024-09-12T02:30:47.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef4005020 con 0x7faefc1025f0 2024-09-12T02:30:47.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc1a1fd0 con 0x7faefc1025f0 2024-09-12T02:30:47.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400f6f0 con 0x7faefc1025f0 2024-09-12T02:30:47.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.787+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc1a24c0 con 0x7faefc1025f0 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.788+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faefc1a2780 con 0x7faefc1025f0 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.789+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faef40051d0 con 0x7faefc1025f0 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.790+0000 7faef97fa640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 0x7faee40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.790+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faef40cf180 con 0x7faefc1025f0 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.790+0000 7faefbfff640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 0x7faee40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.791+0000 7faefbfff640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 0x7faee40a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faeec02aa00 tx=0x7faeec0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:47.795+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faef4014030 con 0x7faefc1025f0 2024-09-12T02:30:48.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.046+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7faefc1a2950 con 0x7faefc1025f0 2024-09-12T02:30:48.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:47 smithi001 ceph-mon[31252]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:47 smithi134 ceph-mon[35091]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:47 smithi173 ceph-mon[35036]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:30:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.733+0000 7faef97fa640 1 -- 172.21.15.1:0/2556169965 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7faef409c060 con 0x7faefc1025f0 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 msgr2=0x7faee40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 0x7faee40a50f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faeec02aa00 tx=0x7faeec0315b0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 msgr2=0x7faefc103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faef400cad0 tx=0x7faef400cf90 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 shutdown_connections 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.735+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faee40a2c30 0x7faee40a50f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faefc1025f0 0x7faefc103550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faefc101c30 0x7faefc103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 --2- 172.21.15.1:0/2556169965 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faefc100a40 0x7faefc104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 >> 172.21.15.1:0/2556169965 conn(0x7faefc0fc1e0 msgr2=0x7faefc0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:48.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 shutdown_connections 2024-09-12T02:30:48.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.736+0000 7faf02523640 1 -- 172.21.15.1:0/2556169965 wait complete. 2024-09-12T02:30:48.747 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:30:48.759 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T02:30:48.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 -- 172.21.15.1:0/2733437912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec102d20 msgr2=0x7f0aec1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 --2- 172.21.15.1:0/2733437912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec102d20 0x7f0aec1031a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009900 tx=0x7f0ae002a410 comp rx=0 tx=0).stop 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 -- 172.21.15.1:0/2733437912 shutdown_connections 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 --2- 172.21.15.1:0/2733437912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec102d20 0x7f0aec1031a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 --2- 172.21.15.1:0/2733437912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec1036e0 0x7f0aec109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 --2- 172.21.15.1:0/2733437912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 -- 172.21.15.1:0/2733437912 >> 172.21.15.1:0/2733437912 conn(0x7f0aec0fd2b0 msgr2=0x7f0aec0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 -- 172.21.15.1:0/2733437912 shutdown_connections 2024-09-12T02:30:48.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.918+0000 7f0af2227640 1 -- 172.21.15.1:0/2733437912 wait complete. 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 Processor -- start 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 -- start start 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec102d20 0x7f0aec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec10d8b0 con 0x7f0aec1036e0 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec10d730 con 0x7f0aec101b30 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0af2227640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec10da30 con 0x7f0aec102d20 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.919+0000 7f0aebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39346/0 (socket says 172.21.15.1:39346) 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 -- 172.21.15.1:0/4048479853 learned_addr learned my addr 172.21.15.1:0/4048479853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aeaffd640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec102d20 0x7f0aec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aeb7fe640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 -- 172.21.15.1:0/4048479853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec102d20 msgr2=0x7f0aec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec102d20 0x7f0aec0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 -- 172.21.15.1:0/4048479853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 msgr2=0x7f0aec075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 -- 172.21.15.1:0/4048479853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec0753b0 con 0x7f0aec1036e0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aeb7fe640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0aebfff640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b970 tx=0x7f0ae400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4019070 con 0x7f0aec1036e0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec1a20e0 con 0x7f0aec1036e0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae400cb40 con 0x7f0aec1036e0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4007610 con 0x7f0aec1036e0 2024-09-12T02:30:48.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.920+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1a26d0 con 0x7f0aec1036e0 2024-09-12T02:30:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.921+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec109010 con 0x7f0aec1036e0 2024-09-12T02:30:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.922+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0ae401c070 con 0x7f0aec1036e0 2024-09-12T02:30:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.923+0000 7f0ae8ff9640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 0x7f0ad40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.923+0000 7f0aeb7fe640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 0x7f0ad40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.923+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0ae40ce6c0 con 0x7f0aec1036e0 2024-09-12T02:30:48.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.924+0000 7f0aeb7fe640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 0x7f0ad40a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aec102b80 tx=0x7f0adc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:48.927+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ae409af50 con 0x7f0aec1036e0 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.107+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aec062df0 con 0x7f0aec1036e0 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.108+0000 7f0ae8ff9640 1 -- 172.21.15.1:0/4048479853 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7f0ae409f250 con 0x7f0aec1036e0 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 msgr2=0x7f0ad40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 0x7f0ad40a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aec102b80 tx=0x7f0adc008040 comp rx=0 tx=0).stop 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 msgr2=0x7f0aec074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400b970 tx=0x7f0ae400be30 comp rx=0 tx=0).stop 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 shutdown_connections 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0ad40a2b90 0x7f0ad40a5050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0aec1036e0 0x7f0aec074b20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec102d20 0x7f0aec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 --2- 172.21.15.1:0/4048479853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aec101b30 0x7f0aec075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 >> 172.21.15.1:0/4048479853 conn(0x7f0aec0fd2b0 msgr2=0x7f0aec1061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 shutdown_connections 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.111+0000 7f0af2227640 1 -- 172.21.15.1:0/4048479853 wait complete. 2024-09-12T02:30:49.121 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:30:49.122 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:24:10.372859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:28:48.794744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:28:50.955400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:30:49.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:30:49.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:48 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:30:49.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:48 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:30:49.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- 172.21.15.1:0/3366267164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 msgr2=0x7f6e84104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/3366267164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84104a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009900 tx=0x7f6e7402a410 comp rx=0 tx=0).stop 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- 172.21.15.1:0/3366267164 shutdown_connections 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/3366267164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/3366267164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 0x7f6e84107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/3366267164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84104a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- 172.21.15.1:0/3366267164 >> 172.21.15.1:0/3366267164 conn(0x7f6e840fc140 msgr2=0x7f6e840fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- 172.21.15.1:0/3366267164 shutdown_connections 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- 172.21.15.1:0/3366267164 wait complete. 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 Processor -- start 2024-09-12T02:30:49.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 -- start start 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.229+0000 7f6e8aef1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 0x7f6e841005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410d7c0 con 0x7f6e84102620 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410d640 con 0x7f6e84107880 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410d940 con 0x7f6e84104f50 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39364/0 (socket says 172.21.15.1:39364) 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 -- 172.21.15.1:0/1631107258 learned_addr learned my addr 172.21.15.1:0/1631107258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e83fff640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 0x7f6e841005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8948e640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 -- 172.21.15.1:0/1631107258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 msgr2=0x7f6e841005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 0x7f6e841005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 -- 172.21.15.1:0/1631107258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 msgr2=0x7f6e84100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 -- 172.21.15.1:0/1631107258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e841013a0 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8948e640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e88c8d640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009230 tx=0x7f6e74004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7403f030 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e74003ce0 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e841a1fe0 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.230+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74035070 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.231+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e841a23f0 con 0x7f6e84102620 2024-09-12T02:30:49.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.232+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e840fdc30 con 0x7f6e84102620 2024-09-12T02:30:49.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.233+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6e74042030 con 0x7f6e84102620 2024-09-12T02:30:49.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.234+0000 7f6e81ffb640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 0x7f6e6c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.234+0000 7f6e83fff640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 0x7f6e6c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.234+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6e740efa50 con 0x7f6e84102620 2024-09-12T02:30:49.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.234+0000 7f6e83fff640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 0x7f6e6c0a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e84101d00 tx=0x7f6e7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.238+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e740bc930 con 0x7f6e84102620 2024-09-12T02:30:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.413+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e84062f30 con 0x7f6e84102620 2024-09-12T02:30:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.413+0000 7f6e81ffb640 1 -- 172.21.15.1:0/1631107258 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f6e740bc230 con 0x7f6e84102620 2024-09-12T02:30:49.416 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-12T02:30:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 msgr2=0x7f6e6c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 0x7f6e6c0a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e84101d00 tx=0x7f6e7800b390 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 msgr2=0x7f6e84101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009230 tx=0x7f6e74004360 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 shutdown_connections 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e6c0a2b90 0x7f6e6c0a5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e84107880 0x7f6e84100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e84104f50 0x7f6e841005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.415+0000 7f6e8aef1640 1 --2- 172.21.15.1:0/1631107258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e84102620 0x7f6e84101f90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.416+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 >> 172.21.15.1:0/1631107258 conn(0x7f6e840fc140 msgr2=0x7f6e84102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.416+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 shutdown_connections 2024-09-12T02:30:49.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.416+0000 7f6e8aef1640 1 -- 172.21.15.1:0/1631107258 wait complete. 2024-09-12T02:30:49.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/311782225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 msgr2=0x7fb4e0100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/311782225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0100e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009900 tx=0x7fb4d002a410 comp rx=0 tx=0).stop 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/311782225 shutdown_connections 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/311782225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 0x7fb4e0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/311782225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/311782225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0100e00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/311782225 >> 172.21.15.1:0/311782225 conn(0x7fb4e00fc160 msgr2=0x7fb4e00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/311782225 shutdown_connections 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/311782225 wait complete. 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 Processor -- start 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.555+0000 7fb4e6ae6640 1 -- start start 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 0x7fb4e019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e010c6d0 con 0x7fb4e0100a00 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e010c550 con 0x7fb4e01025b0 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e010c850 con 0x7fb4e0101bf0 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39384/0 (socket says 172.21.15.1:39384) 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 -- 172.21.15.1:0/2286208311 learned_addr learned my addr 172.21.15.1:0/2286208311 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e5083640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 0x7fb4e019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4dffff640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 -- 172.21.15.1:0/2286208311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 msgr2=0x7fb4e01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 -- 172.21.15.1:0/2286208311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 msgr2=0x7fb4e019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 0x7fb4e019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 -- 172.21.15.1:0/2286208311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e019fad0 con 0x7fb4e0100a00 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4dffff640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e4882640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0031440 tx=0x7fb4d0032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d003f030 con 0x7fb4e0100a00 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4d0003ce0 con 0x7fb4e0100a00 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e019fd60 con 0x7fb4e0100a00 2024-09-12T02:30:49.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.556+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0035070 con 0x7fb4e0100a00 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.557+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01a01e0 con 0x7fb4e0100a00 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.558+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e01a0410 con 0x7fb4e0100a00 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.559+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb4d0042030 con 0x7fb4e0100a00 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.560+0000 7fb4ddffb640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 0x7fb4cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.560+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb4d00efa50 con 0x7fb4e0100a00 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.560+0000 7fb4dffff640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 0x7fb4cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.560+0000 7fb4dffff640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 0x7fb4cc0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4e01993c0 tx=0x7fb4c8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.563+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4d00bc930 con 0x7fb4e0100a00 2024-09-12T02:30:49.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.739+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb4e01a0700 con 0x7fb4e0100a00 2024-09-12T02:30:49.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.739+0000 7fb4ddffb640 1 -- 172.21.15.1:0/2286208311 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fb4d00bc230 con 0x7fb4e0100a00 2024-09-12T02:30:49.745 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-12T02:30:49.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 msgr2=0x7fb4cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 0x7fb4cc0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4e01993c0 tx=0x7fb4c8005e50 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 msgr2=0x7fb4e0197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0031440 tx=0x7fb4d0032e20 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 shutdown_connections 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4cc0a2c10 0x7fb4cc0a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e01025b0 0x7fb4e019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0101bf0 0x7fb4e01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 --2- 172.21.15.1:0/2286208311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4e0100a00 0x7fb4e0197eb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.741+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 >> 172.21.15.1:0/2286208311 conn(0x7fb4e00fc160 msgr2=0x7fb4e006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.742+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 shutdown_connections 2024-09-12T02:30:49.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.742+0000 7fb4e6ae6640 1 -- 172.21.15.1:0/2286208311 wait complete. 2024-09-12T02:30:49.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- 172.21.15.1:0/2443747496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c104f10 msgr2=0x7f397c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- 172.21.15.1:0/2443747496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c104f10 0x7f397c107300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f396c009900 tx=0x7f396c02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- 172.21.15.1:0/2443747496 shutdown_connections 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- 172.21.15.1:0/2443747496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c104f10 0x7f397c107300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- 172.21.15.1:0/2443747496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c107840 0x7f397c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- 172.21.15.1:0/2443747496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 0x7f397c1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- 172.21.15.1:0/2443747496 >> 172.21.15.1:0/2443747496 conn(0x7f397c0fc140 msgr2=0x7f397c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- 172.21.15.1:0/2443747496 shutdown_connections 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- 172.21.15.1:0/2443747496 wait complete. 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 Processor -- start 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- start start 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 0x7f397c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c104f10 0x7f397c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10d7a0 con 0x7f397c107840 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10d620 con 0x7f397c1025e0 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.880+0000 7f398356d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f397c10d920 con 0x7f397c104f10 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39406/0 (socket says 172.21.15.1:39406) 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 -- 172.21.15.1:0/72033262 learned_addr learned my addr 172.21.15.1:0/72033262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3980b08640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c104f10 0x7f397c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981309640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 0x7f397c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 -- 172.21.15.1:0/72033262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c104f10 msgr2=0x7f397c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c104f10 0x7f397c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 -- 172.21.15.1:0/72033262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 msgr2=0x7f397c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 0x7f397c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 -- 172.21.15.1:0/72033262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c19fa80 con 0x7f397c107840 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f3981b0a640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f397400e9d0 tx=0x7f397400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397400cd80 con 0x7f397c107840 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3974005020 con 0x7f397c107840 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c19fd70 con 0x7f397c107840 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740116d0 con 0x7f397c107840 2024-09-12T02:30:49.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.881+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c1a01e0 con 0x7f397c107840 2024-09-12T02:30:49.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.882+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c0fdc30 con 0x7f397c107840 2024-09-12T02:30:49.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.884+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f39740051d0 con 0x7f397c107840 2024-09-12T02:30:49.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.884+0000 7f39727fc640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 0x7f39680a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:49.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.884+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f39740cf5e0 con 0x7f397c107840 2024-09-12T02:30:49.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.884+0000 7f3981309640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 0x7f39680a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:49.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.885+0000 7f3981309640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 0x7f39680a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3978005e10 tx=0x7f3978005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:49.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:49.887+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3974016030 con 0x7f397c107840 2024-09-12T02:30:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.065+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f397c062e90 con 0x7f397c107840 2024-09-12T02:30:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.066+0000 7f39727fc640 1 -- 172.21.15.1:0/72033262 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f397409c520 con 0x7f397c107840 2024-09-12T02:30:50.066 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-12T02:30:50.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 msgr2=0x7f39680a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:50.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 0x7f39680a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3978005e10 tx=0x7f3978005da0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 msgr2=0x7f397c19f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f397400e9d0 tx=0x7f397400ee90 comp rx=0 tx=0).stop 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 shutdown_connections 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f39680a2b90 0x7f39680a5050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f397c107840 0x7f397c19f410 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f397c104f10 0x7f397c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 --2- 172.21.15.1:0/72033262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c1025e0 0x7f397c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 >> 172.21.15.1:0/72033262 conn(0x7f397c0fc140 msgr2=0x7f397c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 shutdown_connections 2024-09-12T02:30:50.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.068+0000 7f398356d640 1 -- 172.21.15.1:0/72033262 wait complete. 2024-09-12T02:30:50.081 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:49 smithi001 ceph-mon[31252]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:50.081 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:30:50.081 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:49 smithi001 ceph-mon[31252]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:30:50.081 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4048479853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:50.081 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:49 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1631107258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:50.082 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T02:30:50.082 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:49 smithi134 ceph-mon[35091]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:49 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:30:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:49 smithi134 ceph-mon[35091]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:30:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:49 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/4048479853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:49 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1631107258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:49 smithi173 ceph-mon[35036]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:30:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:49 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2556169965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:30:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:49 smithi173 ceph-mon[35036]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:30:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:49 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/4048479853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:49 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1631107258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:50.341 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.906+0000 7f4082bcb640 1 -- 172.21.15.1:0/2863386155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c101420 msgr2=0x7f407c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.906+0000 7f4082bcb640 1 --2- 172.21.15.1:0/2863386155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c101420 0x7f407c10d950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4074009cd0 tx=0x7f407402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 -- 172.21.15.1:0/2863386155 shutdown_connections 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 --2- 172.21.15.1:0/2863386155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c101420 0x7f407c10d950 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 --2- 172.21.15.1:0/2863386155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c100a80 0x7f407c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 --2- 172.21.15.1:0/2863386155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c106a80 0x7f407c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 -- 172.21.15.1:0/2863386155 >> 172.21.15.1:0/2863386155 conn(0x7f407c0fc7a0 msgr2=0x7f407c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 -- 172.21.15.1:0/2863386155 shutdown_connections 2024-09-12T02:30:50.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 -- 172.21.15.1:0/2863386155 wait complete. 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 Processor -- start 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 -- start start 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.907+0000 7f4082bcb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c100a80 0x7f407c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c101420 0x7f407c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f407c111fa0 con 0x7f407c106a80 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f407c111e20 con 0x7f407c101420 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f407c112120 con 0x7f407c100a80 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39424/0 (socket says 172.21.15.1:39424) 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 -- 172.21.15.1:0/4141068098 learned_addr learned my addr 172.21.15.1:0/4141068098 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4080967640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c100a80 0x7f407c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:50.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f407bfff640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c101420 0x7f407c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 -- 172.21.15.1:0/4141068098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c100a80 msgr2=0x7f407c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c100a80 0x7f407c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 -- 172.21.15.1:0/4141068098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c101420 msgr2=0x7f407c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c101420 0x7f407c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 -- 172.21.15.1:0/4141068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407c19d3d0 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4081168640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4074005cc0 tx=0x7f4074003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004040 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40740046c0 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407c19d660 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.908+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074046480 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.909+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407c1a4fa0 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.910+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f407c100ee0 con 0x7f407c106a80 2024-09-12T02:30:50.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.911+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f40740305a0 con 0x7f407c106a80 2024-09-12T02:30:50.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.912+0000 7f4079ffb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 0x7f406c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:50.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.912+0000 7f4080967640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 0x7f406c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:50.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.912+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f407402e030 con 0x7f407c106a80 2024-09-12T02:30:50.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.912+0000 7f4080967640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 0x7f406c0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4070005fd0 tx=0x7f407000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:50.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:50.915+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f407404b060 con 0x7f407c106a80 2024-09-12T02:30:51.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:50 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2286208311' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:50 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/72033262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.127+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f407c109010 con 0x7f407c106a80 2024-09-12T02:30:51.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.127+0000 7f4079ffb640 1 -- 172.21.15.1:0/4141068098 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f40740bd940 con 0x7f407c106a80 2024-09-12T02:30:51.128 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:51.128 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:30:51.128 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.129+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 msgr2=0x7f406c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.129+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 0x7f406c0a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4070005fd0 tx=0x7f407000b390 comp rx=0 tx=0).stop 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 msgr2=0x7f407c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4074005cc0 tx=0x7f4074003970 comp rx=0 tx=0).stop 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 shutdown_connections 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f406c0a2b80 0x7f406c0a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f407c106a80 0x7f407c19ccf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f407c101420 0x7f407c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:51.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 --2- 172.21.15.1:0/4141068098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f407c100a80 0x7f407c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:51.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 >> 172.21.15.1:0/4141068098 conn(0x7f407c0fc7a0 msgr2=0x7f407c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:51.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 shutdown_connections 2024-09-12T02:30:51.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:51.130+0000 7f4082bcb640 1 -- 172.21.15.1:0/4141068098 wait complete. 2024-09-12T02:30:51.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:50 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2286208311' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:50 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/72033262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:50 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2286208311' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:50 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/72033262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:51 smithi001 ceph-mon[31252]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:30:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:51 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/4141068098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:51.943 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T02:30:51.943 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T02:30:51.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:30:52.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.054+0000 7f0ded16d640 1 -- 172.21.15.1:0/3052443684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 msgr2=0x7f0de8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.054+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3052443684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de8109c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009ca0 tx=0x7f0de002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 -- 172.21.15.1:0/3052443684 shutdown_connections 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3052443684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de8109c80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3052443684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 0x7f0de81072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3052443684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 0x7f0de81049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 -- 172.21.15.1:0/3052443684 >> 172.21.15.1:0/3052443684 conn(0x7f0de80fc1b0 msgr2=0x7f0de80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 -- 172.21.15.1:0/3052443684 shutdown_connections 2024-09-12T02:30:52.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 -- 172.21.15.1:0/3052443684 wait complete. 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.055+0000 7f0ded16d640 1 Processor -- start 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 -- start start 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 0x7f0de8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 0x7f0de8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810d7f0 con 0x7f0de8107810 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810d670 con 0x7f0de81025b0 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0ded16d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810d970 con 0x7f0de8104ee0 2024-09-12T02:30:52.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59090/0 (socket says 172.21.15.1:59090) 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 -- 172.21.15.1:0/3757743109 learned_addr learned my addr 172.21.15.1:0/3757743109 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de659c640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 0x7f0de8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de6d9d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 0x7f0de8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 -- 172.21.15.1:0/3757743109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 msgr2=0x7f0de8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 0x7f0de8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 -- 172.21.15.1:0/3757743109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 msgr2=0x7f0de8197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 0x7f0de8197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 -- 172.21.15.1:0/3757743109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de819fa30 con 0x7f0de8107810 2024-09-12T02:30:52.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.056+0000 7f0de759e640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0de002f540 tx=0x7f0de0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.057+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0003b70 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.057+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de0003d10 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.057+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de819fcc0 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.057+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de002fc80 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.057+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de81a0200 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.058+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de80fdca0 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.059+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0de0004050 con 0x7f0de8107810 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.059+0000 7f0dcffff640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 0x7f0dd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.060+0000 7f0de6d9d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 0x7f0dd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.060+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0de00f0170 con 0x7f0de8107810 2024-09-12T02:30:52.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.060+0000 7f0de6d9d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 0x7f0dd00a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800abe0 tx=0x7f0dd800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.064+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0de00bd170 con 0x7f0de8107810 2024-09-12T02:30:52.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:51 smithi134 ceph-mon[35091]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:30:52.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:51 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/4141068098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:51 smithi173 ceph-mon[35036]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:30:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:51 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/4141068098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:52.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.236+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0de8062630 con 0x7f0dd00a2c10 2024-09-12T02:30:52.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.242+0000 7f0dcffff640 1 -- 172.21.15.1:0/3757743109 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259140 (secure 0 0 0) 0x7f0de8062630 con 0x7f0dd00a2c10 2024-09-12T02:30:52.245 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:52.249 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:30:52.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 msgr2=0x7f0dd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 0x7f0dd00a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800abe0 tx=0x7f0dd800a2d0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 msgr2=0x7f0de819f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0de002f540 tx=0x7f0de0031ee0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 shutdown_connections 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.245+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0dd00a2c10 0x7f0dd00a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de8107810 0x7f0de819f3c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0de8104ee0 0x7f0de8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 --2- 172.21.15.1:0/3757743109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0de81025b0 0x7f0de8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 >> 172.21.15.1:0/3757743109 conn(0x7f0de80fc1b0 msgr2=0x7f0de8102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 shutdown_connections 2024-09-12T02:30:52.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.246+0000 7f0ded16d640 1 -- 172.21.15.1:0/3757743109 wait complete. 2024-09-12T02:30:52.259 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-12T02:30:51.997077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660785,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1217,"num_read_kb":729,"num_write":444,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381148,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560676,"statfs":{"total":1151940427776,"available":1151550132224,"internally_reserved":0,"allocated":11366400,"data_stored":7197627,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002863"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976962+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.976962+0000","last_peered":"2024-09-12T02:30:23.976962+0000","last_clean":"2024-09-12T02:30:23.976962+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.976962+0000","last_undegraded":"2024-09-12T02:30:23.976962+0000","last_fullsized":"2024-09-12T02:30:23.976962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965517+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.965517+0000","last_peered":"2024-09-12T02:30:23.965517+0000","last_clean":"2024-09-12T02:30:23.965517+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.965517+0000","last_undegraded":"2024-09-12T02:30:23.965517+0000","last_fullsized":"2024-09-12T02:30:23.965517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976447+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976447+0000","last_peered":"2024-09-12T02:30:23.976447+0000","last_clean":"2024-09-12T02:30:23.976447+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976447+0000","last_undegraded":"2024-09-12T02:30:23.976447+0000","last_fullsized":"2024-09-12T02:30:23.976447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966068+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966068+0000","last_peered":"2024-09-12T02:30:23.966068+0000","last_clean":"2024-09-12T02:30:23.966068+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966068+0000","last_undegraded":"2024-09-12T02:30:23.966068+0000","last_fullsized":"2024-09-12T02:30:23.966068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.962180+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.962180+0000","last_peered":"2024-09-12T02:30:23.962180+0000","last_clean":"2024-09-12T02:30:23.962180+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.962180+0000","last_undegraded":"2024-09-12T02:30:23.962180+0000","last_fullsized":"2024-09-12T02:30:23.962180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.964055+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.964055+0000","last_peered":"2024-09-12T02:30:23.964055+0000","last_clean":"2024-09-12T02:30:23.964055+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.964055+0000","last_undegraded":"2024-09-12T02:30:23.964055+0000","last_fullsized":"2024-09-12T02:30:23.964055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968197+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968197+0000","last_peered":"2024-09-12T02:30:23.968197+0000","last_clean":"2024-09-12T02:30:23.968197+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968197+0000","last_undegraded":"2024-09-12T02:30:23.968197+0000","last_fullsized":"2024-09-12T02:30:23.968197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970327+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970327+0000","last_peered":"2024-09-12T02:30:23.970327+0000","last_clean":"2024-09-12T02:30:23.970327+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970327+0000","last_undegraded":"2024-09-12T02:30:23.970327+0000","last_fullsized":"2024-09-12T02:30:23.970327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183072+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:49.183072+0000","last_peered":"2024-09-12T02:30:49.183072+0000","last_clean":"2024-09-12T02:30:49.183072+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:49.183072+0000","last_undegraded":"2024-09-12T02:30:49.183072+0000","last_fullsized":"2024-09-12T02:30:49.183072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":237,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182613+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:49.182613+0000","last_peered":"2024-09-12T02:30:49.182613+0000","last_clean":"2024-09-12T02:30:49.182613+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:49.182613+0000","last_undegraded":"2024-09-12T02:30:49.182613+0000","last_fullsized":"2024-09-12T02:30:49.182613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182588+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:49.182588+0000","last_peered":"2024-09-12T02:30:49.182588+0000","last_clean":"2024-09-12T02:30:49.182588+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:49.182588+0000","last_undegraded":"2024-09-12T02:30:49.182588+0000","last_fullsized":"2024-09-12T02:30:49.182588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":170,"num_write":38,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183058+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:49.183058+0000","last_peered":"2024-09-12T02:30:49.183058+0000","last_clean":"2024-09-12T02:30:49.183058+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:49.183058+0000","last_undegraded":"2024-09-12T02:30:49.183058+0000","last_fullsized":"2024-09-12T02:30:49.183058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:48.194163+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:48.194163+0000","last_peered":"2024-09-12T02:30:48.194163+0000","last_clean":"2024-09-12T02:30:48.194163+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:48.194163+0000","last_undegraded":"2024-09-12T02:30:48.194163+0000","last_fullsized":"2024-09-12T02:30:48.194163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639878+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639878+0000","last_peered":"2024-09-12T02:29:55.639878+0000","last_clean":"2024-09-12T02:29:55.639878+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639878+0000","last_undegraded":"2024-09-12T02:29:55.639878+0000","last_fullsized":"2024-09-12T02:29:55.639878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644440+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644440+0000","last_peered":"2024-09-12T02:29:55.644440+0000","last_clean":"2024-09-12T02:29:55.644440+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644440+0000","last_undegraded":"2024-09-12T02:29:55.644440+0000","last_fullsized":"2024-09-12T02:29:55.644440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971872+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.971872+0000","last_peered":"2024-09-12T02:30:23.971872+0000","last_clean":"2024-09-12T02:30:23.971872+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.971872+0000","last_undegraded":"2024-09-12T02:30:23.971872+0000","last_fullsized":"2024-09-12T02:30:23.971872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.178597+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:46.178597+0000","last_peered":"2024-09-12T02:30:46.178597+0000","last_clean":"2024-09-12T02:30:46.178597+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:46.178597+0000","last_undegraded":"2024-09-12T02:30:46.178597+0000","last_fullsized":"2024-09-12T02:30:46.178597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968950+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.968950+0000","last_peered":"2024-09-12T02:30:23.968950+0000","last_clean":"2024-09-12T02:30:23.968950+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.968950+0000","last_undegraded":"2024-09-12T02:30:23.968950+0000","last_fullsized":"2024-09-12T02:30:23.968950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.665129+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:46.665129+0000","last_peered":"2024-09-12T02:30:46.665129+0000","last_clean":"2024-09-12T02:30:46.665129+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:46.665129+0000","last_undegraded":"2024-09-12T02:30:46.665129+0000","last_fullsized":"2024-09-12T02:30:46.665129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961529+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961529+0000","last_peered":"2024-09-12T02:30:23.961529+0000","last_clean":"2024-09-12T02:30:23.961529+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961529+0000","last_undegraded":"2024-09-12T02:30:23.961529+0000","last_fullsized":"2024-09-12T02:30:23.961529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585850+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.585850+0000","last_peered":"2024-09-12T02:29:55.585850+0000","last_clean":"2024-09-12T02:29:55.585850+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.585850+0000","last_undegraded":"2024-09-12T02:29:55.585850+0000","last_fullsized":"2024-09-12T02:29:55.585850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.958029+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.958029+0000","last_peered":"2024-09-12T02:30:23.958029+0000","last_clean":"2024-09-12T02:30:23.958029+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.958029+0000","last_undegraded":"2024-09-12T02:30:23.958029+0000","last_fullsized":"2024-09-12T02:30:23.958029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587785+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587785+0000","last_peered":"2024-09-12T02:29:55.587785+0000","last_clean":"2024-09-12T02:29:55.587785+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587785+0000","last_undegraded":"2024-09-12T02:29:55.587785+0000","last_fullsized":"2024-09-12T02:29:55.587785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971977+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.971977+0000","last_peered":"2024-09-12T02:30:23.971977+0000","last_clean":"2024-09-12T02:30:23.971977+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.971977+0000","last_undegraded":"2024-09-12T02:30:23.971977+0000","last_fullsized":"2024-09-12T02:30:23.971977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640246+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640246+0000","last_peered":"2024-09-12T02:29:55.640246+0000","last_clean":"2024-09-12T02:29:55.640246+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640246+0000","last_undegraded":"2024-09-12T02:29:55.640246+0000","last_fullsized":"2024-09-12T02:29:55.640246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638722+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638722+0000","last_peered":"2024-09-12T02:29:55.638722+0000","last_clean":"2024-09-12T02:29:55.638722+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638722+0000","last_undegraded":"2024-09-12T02:29:55.638722+0000","last_fullsized":"2024-09-12T02:29:55.638722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.933510+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.933510+0000","last_peered":"2024-09-12T02:30:23.933510+0000","last_clean":"2024-09-12T02:30:23.933510+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.933510+0000","last_undegraded":"2024-09-12T02:30:23.933510+0000","last_fullsized":"2024-09-12T02:30:23.933510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585664+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585664+0000","last_peered":"2024-09-12T02:29:55.585664+0000","last_clean":"2024-09-12T02:29:55.585664+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585664+0000","last_undegraded":"2024-09-12T02:29:55.585664+0000","last_fullsized":"2024-09-12T02:29:55.585664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585044+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:55.585044+0000","last_peered":"2024-09-12T02:29:55.585044+0000","last_clean":"2024-09-12T02:29:55.585044+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:55.585044+0000","last_undegraded":"2024-09-12T02:29:55.585044+0000","last_fullsized":"2024-09-12T02:29:55.585044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976332+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976332+0000","last_peered":"2024-09-12T02:30:23.976332+0000","last_clean":"2024-09-12T02:30:23.976332+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976332+0000","last_undegraded":"2024-09-12T02:30:23.976332+0000","last_fullsized":"2024-09-12T02:30:23.976332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961625+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961625+0000","last_peered":"2024-09-12T02:30:23.961625+0000","last_clean":"2024-09-12T02:30:23.961625+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961625+0000","last_undegraded":"2024-09-12T02:30:23.961625+0000","last_fullsized":"2024-09-12T02:30:23.961625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.664551+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:46.664551+0000","last_peered":"2024-09-12T02:30:46.664551+0000","last_clean":"2024-09-12T02:30:46.664551+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:46.664551+0000","last_undegraded":"2024-09-12T02:30:46.664551+0000","last_fullsized":"2024-09-12T02:30:46.664551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70183,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1091,"num_read_kb":620,"num_write":261,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1089746,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499159,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499277,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:52.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:30:52.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 -- 172.21.15.1:0/1861079527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7781025e0 msgr2=0x7fe778108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 --2- 172.21.15.1:0/1861079527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7781025e0 0x7fe778108e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe770009ca0 tx=0x7fe77002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 -- 172.21.15.1:0/1861079527 shutdown_connections 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 --2- 172.21.15.1:0/1861079527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7781025e0 0x7fe778108e70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 --2- 172.21.15.1:0/1861079527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe778101c20 0x7fe7781020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 --2- 172.21.15.1:0/1861079527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778100a30 0x7fe778100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 -- 172.21.15.1:0/1861079527 >> 172.21.15.1:0/1861079527 conn(0x7fe7780fc190 msgr2=0x7fe7780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 -- 172.21.15.1:0/1861079527 shutdown_connections 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.402+0000 7fe77f81e640 1 -- 172.21.15.1:0/1861079527 wait complete. 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 Processor -- start 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 -- start start 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 0x7fe778198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 0x7fe77819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810d800 con 0x7fe778100a30 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810d680 con 0x7fe7781025e0 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77f81e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810d980 con 0x7fe778101c20 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77d5ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77d5ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59100/0 (socket says 172.21.15.1:59100) 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77d5ba640 1 -- 172.21.15.1:0/253842008 learned_addr learned my addr 172.21.15.1:0/253842008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.403+0000 7fe77ddbb640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 0x7fe77819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77cdb9640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 0x7fe778198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 -- 172.21.15.1:0/253842008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 msgr2=0x7fe778198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 0x7fe778198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 -- 172.21.15.1:0/253842008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 msgr2=0x7fe77819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 0x7fe77819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 -- 172.21.15.1:0/253842008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77819fa70 con 0x7fe778100a30 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77ddbb640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 0x7fe77819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77cdb9640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 0x7fe778198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77d5ba640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe77400d950 tx=0x7fe77400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774017070 con 0x7fe778100a30 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe774009c30 con 0x7fe778100a30 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77819fd60 con 0x7fe778100a30 2024-09-12T02:30:52.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77400f600 con 0x7fe778100a30 2024-09-12T02:30:52.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.404+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a01a0 con 0x7fe778100a30 2024-09-12T02:30:52.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.405+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778107e70 con 0x7fe778100a30 2024-09-12T02:30:52.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.407+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe77401a070 con 0x7fe778100a30 2024-09-12T02:30:52.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.408+0000 7fe76e7fc640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 0x7fe7640a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.408+0000 7fe77cdb9640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 0x7fe7640a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.408+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe7740ceba0 con 0x7fe778100a30 2024-09-12T02:30:52.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.408+0000 7fe77cdb9640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 0x7fe7640a5050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe778199360 tx=0x7fe768005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.411+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7740cee20 con 0x7fe778100a30 2024-09-12T02:30:52.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.595+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe778062630 con 0x7fe7640a2b90 2024-09-12T02:30:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.601+0000 7fe76e7fc640 1 -- 172.21.15.1:0/253842008 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259140 (secure 0 0 0) 0x7fe778062630 con 0x7fe7640a2b90 2024-09-12T02:30:52.607 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:30:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 msgr2=0x7fe7640a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 0x7fe7640a5050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe778199360 tx=0x7fe768005d30 comp rx=0 tx=0).stop 2024-09-12T02:30:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 msgr2=0x7fe778197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe77400d950 tx=0x7fe77400de10 comp rx=0 tx=0).stop 2024-09-12T02:30:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 shutdown_connections 2024-09-12T02:30:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe7640a2b90 0x7fe7640a5050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7781025e0 0x7fe77819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe778101c20 0x7fe778198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 --2- 172.21.15.1:0/253842008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe778100a30 0x7fe778197e50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 >> 172.21.15.1:0/253842008 conn(0x7fe7780fc190 msgr2=0x7fe778105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 shutdown_connections 2024-09-12T02:30:52.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.604+0000 7fe77f81e640 1 -- 172.21.15.1:0/253842008 wait complete. 2024-09-12T02:30:52.616 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-12T02:30:51.997077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660785,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1217,"num_read_kb":729,"num_write":444,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381148,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560676,"statfs":{"total":1151940427776,"available":1151550132224,"internally_reserved":0,"allocated":11366400,"data_stored":7197627,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002863"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976962+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.976962+0000","last_peered":"2024-09-12T02:30:23.976962+0000","last_clean":"2024-09-12T02:30:23.976962+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.976962+0000","last_undegraded":"2024-09-12T02:30:23.976962+0000","last_fullsized":"2024-09-12T02:30:23.976962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965517+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.965517+0000","last_peered":"2024-09-12T02:30:23.965517+0000","last_clean":"2024-09-12T02:30:23.965517+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.965517+0000","last_undegraded":"2024-09-12T02:30:23.965517+0000","last_fullsized":"2024-09-12T02:30:23.965517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976447+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976447+0000","last_peered":"2024-09-12T02:30:23.976447+0000","last_clean":"2024-09-12T02:30:23.976447+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976447+0000","last_undegraded":"2024-09-12T02:30:23.976447+0000","last_fullsized":"2024-09-12T02:30:23.976447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966068+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966068+0000","last_peered":"2024-09-12T02:30:23.966068+0000","last_clean":"2024-09-12T02:30:23.966068+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966068+0000","last_undegraded":"2024-09-12T02:30:23.966068+0000","last_fullsized":"2024-09-12T02:30:23.966068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.962180+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.962180+0000","last_peered":"2024-09-12T02:30:23.962180+0000","last_clean":"2024-09-12T02:30:23.962180+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.962180+0000","last_undegraded":"2024-09-12T02:30:23.962180+0000","last_fullsized":"2024-09-12T02:30:23.962180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.964055+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.964055+0000","last_peered":"2024-09-12T02:30:23.964055+0000","last_clean":"2024-09-12T02:30:23.964055+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.964055+0000","last_undegraded":"2024-09-12T02:30:23.964055+0000","last_fullsized":"2024-09-12T02:30:23.964055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968197+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968197+0000","last_peered":"2024-09-12T02:30:23.968197+0000","last_clean":"2024-09-12T02:30:23.968197+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968197+0000","last_undegraded":"2024-09-12T02:30:23.968197+0000","last_fullsized":"2024-09-12T02:30:23.968197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970327+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970327+0000","last_peered":"2024-09-12T02:30:23.970327+0000","last_clean":"2024-09-12T02:30:23.970327+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970327+0000","last_undegraded":"2024-09-12T02:30:23.970327+0000","last_fullsized":"2024-09-12T02:30:23.970327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183072+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:49.183072+0000","last_peered":"2024-09-12T02:30:49.183072+0000","last_clean":"2024-09-12T02:30:49.183072+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:49.183072+0000","last_undegraded":"2024-09-12T02:30:49.183072+0000","last_fullsized":"2024-09-12T02:30:49.183072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":237,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182613+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:49.182613+0000","last_peered":"2024-09-12T02:30:49.182613+0000","last_clean":"2024-09-12T02:30:49.182613+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:49.182613+0000","last_undegraded":"2024-09-12T02:30:49.182613+0000","last_fullsized":"2024-09-12T02:30:49.182613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182588+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:49.182588+0000","last_peered":"2024-09-12T02:30:49.182588+0000","last_clean":"2024-09-12T02:30:49.182588+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:49.182588+0000","last_undegraded":"2024-09-12T02:30:49.182588+0000","last_fullsized":"2024-09-12T02:30:49.182588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":170,"num_write":38,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183058+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:49.183058+0000","last_peered":"2024-09-12T02:30:49.183058+0000","last_clean":"2024-09-12T02:30:49.183058+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:49.183058+0000","last_undegraded":"2024-09-12T02:30:49.183058+0000","last_fullsized":"2024-09-12T02:30:49.183058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:48.194163+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:48.194163+0000","last_peered":"2024-09-12T02:30:48.194163+0000","last_clean":"2024-09-12T02:30:48.194163+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:48.194163+0000","last_undegraded":"2024-09-12T02:30:48.194163+0000","last_fullsized":"2024-09-12T02:30:48.194163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639878+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639878+0000","last_peered":"2024-09-12T02:29:55.639878+0000","last_clean":"2024-09-12T02:29:55.639878+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639878+0000","last_undegraded":"2024-09-12T02:29:55.639878+0000","last_fullsized":"2024-09-12T02:29:55.639878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644440+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644440+0000","last_peered":"2024-09-12T02:29:55.644440+0000","last_clean":"2024-09-12T02:29:55.644440+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644440+0000","last_undegraded":"2024-09-12T02:29:55.644440+0000","last_fullsized":"2024-09-12T02:29:55.644440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971872+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.971872+0000","last_peered":"2024-09-12T02:30:23.971872+0000","last_clean":"2024-09-12T02:30:23.971872+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.971872+0000","last_undegraded":"2024-09-12T02:30:23.971872+0000","last_fullsized":"2024-09-12T02:30:23.971872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.178597+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:46.178597+0000","last_peered":"2024-09-12T02:30:46.178597+0000","last_clean":"2024-09-12T02:30:46.178597+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:46.178597+0000","last_undegraded":"2024-09-12T02:30:46.178597+0000","last_fullsized":"2024-09-12T02:30:46.178597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968950+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.968950+0000","last_peered":"2024-09-12T02:30:23.968950+0000","last_clean":"2024-09-12T02:30:23.968950+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.968950+0000","last_undegraded":"2024-09-12T02:30:23.968950+0000","last_fullsized":"2024-09-12T02:30:23.968950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.665129+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:46.665129+0000","last_peered":"2024-09-12T02:30:46.665129+0000","last_clean":"2024-09-12T02:30:46.665129+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:46.665129+0000","last_undegraded":"2024-09-12T02:30:46.665129+0000","last_fullsized":"2024-09-12T02:30:46.665129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961529+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961529+0000","last_peered":"2024-09-12T02:30:23.961529+0000","last_clean":"2024-09-12T02:30:23.961529+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961529+0000","last_undegraded":"2024-09-12T02:30:23.961529+0000","last_fullsized":"2024-09-12T02:30:23.961529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585850+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.585850+0000","last_peered":"2024-09-12T02:29:55.585850+0000","last_clean":"2024-09-12T02:29:55.585850+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.585850+0000","last_undegraded":"2024-09-12T02:29:55.585850+0000","last_fullsized":"2024-09-12T02:29:55.585850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.958029+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.958029+0000","last_peered":"2024-09-12T02:30:23.958029+0000","last_clean":"2024-09-12T02:30:23.958029+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.958029+0000","last_undegraded":"2024-09-12T02:30:23.958029+0000","last_fullsized":"2024-09-12T02:30:23.958029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587785+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587785+0000","last_peered":"2024-09-12T02:29:55.587785+0000","last_clean":"2024-09-12T02:29:55.587785+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587785+0000","last_undegraded":"2024-09-12T02:29:55.587785+0000","last_fullsized":"2024-09-12T02:29:55.587785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971977+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.971977+0000","last_peered":"2024-09-12T02:30:23.971977+0000","last_clean":"2024-09-12T02:30:23.971977+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.971977+0000","last_undegraded":"2024-09-12T02:30:23.971977+0000","last_fullsized":"2024-09-12T02:30:23.971977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640246+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640246+0000","last_peered":"2024-09-12T02:29:55.640246+0000","last_clean":"2024-09-12T02:29:55.640246+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640246+0000","last_undegraded":"2024-09-12T02:29:55.640246+0000","last_fullsized":"2024-09-12T02:29:55.640246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638722+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638722+0000","last_peered":"2024-09-12T02:29:55.638722+0000","last_clean":"2024-09-12T02:29:55.638722+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638722+0000","last_undegraded":"2024-09-12T02:29:55.638722+0000","last_fullsized":"2024-09-12T02:29:55.638722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.933510+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.933510+0000","last_peered":"2024-09-12T02:30:23.933510+0000","last_clean":"2024-09-12T02:30:23.933510+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.933510+0000","last_undegraded":"2024-09-12T02:30:23.933510+0000","last_fullsized":"2024-09-12T02:30:23.933510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585664+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585664+0000","last_peered":"2024-09-12T02:29:55.585664+0000","last_clean":"2024-09-12T02:29:55.585664+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585664+0000","last_undegraded":"2024-09-12T02:29:55.585664+0000","last_fullsized":"2024-09-12T02:29:55.585664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585044+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:55.585044+0000","last_peered":"2024-09-12T02:29:55.585044+0000","last_clean":"2024-09-12T02:29:55.585044+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:55.585044+0000","last_undegraded":"2024-09-12T02:29:55.585044+0000","last_fullsized":"2024-09-12T02:29:55.585044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976332+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976332+0000","last_peered":"2024-09-12T02:30:23.976332+0000","last_clean":"2024-09-12T02:30:23.976332+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976332+0000","last_undegraded":"2024-09-12T02:30:23.976332+0000","last_fullsized":"2024-09-12T02:30:23.976332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961625+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961625+0000","last_peered":"2024-09-12T02:30:23.961625+0000","last_clean":"2024-09-12T02:30:23.961625+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961625+0000","last_undegraded":"2024-09-12T02:30:23.961625+0000","last_fullsized":"2024-09-12T02:30:23.961625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.664551+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:46.664551+0000","last_peered":"2024-09-12T02:30:46.664551+0000","last_clean":"2024-09-12T02:30:46.664551+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:46.664551+0000","last_undegraded":"2024-09-12T02:30:46.664551+0000","last_fullsized":"2024-09-12T02:30:46.664551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70183,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1091,"num_read_kb":620,"num_write":261,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1089746,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499159,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499277,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:52.620 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T02:30:52.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.760+0000 7f69a196d640 1 -- 172.21.15.1:0/501408526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 msgr2=0x7f699c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.760+0000 7f69a196d640 1 --2- 172.21.15.1:0/501408526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1031a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6984009900 tx=0x7f698402a410 comp rx=0 tx=0).stop 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 -- 172.21.15.1:0/501408526 shutdown_connections 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 --2- 172.21.15.1:0/501408526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1031a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 --2- 172.21.15.1:0/501408526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 --2- 172.21.15.1:0/501408526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 0x7f699c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 -- 172.21.15.1:0/501408526 >> 172.21.15.1:0/501408526 conn(0x7f699c0fd2b0 msgr2=0x7f699c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 -- 172.21.15.1:0/501408526 shutdown_connections 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 -- 172.21.15.1:0/501408526 wait complete. 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 Processor -- start 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.761+0000 7f69a196d640 1 -- start start 2024-09-12T02:30:52.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 0x7f699c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f699c10d790 con 0x7f699c102d20 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f699c10d610 con 0x7f699c1036e0 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f699c10d910 con 0x7f699c101b30 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59128/0 (socket says 172.21.15.1:59128) 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 -- 172.21.15.1:0/656989904 learned_addr learned my addr 172.21.15.1:0/656989904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699affd640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 0x7f699c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699b7fe640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 -- 172.21.15.1:0/656989904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 msgr2=0x7f699c197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 0x7f699c197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 -- 172.21.15.1:0/656989904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 msgr2=0x7f699c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 -- 172.21.15.1:0/656989904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c19fa90 con 0x7f699c102d20 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699b7fe640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f699a7fc640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6984009230 tx=0x7f6984004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698403f030 con 0x7f699c102d20 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6984003ce0 con 0x7f699c102d20 2024-09-12T02:30:52.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c19fd20 con 0x7f699c102d20 2024-09-12T02:30:52.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984035070 con 0x7f699c102d20 2024-09-12T02:30:52.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.762+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c1a01c0 con 0x7f699c102d20 2024-09-12T02:30:52.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.763+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c108ec0 con 0x7f699c102d20 2024-09-12T02:30:52.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.765+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6984042030 con 0x7f699c102d20 2024-09-12T02:30:52.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.765+0000 7f69a096b640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 0x7f69880a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:52.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.765+0000 7f699affd640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 0x7f69880a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:52.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.766+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f69840efaf0 con 0x7f699c102d20 2024-09-12T02:30:52.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.766+0000 7f699affd640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 0x7f69880a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f698c00a300 tx=0x7f698c00a290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:52.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.769+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69840bca30 con 0x7f699c102d20 2024-09-12T02:30:52.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.942+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f699c062630 con 0x7f69880a2b90 2024-09-12T02:30:52.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.948+0000 7f69a096b640 1 -- 172.21.15.1:0/656989904 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259140 (secure 0 0 0) 0x7f699c062630 con 0x7f69880a2b90 2024-09-12T02:30:52.952 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:52.953 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:30:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 msgr2=0x7f69880a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 0x7f69880a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f698c00a300 tx=0x7f698c00a290 comp rx=0 tx=0).stop 2024-09-12T02:30:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 msgr2=0x7f699c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6984009230 tx=0x7f6984004360 comp rx=0 tx=0).stop 2024-09-12T02:30:52.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 shutdown_connections 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f69880a2b90 0x7f69880a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f699c102d20 0x7f699c1983b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f699c1036e0 0x7f699c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.951+0000 7f69a196d640 1 --2- 172.21.15.1:0/656989904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f699c101b30 0x7f699c197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.952+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 >> 172.21.15.1:0/656989904 conn(0x7f699c0fd2b0 msgr2=0x7f699c106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.952+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 shutdown_connections 2024-09-12T02:30:52.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:52.952+0000 7f69a196d640 1 -- 172.21.15.1:0/656989904 wait complete. 2024-09-12T02:30:52.963 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-12T02:30:51.997077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660785,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1217,"num_read_kb":729,"num_write":444,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381148,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560676,"statfs":{"total":1151940427776,"available":1151550132224,"internally_reserved":0,"allocated":11366400,"data_stored":7197627,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":52,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002863"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976962+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.976962+0000","last_peered":"2024-09-12T02:30:23.976962+0000","last_clean":"2024-09-12T02:30:23.976962+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.976962+0000","last_undegraded":"2024-09-12T02:30:23.976962+0000","last_fullsized":"2024-09-12T02:30:23.976962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965517+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.965517+0000","last_peered":"2024-09-12T02:30:23.965517+0000","last_clean":"2024-09-12T02:30:23.965517+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.965517+0000","last_undegraded":"2024-09-12T02:30:23.965517+0000","last_fullsized":"2024-09-12T02:30:23.965517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976447+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976447+0000","last_peered":"2024-09-12T02:30:23.976447+0000","last_clean":"2024-09-12T02:30:23.976447+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976447+0000","last_undegraded":"2024-09-12T02:30:23.976447+0000","last_fullsized":"2024-09-12T02:30:23.976447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966068+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966068+0000","last_peered":"2024-09-12T02:30:23.966068+0000","last_clean":"2024-09-12T02:30:23.966068+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966068+0000","last_undegraded":"2024-09-12T02:30:23.966068+0000","last_fullsized":"2024-09-12T02:30:23.966068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.962180+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.962180+0000","last_peered":"2024-09-12T02:30:23.962180+0000","last_clean":"2024-09-12T02:30:23.962180+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.962180+0000","last_undegraded":"2024-09-12T02:30:23.962180+0000","last_fullsized":"2024-09-12T02:30:23.962180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.964055+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.964055+0000","last_peered":"2024-09-12T02:30:23.964055+0000","last_clean":"2024-09-12T02:30:23.964055+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.964055+0000","last_undegraded":"2024-09-12T02:30:23.964055+0000","last_fullsized":"2024-09-12T02:30:23.964055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968197+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968197+0000","last_peered":"2024-09-12T02:30:23.968197+0000","last_clean":"2024-09-12T02:30:23.968197+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968197+0000","last_undegraded":"2024-09-12T02:30:23.968197+0000","last_fullsized":"2024-09-12T02:30:23.968197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970327+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970327+0000","last_peered":"2024-09-12T02:30:23.970327+0000","last_clean":"2024-09-12T02:30:23.970327+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970327+0000","last_undegraded":"2024-09-12T02:30:23.970327+0000","last_fullsized":"2024-09-12T02:30:23.970327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":137,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183072+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:49.183072+0000","last_peered":"2024-09-12T02:30:49.183072+0000","last_clean":"2024-09-12T02:30:49.183072+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:49.183072+0000","last_undegraded":"2024-09-12T02:30:49.183072+0000","last_fullsized":"2024-09-12T02:30:49.183072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":237,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182613+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:49.182613+0000","last_peered":"2024-09-12T02:30:49.182613+0000","last_clean":"2024-09-12T02:30:49.182613+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:49.182613+0000","last_undegraded":"2024-09-12T02:30:49.182613+0000","last_fullsized":"2024-09-12T02:30:49.182613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.182588+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:49.182588+0000","last_peered":"2024-09-12T02:30:49.182588+0000","last_clean":"2024-09-12T02:30:49.182588+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:49.182588+0000","last_undegraded":"2024-09-12T02:30:49.182588+0000","last_fullsized":"2024-09-12T02:30:49.182588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":170,"num_write":38,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:49.183058+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:49.183058+0000","last_peered":"2024-09-12T02:30:49.183058+0000","last_clean":"2024-09-12T02:30:49.183058+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:49.183058+0000","last_undegraded":"2024-09-12T02:30:49.183058+0000","last_fullsized":"2024-09-12T02:30:49.183058+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:48.194163+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:48.194163+0000","last_peered":"2024-09-12T02:30:48.194163+0000","last_clean":"2024-09-12T02:30:48.194163+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:48.194163+0000","last_undegraded":"2024-09-12T02:30:48.194163+0000","last_fullsized":"2024-09-12T02:30:48.194163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639878+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639878+0000","last_peered":"2024-09-12T02:29:55.639878+0000","last_clean":"2024-09-12T02:29:55.639878+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639878+0000","last_undegraded":"2024-09-12T02:29:55.639878+0000","last_fullsized":"2024-09-12T02:29:55.639878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644440+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644440+0000","last_peered":"2024-09-12T02:29:55.644440+0000","last_clean":"2024-09-12T02:29:55.644440+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644440+0000","last_undegraded":"2024-09-12T02:29:55.644440+0000","last_fullsized":"2024-09-12T02:29:55.644440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971872+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.971872+0000","last_peered":"2024-09-12T02:30:23.971872+0000","last_clean":"2024-09-12T02:30:23.971872+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.971872+0000","last_undegraded":"2024-09-12T02:30:23.971872+0000","last_fullsized":"2024-09-12T02:30:23.971872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.178597+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:46.178597+0000","last_peered":"2024-09-12T02:30:46.178597+0000","last_clean":"2024-09-12T02:30:46.178597+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:46.178597+0000","last_undegraded":"2024-09-12T02:30:46.178597+0000","last_fullsized":"2024-09-12T02:30:46.178597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968950+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.968950+0000","last_peered":"2024-09-12T02:30:23.968950+0000","last_clean":"2024-09-12T02:30:23.968950+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.968950+0000","last_undegraded":"2024-09-12T02:30:23.968950+0000","last_fullsized":"2024-09-12T02:30:23.968950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.665129+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:46.665129+0000","last_peered":"2024-09-12T02:30:46.665129+0000","last_clean":"2024-09-12T02:30:46.665129+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:46.665129+0000","last_undegraded":"2024-09-12T02:30:46.665129+0000","last_fullsized":"2024-09-12T02:30:46.665129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961529+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961529+0000","last_peered":"2024-09-12T02:30:23.961529+0000","last_clean":"2024-09-12T02:30:23.961529+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961529+0000","last_undegraded":"2024-09-12T02:30:23.961529+0000","last_fullsized":"2024-09-12T02:30:23.961529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585850+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.585850+0000","last_peered":"2024-09-12T02:29:55.585850+0000","last_clean":"2024-09-12T02:29:55.585850+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.585850+0000","last_undegraded":"2024-09-12T02:29:55.585850+0000","last_fullsized":"2024-09-12T02:29:55.585850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.958029+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.958029+0000","last_peered":"2024-09-12T02:30:23.958029+0000","last_clean":"2024-09-12T02:30:23.958029+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.958029+0000","last_undegraded":"2024-09-12T02:30:23.958029+0000","last_fullsized":"2024-09-12T02:30:23.958029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587785+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587785+0000","last_peered":"2024-09-12T02:29:55.587785+0000","last_clean":"2024-09-12T02:29:55.587785+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587785+0000","last_undegraded":"2024-09-12T02:29:55.587785+0000","last_fullsized":"2024-09-12T02:29:55.587785+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971977+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.971977+0000","last_peered":"2024-09-12T02:30:23.971977+0000","last_clean":"2024-09-12T02:30:23.971977+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.971977+0000","last_undegraded":"2024-09-12T02:30:23.971977+0000","last_fullsized":"2024-09-12T02:30:23.971977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640246+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640246+0000","last_peered":"2024-09-12T02:29:55.640246+0000","last_clean":"2024-09-12T02:29:55.640246+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640246+0000","last_undegraded":"2024-09-12T02:29:55.640246+0000","last_fullsized":"2024-09-12T02:29:55.640246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638722+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638722+0000","last_peered":"2024-09-12T02:29:55.638722+0000","last_clean":"2024-09-12T02:29:55.638722+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638722+0000","last_undegraded":"2024-09-12T02:29:55.638722+0000","last_fullsized":"2024-09-12T02:29:55.638722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.933510+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.933510+0000","last_peered":"2024-09-12T02:30:23.933510+0000","last_clean":"2024-09-12T02:30:23.933510+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.933510+0000","last_undegraded":"2024-09-12T02:30:23.933510+0000","last_fullsized":"2024-09-12T02:30:23.933510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585664+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585664+0000","last_peered":"2024-09-12T02:29:55.585664+0000","last_clean":"2024-09-12T02:29:55.585664+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585664+0000","last_undegraded":"2024-09-12T02:29:55.585664+0000","last_fullsized":"2024-09-12T02:29:55.585664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585044+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:55.585044+0000","last_peered":"2024-09-12T02:29:55.585044+0000","last_clean":"2024-09-12T02:29:55.585044+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:55.585044+0000","last_undegraded":"2024-09-12T02:29:55.585044+0000","last_fullsized":"2024-09-12T02:29:55.585044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976332+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976332+0000","last_peered":"2024-09-12T02:30:23.976332+0000","last_clean":"2024-09-12T02:30:23.976332+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976332+0000","last_undegraded":"2024-09-12T02:30:23.976332+0000","last_fullsized":"2024-09-12T02:30:23.976332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961625+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961625+0000","last_peered":"2024-09-12T02:30:23.961625+0000","last_clean":"2024-09-12T02:30:23.961625+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961625+0000","last_undegraded":"2024-09-12T02:30:23.961625+0000","last_fullsized":"2024-09-12T02:30:23.961625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:46.664551+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:46.664551+0000","last_peered":"2024-09-12T02:30:46.664551+0000","last_clean":"2024-09-12T02:30:46.664551+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:46.664551+0000","last_undegraded":"2024-09-12T02:30:46.664551+0000","last_fullsized":"2024-09-12T02:30:46.664551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70183,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1091,"num_read_kb":620,"num_write":261,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1089746,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499159,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499277,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:52.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:30:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:53.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 -- 172.21.15.1:0/2152292276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c102790 msgr2=0x7f8b0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:53.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/2152292276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c102790 0x7f8b0c1067e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009900 tx=0x7f8afc02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:53.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 -- 172.21.15.1:0/2152292276 shutdown_connections 2024-09-12T02:30:53.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/2152292276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c102790 0x7f8b0c1067e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/2152292276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c106f10 0x7f8b0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/2152292276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 0x7f8b0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 -- 172.21.15.1:0/2152292276 >> 172.21.15.1:0/2152292276 conn(0x7f8b0c0fd8c0 msgr2=0x7f8b0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 -- 172.21.15.1:0/2152292276 shutdown_connections 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.760+0000 7f8b13cfe640 1 -- 172.21.15.1:0/2152292276 wait complete. 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 Processor -- start 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 -- start start 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 0x7f8b0c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 0x7f8b0c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c111f70 con 0x7f8b0c106f10 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c111df0 con 0x7f8b0c102790 2024-09-12T02:30:53.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b13cfe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c1120f0 con 0x7f8b0c101de0 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b1229b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b1229b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59140/0 (socket says 172.21.15.1:59140) 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b1229b640 1 -- 172.21.15.1:0/281813093 learned_addr learned my addr 172.21.15.1:0/281813093 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.761+0000 7f8b11a9a640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 0x7f8b0c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b11299640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 0x7f8b0c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 -- 172.21.15.1:0/281813093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 msgr2=0x7f8b0c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 0x7f8b0c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 -- 172.21.15.1:0/281813093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 msgr2=0x7f8b0c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 0x7f8b0c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 -- 172.21.15.1:0/281813093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c19d380 con 0x7f8b0c106f10 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b11299640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 0x7f8b0c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b1229b640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400cce0 tx=0x7f8b0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400f450 con 0x7f8b0c106f10 2024-09-12T02:30:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b0400fad0 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c19d670 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04018c10 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.762+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c1a4f50 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.763+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0c1021c0 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.764+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8b0400f5f0 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.765+0000 7f8b02ffd640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 0x7f8af80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.765+0000 7f8b11a9a640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 0x7f8af80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.765+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8b040cf6b0 con 0x7f8b0c106f10 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.766+0000 7f8b11a9a640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 0x7f8af80a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b08005fd0 tx=0x7f8b0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.768+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b04014030 con 0x7f8b0c106f10 2024-09-12T02:30:53.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.981+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b0c199730 con 0x7f8b0c106f10 2024-09-12T02:30:53.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:53 smithi001 ceph-mon[31252]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:53.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:53 smithi001 ceph-mon[31252]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:53.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:53 smithi001 ceph-mon[31252]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:53.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.982+0000 7f8b02ffd640 1 -- 172.21.15.1:0/281813093 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f8b0c199730 con 0x7f8b0c106f10 2024-09-12T02:30:53.983 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:30:53.984 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:30:53.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 msgr2=0x7f8af80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 0x7f8af80a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b08005fd0 tx=0x7f8b0800b390 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 msgr2=0x7f8b0c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400cce0 tx=0x7f8b0400a620 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 shutdown_connections 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8af80a2c00 0x7f8af80a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b0c106f10 0x7f8b0c19cca0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b0c102790 0x7f8b0c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 --2- 172.21.15.1:0/281813093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b0c101de0 0x7f8b0c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 >> 172.21.15.1:0/281813093 conn(0x7f8b0c0fd8c0 msgr2=0x7f8b0c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 shutdown_connections 2024-09-12T02:30:53.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:53.984+0000 7f8b13cfe640 1 -- 172.21.15.1:0/281813093 wait complete. 2024-09-12T02:30:54.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:53 smithi134 ceph-mon[35091]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:54.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:53 smithi134 ceph-mon[35091]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:54.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:53 smithi134 ceph-mon[35091]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:53 smithi173 ceph-mon[35036]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:30:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:53 smithi173 ceph-mon[35036]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:53 smithi173 ceph-mon[35036]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:54.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:30:55.060 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:54 smithi001 ceph-mon[31252]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:55.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/281813093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:54 smithi134 ceph-mon[35091]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:55.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/281813093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:54 smithi173 ceph-mon[35036]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:55.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/281813093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 -- 172.21.15.1:0/735583055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881036e0 msgr2=0x7fb088107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/735583055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881036e0 0x7fb088107b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb070009930 tx=0x7fb07002a420 comp rx=0 tx=0).stop 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 -- 172.21.15.1:0/735583055 shutdown_connections 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/735583055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881036e0 0x7fb088107b90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/735583055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0881082a0 0x7fb08810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/735583055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb088102d30 0x7fb088103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 -- 172.21.15.1:0/735583055 >> 172.21.15.1:0/735583055 conn(0x7fb0880fc7d0 msgr2=0x7fb0880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 -- 172.21.15.1:0/735583055 shutdown_connections 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.553+0000 7fb08e3b5640 1 -- 172.21.15.1:0/735583055 wait complete. 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 Processor -- start 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 -- start start 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb088102d30 0x7fb088100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0881036e0 0x7fb088100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb088112140 con 0x7fb0881082a0 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb088111fc0 con 0x7fb088102d30 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08e3b5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881122c0 con 0x7fb0881036e0 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59156/0 (socket says 172.21.15.1:59156) 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 -- 172.21.15.1:0/3213613154 learned_addr learned my addr 172.21.15.1:0/3213613154 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb07ffff640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0881036e0 0x7fb088100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb087fff640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb088102d30 0x7fb088100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 -- 172.21.15.1:0/3213613154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0881036e0 msgr2=0x7fb088100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0881036e0 0x7fb088100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 -- 172.21.15.1:0/3213613154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb088102d30 msgr2=0x7fb088100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb088102d30 0x7fb088100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.554+0000 7fb08c952640 1 -- 172.21.15.1:0/3213613154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0881a6bc0 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb08c952640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb08000b970 tx=0x7fb08000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080019070 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08000cb40 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0881a6eb0 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080007650 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.555+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0881a7370 con 0x7fb0881082a0 2024-09-12T02:30:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.556+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb088103190 con 0x7fb0881082a0 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.557+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb08001c070 con 0x7fb0881082a0 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.558+0000 7fb085ffb640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 0x7fb0740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.558+0000 7fb087fff640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 0x7fb0740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.558+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb0800ce6a0 con 0x7fb0881082a0 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.558+0000 7fb087fff640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 0x7fb0740a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb078009890 tx=0x7fb078008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:55.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.562+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb08009b580 con 0x7fb0881082a0 2024-09-12T02:30:55.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.739+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb08810a2b0 con 0x7fb0881082a0 2024-09-12T02:30:55.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.741+0000 7fb085ffb640 1 -- 172.21.15.1:0/3213613154 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7fb08009ae80 con 0x7fb0881082a0 2024-09-12T02:30:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:55.743 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.743+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 msgr2=0x7fb0740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.743+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 0x7fb0740a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb078009890 tx=0x7fb078008040 comp rx=0 tx=0).stop 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.743+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 msgr2=0x7fb088101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.743+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb08000b970 tx=0x7fb08000be30 comp rx=0 tx=0).stop 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 shutdown_connections 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0740a2c00 0x7fb0740a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb0881082a0 0x7fb088101410 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0881036e0 0x7fb088100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 --2- 172.21.15.1:0/3213613154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb088102d30 0x7fb088100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:55.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 >> 172.21.15.1:0/3213613154 conn(0x7fb0880fc7d0 msgr2=0x7fb088105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:55.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 shutdown_connections 2024-09-12T02:30:55.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:55.744+0000 7fb08e3b5640 1 -- 172.21.15.1:0/3213613154 wait complete. 2024-09-12T02:30:56.061 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:55 smithi001 ceph-mon[31252]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T02:30:56.061 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:55 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3213613154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:55 smithi134 ceph-mon[35091]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T02:30:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:55 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3213613154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:55 smithi173 ceph-mon[35036]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-12T02:30:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:55 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3213613154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:56.434 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T02:30:56.434 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T02:30:56.444 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:30:56.444 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T02:30:56.445 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T02:30:56.445 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:30:56.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:30:56.447 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T02:30:56.564 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:30:56.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:30:56.728 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 -- 172.21.15.1:0/648084895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4102d40 msgr2=0x7fd6a4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 --2- 172.21.15.1:0/648084895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4102d40 0x7fd6a4103120 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd694009900 tx=0x7fd69402a480 comp rx=0 tx=0).stop 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 -- 172.21.15.1:0/648084895 shutdown_connections 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 --2- 172.21.15.1:0/648084895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 0x7fd6a410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 --2- 172.21.15.1:0/648084895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4103660 0x7fd6a410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 --2- 172.21.15.1:0/648084895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4102d40 0x7fd6a4103120 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 -- 172.21.15.1:0/648084895 >> 172.21.15.1:0/648084895 conn(0x7fd6a40fc7a0 msgr2=0x7fd6a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 -- 172.21.15.1:0/648084895 shutdown_connections 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.245+0000 7fd6a926e640 1 -- 172.21.15.1:0/648084895 wait complete. 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 Processor -- start 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 -- start start 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4102d40 0x7fd6a4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 0x7fd6a419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4111f70 con 0x7fd6a4103660 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4111df0 con 0x7fd6a410c170 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a926e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41120f0 con 0x7fd6a4102d40 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59180/0 (socket says 172.21.15.1:59180) 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a27fc640 1 -- 172.21.15.1:0/1207163795 learned_addr learned my addr 172.21.15.1:0/1207163795 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4102d40 0x7fd6a4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.246+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 0x7fd6a419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 -- 172.21.15.1:0/1207163795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4102d40 msgr2=0x7fd6a4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4102d40 0x7fd6a4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 -- 172.21.15.1:0/1207163795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 msgr2=0x7fd6a419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 0x7fd6a419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 -- 172.21.15.1:0/1207163795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a419d420 con 0x7fd6a4103660 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00d750 tx=0x7fd68c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd69bfff640 1 -- 172.21.15.1:0/1207163795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c017070 con 0x7fd6a4103660 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a419d710 con 0x7fd6a4103660 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd69bfff640 1 -- 172.21.15.1:0/1207163795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd68c005020 con 0x7fd6a4103660 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd69bfff640 1 -- 172.21.15.1:0/1207163795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004d00 con 0x7fd6a4103660 2024-09-12T02:30:57.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.247+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a4ff0 con 0x7fd6a4103660 2024-09-12T02:30:57.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd69bfff640 1 -- 172.21.15.1:0/1207163795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd68c009a30 con 0x7fd6a4103660 2024-09-12T02:30:57.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 Processor -- start 2024-09-12T02:30:57.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 -- start start 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 0x555583226e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x555583238540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55558318c280 con 0x555583236150 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555583133b10 con 0x555583227340 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6ab647740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555583188240 con 0x555583226a20 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.251+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:52244/0 (socket says 172.21.15.1:52244) 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4043780297 learned_addr learned my addr 172.21.15.1:0/4043780297 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 0x555583226e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x555583238540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4043780297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 msgr2=0x555583226e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd69bfff640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 0x7fd6900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 0x555583226e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4043780297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 msgr2=0x555583238540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x555583238540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4043780297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555831401f0 con 0x555583227340 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 0x555583226e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd69bfff640 1 -- 172.21.15.1:0/1207163795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd68c0cea20 con 0x7fd6a4103660 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 0x7fd6900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.252+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd694009900 tx=0x7fd694031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3e09277ca1505f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6997fa640 1 -- 172.21.15.1:0/4043780297 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040070 con 0x555583227340 2024-09-12T02:30:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6997fa640 1 -- 172.21.15.1:0/4043780297 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694005020 con 0x555583227340 2024-09-12T02:30:57.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6997fa640 1 -- 172.21.15.1:0/4043780297 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694035040 con 0x555583227340 2024-09-12T02:30:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6ab647740 1 -- 172.21.15.1:0/4043780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 msgr2=0x555583235c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd694009900 tx=0x7fd694031630 comp rx=0 tx=0).stop 2024-09-12T02:30:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.253+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 0x7fd6900a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd69c013b40 tx=0x7fd69c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 -- 172.21.15.1:0/4043780297 shutdown_connections 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x555583238540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583235c10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4043780297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583226a20 0x555583226e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 -- 172.21.15.1:0/4043780297 >> 172.21.15.1:0/4043780297 conn(0x5555832230f0 msgr2=0x5555832234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 -- 172.21.15.1:0/4043780297 shutdown_connections 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 -- 172.21.15.1:0/4043780297 wait complete. 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 -- start start 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 Processor -- start 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.254+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583233590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x555583233ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6ab647740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555583238cc0 con 0x555583226a20 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6ab647740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555583146f10 con 0x555583227340 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6ab647740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555583238e40 con 0x555583236150 2024-09-12T02:30:57.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6ab647740 10 client.0 _ll_register_callbacks cb 0x55558310fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59202/0 (socket says 172.21.15.1:59202) 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4056496994 learned_addr learned my addr 172.21.15.1:0/4056496994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583233590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x555583233ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4056496994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 msgr2=0x555583233ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x555583233ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 msgr2=0x555583233590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583233590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/4056496994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555582efd6a0 con 0x555583226a20 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583233590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd694031b10 tx=0x7fd6940051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8d8520600be3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.255+0000 7fd68a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040070 con 0x555583226a20 2024-09-12T02:30:57.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd694004810 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd694005020 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd694054070 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 10 client.15276 fetch_fsmap learned FSMap version 28 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555583244930 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd69403c440 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd69404e410 con 0x555583226a20 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 10 client.15276 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 20 client.15276 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x555583245c80 0x555583248070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 4 client.15276 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.256+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd694005020 con 0x555583245c80 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.257+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x555583245c80 0x555583248070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.257+0000 7fd68a7fc640 10 client.15276 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:57.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.257+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x555583245c80 0x555583248070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863e5439b3201a5d server_cookie=9b6ca65006856e18 in_seq=0 out_seq=0 2024-09-12T02:30:57.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd68a7fc640 1 -- 172.21.15.1:0/4056496994 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd68c080e80 con 0x555583245c80 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd68a7fc640 10 client.15276 handle_command_reply: tid=0 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 client.15276 shutdown 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 msgr2=0x555583233050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd694031b10 tx=0x7fd6940051d0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 shutdown_connections 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x555583245c80 0x555583248070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x555583233ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583227340 0x555583233590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 --2- 172.21.15.1:0/4056496994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583226a20 0x555583233050 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 >> 172.21.15.1:0/4056496994 conn(0x5555832230f0 msgr2=0x555583228e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd68a7fc640 0 client.15276 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 shutdown_connections 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 1 -- 172.21.15.1:0/4056496994 wait complete. 2024-09-12T02:30:57.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.258+0000 7fd6ab647740 20 client.15276 trim_cache size 0 max 16384 2024-09-12T02:30:57.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.276+0000 7fd6ab647740 1 Processor -- start 2024-09-12T02:30:57.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.276+0000 7fd6ab647740 1 -- start start 2024-09-12T02:30:57.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 0x55558324d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x5555832289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41ab350 con 0x555583236150 2024-09-12T02:30:57.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41ace90 con 0x555583228530 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6ab647740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41aba20 con 0x555583227340 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x5555832289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59214/0 (socket says 172.21.15.1:59214) 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a27fc640 1 -- 172.21.15.1:0/2388286315 learned_addr learned my addr 172.21.15.1:0/2388286315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:57.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 0x55558324d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2388286315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 msgr2=0x5555832289c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x5555832289c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2388286315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 msgr2=0x55558324dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.277+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2388286315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555583222f20 con 0x555583227340 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.278+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.278+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 0x55558324d6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd69404ea70 tx=0x7fd694000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d121d2bac2c5f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.278+0000 7fd698ff9640 1 -- 172.21.15.1:0/2388286315 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69405d070 con 0x555583227340 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.278+0000 7fd698ff9640 1 -- 172.21.15.1:0/2388286315 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694009520 con 0x555583227340 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.278+0000 7fd698ff9640 1 -- 172.21.15.1:0/2388286315 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040070 con 0x555583227340 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- 172.21.15.1:0/2388286315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 msgr2=0x55558324d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 0x55558324d6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd69404ea70 tx=0x7fd694000bc0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- 172.21.15.1:0/2388286315 shutdown_connections 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583236150 0x55558324dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x5555832289c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2388286315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583227340 0x55558324d6a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- 172.21.15.1:0/2388286315 >> 172.21.15.1:0/2388286315 conn(0x5555832230f0 msgr2=0x555583232010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- 172.21.15.1:0/2388286315 shutdown_connections 2024-09-12T02:30:57.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- 172.21.15.1:0/2388286315 wait complete. 2024-09-12T02:30:57.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 -- start start 2024-09-12T02:30:57.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.279+0000 7fd6ab647740 1 Processor -- start 2024-09-12T02:30:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x55558323a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x5555832af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41ac7c0 con 0x555583227340 2024-09-12T02:30:57.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41ac0f0 con 0x555583228530 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41a9330 con 0x555583236150 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6ab647740 10 client.0 _ll_register_callbacks cb 0x7fd68c0d23d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59220/0 (socket says 172.21.15.1:59220) 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2733204774 learned_addr learned my addr 172.21.15.1:0/2733204774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x5555832af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x55558323a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2733204774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 msgr2=0x5555832af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x5555832af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 msgr2=0x55558323a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x55558323a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a2ffd640 1 -- 172.21.15.1:0/2733204774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555832afbb0 con 0x555583227340 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.280+0000 7fd6a37fe640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x5555832af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:57.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd6a2ffd640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd694031bf0 tx=0x7fd694005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361e5ae72d4b783b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd68a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x55558323a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040040 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd69404ecb0 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd694009520 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd69405d040 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd6ab647740 10 client.15282 fetch_fsmap learned FSMap version 28 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5555832b0e30 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.281+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694066070 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd694059730 con 0x555583227340 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 10 client.15282 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:30:57.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 20 client.15282 populate_metadata read hostname 'smithi001' 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5555832b1430 0x5555832b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 4 client.15282 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fd694009520 con 0x5555832b1430 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5555832b1430 0x5555832b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd68a7fc640 10 client.15282 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:57.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.282+0000 7fd6a27fc640 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5555832b1430 0x5555832b3870 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7740947204a30185 server_cookie=29fa1abd1dfb1ffd in_seq=0 out_seq=0 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.283+0000 7fd68a7fc640 1 -- 172.21.15.1:0/2733204774 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fd694009520 con 0x5555832b1430 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.283+0000 7fd68a7fc640 10 client.15282 handle_command_reply: tid=0 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 client.15282 shutdown 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 msgr2=0x55558323a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd694031bf0 tx=0x7fd694005c90 comp rx=0 tx=0).stop 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 shutdown_connections 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5555832b1430 0x5555832b3870 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555583236150 0x5555832af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd68a7fc640 0 client.15282 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:30:57.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555583228530 0x55558323a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 --2- 172.21.15.1:0/2733204774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555583227340 0x55558323a4a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 >> 172.21.15.1:0/2733204774 conn(0x5555832230f0 msgr2=0x555583232010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 shutdown_connections 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 1 -- 172.21.15.1:0/2733204774 wait complete. 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.284+0000 7fd6ab647740 20 client.15282 trim_cache size 0 max 16384 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "8a1c3570-cb67-4fde-919c-fd040df589ce", 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-12T02:30:57.289 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:30:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 msgr2=0x7fd6900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 0x7fd6900a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd69c013b40 tx=0x7fd69c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 msgr2=0x7fd6a41989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00d750 tx=0x7fd68c00dc10 comp rx=0 tx=0).stop 2024-09-12T02:30:57.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 shutdown_connections 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd6900a2b80 0x7fd6900a5040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6a4103660 0x7fd6a41989b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a410c170 0x7fd6a419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 --2- 172.21.15.1:0/1207163795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6a4102d40 0x7fd6a4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 >> 172.21.15.1:0/1207163795 conn(0x7fd6a40fc7a0 msgr2=0x7fd6a40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 shutdown_connections 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:57.285+0000 7fd6a926e640 1 -- 172.21.15.1:0/1207163795 wait complete. 2024-09-12T02:30:57.291 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:57.894 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:57 smithi001 ceph-mon[31252]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T02:30:58.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 -- 172.21.15.1:0/3396846363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d8100ca0 msgr2=0x7fa6d8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 --2- 172.21.15.1:0/3396846363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8106840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009930 tx=0x7fa6cc02a420 comp rx=0 tx=0).stop 2024-09-12T02:30:58.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 -- 172.21.15.1:0/3396846363 shutdown_connections 2024-09-12T02:30:58.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 --2- 172.21.15.1:0/3396846363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8106840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 --2- 172.21.15.1:0/3396846363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8106f50 0x7fa6d810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 --2- 172.21.15.1:0/3396846363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d81002f0 0x7fa6d81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 -- 172.21.15.1:0/3396846363 >> 172.21.15.1:0/3396846363 conn(0x7fa6d8077210 msgr2=0x7fa6d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 -- 172.21.15.1:0/3396846363 shutdown_connections 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.087+0000 7fa6dd119640 1 -- 172.21.15.1:0/3396846363 wait complete. 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 Processor -- start 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 -- start start 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 0x7fa6d819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8111fe0 con 0x7fa6d81002f0 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8111e60 con 0x7fa6d8106f50 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.088+0000 7fa6dd119640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8112160 con 0x7fa6d8100ca0 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59238/0 (socket says 172.21.15.1:59238) 2024-09-12T02:30:58.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 -- 172.21.15.1:0/2255783719 learned_addr learned my addr 172.21.15.1:0/2255783719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d659c640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d759e640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 0x7fa6d819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 -- 172.21.15.1:0/2255783719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8100ca0 msgr2=0x7fa6d8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 -- 172.21.15.1:0/2255783719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 msgr2=0x7fa6d819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 0x7fa6d819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 -- 172.21.15.1:0/2255783719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d819d4b0 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d759e640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 0x7fa6d819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6d6d9d640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c920 tx=0x7fa6c800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8007c70 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8007e10 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d819d7a0 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.089+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8018890 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.090+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d81a5080 con 0x7fa6d81002f0 2024-09-12T02:30:58.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.090+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d81006d0 con 0x7fa6d81002f0 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.092+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa6c8018a50 con 0x7fa6d81002f0 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.092+0000 7fa6bffff640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 0x7fa6c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.093+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fa6c80cf3e0 con 0x7fa6d81002f0 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.093+0000 7fa6d659c640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 0x7fa6c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.093+0000 7fa6d659c640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 0x7fa6c00a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc031550 tx=0x7fa6cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:58.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.096+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6c8014030 con 0x7fa6d81002f0 2024-09-12T02:30:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:57 smithi134 ceph-mon[35091]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T02:30:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:57 smithi173 ceph-mon[35036]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T02:30:58.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.269+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6d810a170 con 0x7fa6c00a2c00 2024-09-12T02:30:58.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.276+0000 7fa6bffff640 1 -- 172.21.15.1:0/2255783719 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259167 (secure 0 0 0) 0x7fa6d810a170 con 0x7fa6c00a2c00 2024-09-12T02:30:58.279 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:30:58.280 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:30:58.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 msgr2=0x7fa6c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 0x7fa6c00a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc031550 tx=0x7fa6cc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 msgr2=0x7fa6d8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c920 tx=0x7fa6c800cde0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 shutdown_connections 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fa6c00a2c00 0x7fa6c00a50c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d8106f50 0x7fa6d819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6d8100ca0 0x7fa6d8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 --2- 172.21.15.1:0/2255783719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6d81002f0 0x7fa6d8198500 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 >> 172.21.15.1:0/2255783719 conn(0x7fa6d8077210 msgr2=0x7fa6d8105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 shutdown_connections 2024-09-12T02:30:58.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:58.279+0000 7fa6dd119640 1 -- 172.21.15.1:0/2255783719 wait complete. 2024-09-12T02:30:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:58 smithi001 ceph-mon[31252]: scrub queued for path: / 2024-09-12T02:30:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:58 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:58 smithi001 ceph-mon[31252]: scrub summary: active paths [/] 2024-09-12T02:30:58.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:58 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:58 smithi134 ceph-mon[35091]: scrub queued for path: / 2024-09-12T02:30:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:58 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:58 smithi134 ceph-mon[35091]: scrub summary: active paths [/] 2024-09-12T02:30:59.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:58 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:59.194 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-12T02:30:57.998475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665099,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1278,"num_read_kb":764,"num_write":445,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381160,"kb_used_data":11112,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560664,"statfs":{"total":1151940427776,"available":1151550119936,"internally_reserved":0,"allocated":11378688,"data_stored":7210569,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":62,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976962+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.976962+0000","last_peered":"2024-09-12T02:30:23.976962+0000","last_clean":"2024-09-12T02:30:23.976962+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.976962+0000","last_undegraded":"2024-09-12T02:30:23.976962+0000","last_fullsized":"2024-09-12T02:30:23.976962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965517+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.965517+0000","last_peered":"2024-09-12T02:30:23.965517+0000","last_clean":"2024-09-12T02:30:23.965517+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.965517+0000","last_undegraded":"2024-09-12T02:30:23.965517+0000","last_fullsized":"2024-09-12T02:30:23.965517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976447+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976447+0000","last_peered":"2024-09-12T02:30:23.976447+0000","last_clean":"2024-09-12T02:30:23.976447+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976447+0000","last_undegraded":"2024-09-12T02:30:23.976447+0000","last_fullsized":"2024-09-12T02:30:23.976447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966466+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966466+0000","last_peered":"2024-09-12T02:30:23.966466+0000","last_clean":"2024-09-12T02:30:23.966466+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966466+0000","last_undegraded":"2024-09-12T02:30:23.966466+0000","last_fullsized":"2024-09-12T02:30:23.966466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.962180+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.962180+0000","last_peered":"2024-09-12T02:30:23.962180+0000","last_clean":"2024-09-12T02:30:23.962180+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.962180+0000","last_undegraded":"2024-09-12T02:30:23.962180+0000","last_fullsized":"2024-09-12T02:30:23.962180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.964055+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.964055+0000","last_peered":"2024-09-12T02:30:23.964055+0000","last_clean":"2024-09-12T02:30:23.964055+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.964055+0000","last_undegraded":"2024-09-12T02:30:23.964055+0000","last_fullsized":"2024-09-12T02:30:23.964055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968197+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968197+0000","last_peered":"2024-09-12T02:30:23.968197+0000","last_clean":"2024-09-12T02:30:23.968197+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968197+0000","last_undegraded":"2024-09-12T02:30:23.968197+0000","last_fullsized":"2024-09-12T02:30:23.968197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970327+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970327+0000","last_peered":"2024-09-12T02:30:23.970327+0000","last_clean":"2024-09-12T02:30:23.970327+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970327+0000","last_undegraded":"2024-09-12T02:30:23.970327+0000","last_fullsized":"2024-09-12T02:30:23.970327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190688+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:54.190688+0000","last_peered":"2024-09-12T02:30:54.190688+0000","last_clean":"2024-09-12T02:30:54.190688+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:54.190688+0000","last_undegraded":"2024-09-12T02:30:54.190688+0000","last_fullsized":"2024-09-12T02:30:54.190688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":247,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190138+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:54.190138+0000","last_peered":"2024-09-12T02:30:54.190138+0000","last_clean":"2024-09-12T02:30:54.190138+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:54.190138+0000","last_undegraded":"2024-09-12T02:30:54.190138+0000","last_fullsized":"2024-09-12T02:30:54.190138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":291,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190102+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:54.190102+0000","last_peered":"2024-09-12T02:30:54.190102+0000","last_clean":"2024-09-12T02:30:54.190102+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:54.190102+0000","last_undegraded":"2024-09-12T02:30:54.190102+0000","last_fullsized":"2024-09-12T02:30:54.190102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66699,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":180,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190067+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:54.190067+0000","last_peered":"2024-09-12T02:30:54.190067+0000","last_clean":"2024-09-12T02:30:54.190067+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:54.190067+0000","last_undegraded":"2024-09-12T02:30:54.190067+0000","last_fullsized":"2024-09-12T02:30:54.190067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:53.201606+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:53.201606+0000","last_peered":"2024-09-12T02:30:53.201606+0000","last_clean":"2024-09-12T02:30:53.201606+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:53.201606+0000","last_undegraded":"2024-09-12T02:30:53.201606+0000","last_fullsized":"2024-09-12T02:30:53.201606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639941+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639941+0000","last_peered":"2024-09-12T02:29:55.639941+0000","last_clean":"2024-09-12T02:29:55.639941+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639941+0000","last_undegraded":"2024-09-12T02:29:55.639941+0000","last_fullsized":"2024-09-12T02:29:55.639941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644878+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644878+0000","last_peered":"2024-09-12T02:29:55.644878+0000","last_clean":"2024-09-12T02:29:55.644878+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644878+0000","last_undegraded":"2024-09-12T02:29:55.644878+0000","last_fullsized":"2024-09-12T02:29:55.644878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972079+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.972079+0000","last_peered":"2024-09-12T02:30:23.972079+0000","last_clean":"2024-09-12T02:30:23.972079+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.972079+0000","last_undegraded":"2024-09-12T02:30:23.972079+0000","last_fullsized":"2024-09-12T02:30:23.972079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.194037+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:57.194037+0000","last_peered":"2024-09-12T02:30:57.194037+0000","last_clean":"2024-09-12T02:30:57.194037+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:57.194037+0000","last_undegraded":"2024-09-12T02:30:57.194037+0000","last_fullsized":"2024-09-12T02:30:57.194037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969068+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.969068+0000","last_peered":"2024-09-12T02:30:23.969068+0000","last_clean":"2024-09-12T02:30:23.969068+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.969068+0000","last_undegraded":"2024-09-12T02:30:23.969068+0000","last_fullsized":"2024-09-12T02:30:23.969068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.679759+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:57.679759+0000","last_peered":"2024-09-12T02:30:57.679759+0000","last_clean":"2024-09-12T02:30:57.679759+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:57.679759+0000","last_undegraded":"2024-09-12T02:30:57.679759+0000","last_fullsized":"2024-09-12T02:30:57.679759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961529+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961529+0000","last_peered":"2024-09-12T02:30:23.961529+0000","last_clean":"2024-09-12T02:30:23.961529+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961529+0000","last_undegraded":"2024-09-12T02:30:23.961529+0000","last_fullsized":"2024-09-12T02:30:23.961529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585850+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.585850+0000","last_peered":"2024-09-12T02:29:55.585850+0000","last_clean":"2024-09-12T02:29:55.585850+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.585850+0000","last_undegraded":"2024-09-12T02:29:55.585850+0000","last_fullsized":"2024-09-12T02:29:55.585850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.958029+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.958029+0000","last_peered":"2024-09-12T02:30:23.958029+0000","last_clean":"2024-09-12T02:30:23.958029+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.958029+0000","last_undegraded":"2024-09-12T02:30:23.958029+0000","last_fullsized":"2024-09-12T02:30:23.958029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587848+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587848+0000","last_peered":"2024-09-12T02:29:55.587848+0000","last_clean":"2024-09-12T02:29:55.587848+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587848+0000","last_undegraded":"2024-09-12T02:29:55.587848+0000","last_fullsized":"2024-09-12T02:29:55.587848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972102+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.972102+0000","last_peered":"2024-09-12T02:30:23.972102+0000","last_clean":"2024-09-12T02:30:23.972102+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.972102+0000","last_undegraded":"2024-09-12T02:30:23.972102+0000","last_fullsized":"2024-09-12T02:30:23.972102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640246+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640246+0000","last_peered":"2024-09-12T02:29:55.640246+0000","last_clean":"2024-09-12T02:29:55.640246+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640246+0000","last_undegraded":"2024-09-12T02:29:55.640246+0000","last_fullsized":"2024-09-12T02:29:55.640246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638722+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638722+0000","last_peered":"2024-09-12T02:29:55.638722+0000","last_clean":"2024-09-12T02:29:55.638722+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638722+0000","last_undegraded":"2024-09-12T02:29:55.638722+0000","last_fullsized":"2024-09-12T02:29:55.638722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.933510+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.933510+0000","last_peered":"2024-09-12T02:30:23.933510+0000","last_clean":"2024-09-12T02:30:23.933510+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.933510+0000","last_undegraded":"2024-09-12T02:30:23.933510+0000","last_fullsized":"2024-09-12T02:30:23.933510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585664+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585664+0000","last_peered":"2024-09-12T02:29:55.585664+0000","last_clean":"2024-09-12T02:29:55.585664+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585664+0000","last_undegraded":"2024-09-12T02:29:55.585664+0000","last_fullsized":"2024-09-12T02:29:55.585664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585044+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:29:55.585044+0000","last_peered":"2024-09-12T02:29:55.585044+0000","last_clean":"2024-09-12T02:29:55.585044+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:29:55.585044+0000","last_undegraded":"2024-09-12T02:29:55.585044+0000","last_fullsized":"2024-09-12T02:29:55.585044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976332+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976332+0000","last_peered":"2024-09-12T02:30:23.976332+0000","last_clean":"2024-09-12T02:30:23.976332+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976332+0000","last_undegraded":"2024-09-12T02:30:23.976332+0000","last_fullsized":"2024-09-12T02:30:23.976332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961761+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961761+0000","last_peered":"2024-09-12T02:30:23.961761+0000","last_clean":"2024-09-12T02:30:23.961761+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961761+0000","last_undegraded":"2024-09-12T02:30:23.961761+0000","last_fullsized":"2024-09-12T02:30:23.961761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":165,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:51.671344+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:51.671344+0000","last_peered":"2024-09-12T02:30:51.671344+0000","last_clean":"2024-09-12T02:30:51.671344+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:51.671344+0000","last_undegraded":"2024-09-12T02:30:51.671344+0000","last_fullsized":"2024-09-12T02:30:51.671344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1152,"num_read_kb":655,"num_write":262,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579942,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1094060,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972401,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430268,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":503473,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":503591,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:30:59.199 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:30:59.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:58 smithi173 ceph-mon[35036]: scrub queued for path: / 2024-09-12T02:30:59.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:58 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:59.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:58 smithi173 ceph-mon[35036]: scrub summary: active paths [/] 2024-09-12T02:30:59.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:58 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:30:59.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:30:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:59 smithi001 ceph-mon[31252]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T02:30:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:30:59 smithi001 ceph-mon[31252]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:30:59.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.961+0000 7efe49b71640 1 -- 172.21.15.1:0/3817741890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44102790 msgr2=0x7efe441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:59.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.961+0000 7efe49b71640 1 --2- 172.21.15.1:0/3817741890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44102790 0x7efe441067e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009900 tx=0x7efe2c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 -- 172.21.15.1:0/3817741890 shutdown_connections 2024-09-12T02:30:59.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 --2- 172.21.15.1:0/3817741890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44102790 0x7efe441067e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 --2- 172.21.15.1:0/3817741890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44106f10 0x7efe4410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 --2- 172.21.15.1:0/3817741890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 0x7efe441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 -- 172.21.15.1:0/3817741890 >> 172.21.15.1:0/3817741890 conn(0x7efe440fd8c0 msgr2=0x7efe440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 -- 172.21.15.1:0/3817741890 shutdown_connections 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 -- 172.21.15.1:0/3817741890 wait complete. 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 Processor -- start 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.962+0000 7efe49b71640 1 -- start start 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 0x7efe44198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44102790 0x7efe441988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe44111f70 con 0x7efe44106f10 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe44111df0 con 0x7efe44101de0 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe49b71640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efe441120f0 con 0x7efe44102790 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:59.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59260/0 (socket says 172.21.15.1:59260) 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 -- 172.21.15.1:0/1254364817 learned_addr learned my addr 172.21.15.1:0/1254364817 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe3affd640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44102790 0x7efe441988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe437fe640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 0x7efe44198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 -- 172.21.15.1:0/1254364817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44102790 msgr2=0x7efe441988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44102790 0x7efe441988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 -- 172.21.15.1:0/1254364817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 msgr2=0x7efe44198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 0x7efe44198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 -- 172.21.15.1:0/1254364817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4419d310 con 0x7efe44106f10 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.963+0000 7efe43fff640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00eaa0 tx=0x7efe3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.964+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c00cdb0 con 0x7efe44106f10 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.964+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe3c005020 con 0x7efe44106f10 2024-09-12T02:30:59.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.964+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4419d600 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.964+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0116b0 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.964+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe441a4ee0 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.965+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe441021c0 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.966+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7efe3c005560 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.967+0000 7efe417fa640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 0x7efe300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.967+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7efe3c0cf550 con 0x7efe44106f10 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.967+0000 7efe437fe640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 0x7efe300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.967+0000 7efe437fe640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 0x7efe300a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe34005e10 tx=0x7efe34005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:59.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:30:59.970+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe3c016030 con 0x7efe44106f10 2024-09-12T02:31:00.070 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:00.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.155+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe44062630 con 0x7efe300a2c00 2024-09-12T02:31:00.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.161+0000 7efe417fa640 1 -- 172.21.15.1:0/1254364817 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259143 (secure 0 0 0) 0x7efe44062630 con 0x7efe300a2c00 2024-09-12T02:31:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:00.165 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 msgr2=0x7efe300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 0x7efe300a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe34005e10 tx=0x7efe34005da0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 msgr2=0x7efe4419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00eaa0 tx=0x7efe3c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 shutdown_connections 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efe300a2c00 0x7efe300a50c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe44106f10 0x7efe4419cc30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe44102790 0x7efe441988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 --2- 172.21.15.1:0/1254364817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe44101de0 0x7efe44198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 >> 172.21.15.1:0/1254364817 conn(0x7efe440fd8c0 msgr2=0x7efe440fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 shutdown_connections 2024-09-12T02:31:00.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.165+0000 7efe49b71640 1 -- 172.21.15.1:0/1254364817 wait complete. 2024-09-12T02:31:00.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:59 smithi134 ceph-mon[35091]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T02:31:00.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:30:59 smithi134 ceph-mon[35091]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:59 smithi173 ceph-mon[35036]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T02:31:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:30:59 smithi173 ceph-mon[35036]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:00.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 -- 172.21.15.1:0/4175477280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704102790 msgr2=0x7f07041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 --2- 172.21.15.1:0/4175477280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704102790 0x7f07041067e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009ca0 tx=0x7f06f802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 -- 172.21.15.1:0/4175477280 shutdown_connections 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 --2- 172.21.15.1:0/4175477280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704102790 0x7f07041067e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 --2- 172.21.15.1:0/4175477280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704106f10 0x7f070410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 --2- 172.21.15.1:0/4175477280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 0x7f07041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 -- 172.21.15.1:0/4175477280 >> 172.21.15.1:0/4175477280 conn(0x7f07040fd8c0 msgr2=0x7f07040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 -- 172.21.15.1:0/4175477280 shutdown_connections 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.820+0000 7f0708e66640 1 -- 172.21.15.1:0/4175477280 wait complete. 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 Processor -- start 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 -- start start 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 0x7f070419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704102790 0x7f070419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0704111f70 con 0x7f0704106f10 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0704111df0 con 0x7f0704101de0 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0708e66640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07041120f0 con 0x7f0704102790 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59278/0 (socket says 172.21.15.1:59278) 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0702d9d640 1 -- 172.21.15.1:0/2444611938 learned_addr learned my addr 172.21.15.1:0/2444611938 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f070259c640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 0x7f070419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.821+0000 7f0701d9b640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704102790 0x7f070419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 -- 172.21.15.1:0/2444611938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704102790 msgr2=0x7f070419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704102790 0x7f070419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 -- 172.21.15.1:0/2444611938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 msgr2=0x7f070419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 0x7f070419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 -- 172.21.15.1:0/2444611938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070419f5c0 con 0x7f0704106f10 2024-09-12T02:31:00.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0702d9d640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00d750 tx=0x7f06fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f06f37fe640 1 -- 172.21.15.1:0/2444611938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc017070 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f06f37fe640 1 -- 172.21.15.1:0/2444611938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06fc005500 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070419f8b0 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f06f37fe640 1 -- 172.21.15.1:0/2444611938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc004d90 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.822+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07041a7190 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.824+0000 7f06f37fe640 1 -- 172.21.15.1:0/2444611938 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f06fc004f30 con 0x7f0704106f10 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.824+0000 7f070b23f740 1 Processor -- start 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 -- start start 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f571dc0 0x56096f57c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f57ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56096f4d72e0 con 0x56096f5714a0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56096f47ece0 con 0x56096f571dc0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070b23f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56096f4d32a0 con 0x56096f57c680 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59284/0 (socket says 172.21.15.1:59284) 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 -- 172.21.15.1:0/1332203149 learned_addr learned my addr 172.21.15.1:0/1332203149 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f57ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f070259c640 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f571dc0 0x56096f57c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 -- 172.21.15.1:0/1332203149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 msgr2=0x56096f57ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f57ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 -- 172.21.15.1:0/1332203149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f571dc0 msgr2=0x56096f57c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f571dc0 0x56096f57c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.825+0000 7f0701d9b640 1 -- 172.21.15.1:0/1332203149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56096f463440 con 0x56096f5714a0 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f06f37fe640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 0x7f06ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x56096f56edb0 tx=0x7f06f8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41cab1d9bdc448e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f070259c640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 0x7f06ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f06f37fe640 1 -- 172.21.15.1:0/2444611938 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f06fc0ce900 con 0x7f0704106f10 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f06f0ff9640 1 -- 172.21.15.1:0/1332203149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031650 con 0x56096f5714a0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f06f0ff9640 1 -- 172.21.15.1:0/1332203149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8036040 con 0x56096f5714a0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.826+0000 7f06f0ff9640 1 -- 172.21.15.1:0/1332203149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8030820 con 0x56096f5714a0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- 172.21.15.1:0/1332203149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 msgr2=0x56096f571880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070259c640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 0x7f06ec0a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56096f56e890 tx=0x7f06f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x56096f56edb0 tx=0x7f06f8005fa0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- 172.21.15.1:0/1332203149 shutdown_connections 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f57ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f571dc0 0x56096f57c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- 172.21.15.1:0/1332203149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f5714a0 0x56096f571880 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- 172.21.15.1:0/1332203149 >> 172.21.15.1:0/1332203149 conn(0x56096f56da30 msgr2=0x56096f56de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- 172.21.15.1:0/1332203149 shutdown_connections 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- 172.21.15.1:0/1332203149 wait complete. 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 -- start start 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 Processor -- start 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f57bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.827+0000 7f070b23f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 0x56096f579240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56096f57f0d0 con 0x56096f57c680 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56096f492050 con 0x56096f5714a0 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56096f57f250 con 0x56096f571dc0 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 10 client.0 _ll_register_callbacks cb 0x56096f4d2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59296/0 (socket says 172.21.15.1:59296) 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 -- 172.21.15.1:0/1876422971 learned_addr learned my addr 172.21.15.1:0/1876422971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:00.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070259c640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f57bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 0x56096f579240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 -- 172.21.15.1:0/1876422971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 msgr2=0x56096f579240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 0x56096f579240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 -- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 msgr2=0x56096f57bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f57bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 -- 172.21.15.1:0/1876422971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56096f2483c0 con 0x56096f57c680 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0701d9b640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 0x56096f579240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f0702d9d640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06fc09aef0 tx=0x7f06fc09ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e907d61d5ed8be32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f06e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc020070 con 0x56096f57c680 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f06fc0bb0b0 con 0x56096f57c680 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f8036040 con 0x56096f57c680 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06fc0b4120 con 0x56096f57c680 2024-09-12T02:31:00.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 10 client.15306 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.828+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56096f58aa50 con 0x56096f57c680 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8036040 con 0x56096f57c680 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06fc097860 con 0x56096f57c680 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 20 client.15306 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f58bf10 0x56096f58e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 4 client.15306 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56096f4e4850 con 0x56096f58bf10 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.829+0000 7f070259c640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f58bf10 0x56096f58e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070259c640 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f58bf10 0x56096f58e300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452f3ef52ce0df62 server_cookie=dc82235755b77078 in_seq=0 out_seq=0 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f06e9ffb640 10 client.15306 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f06e9ffb640 1 -- 172.21.15.1:0/1876422971 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56096f4e4850 con 0x56096f58bf10 2024-09-12T02:31:00.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f06e9ffb640 10 client.15306 handle_command_reply: tid=0 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 client.15306 shutdown 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 msgr2=0x56096f579780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06fc09aef0 tx=0x7f06fc09ac10 comp rx=0 tx=0).stop 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 shutdown_connections 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f57c680 0x56096f579780 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f58bf10 0x56096f58e300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f571dc0 0x56096f579240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 --2- 172.21.15.1:0/1876422971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f57bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f06e9ffb640 0 client.15306 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.830+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 >> 172.21.15.1:0/1876422971 conn(0x56096f56da30 msgr2=0x56096f573760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.831+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 shutdown_connections 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.831+0000 7f070b23f740 1 -- 172.21.15.1:0/1876422971 wait complete. 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.831+0000 7f070b23f740 20 client.15306 trim_cache size 0 max 16384 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 Processor -- start 2024-09-12T02:31:00.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 -- start start 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f577b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f5940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f07041af7b0 con 0x56096f571dc0 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07041b12f0 con 0x56096f5714a0 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070b23f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07041afe80 con 0x56096f57c680 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59300/0 (socket says 172.21.15.1:59300) 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 -- 172.21.15.1:0/2812775218 learned_addr learned my addr 172.21.15.1:0/2812775218 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0702d9d640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f5940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070259c640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f577b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 -- 172.21.15.1:0/2812775218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 msgr2=0x56096f5940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f5940c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 -- 172.21.15.1:0/2812775218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 msgr2=0x56096f577b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f577b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0701d9b640 1 -- 172.21.15.1:0/2812775218 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56096f5781f0 con 0x56096f571dc0 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f0702d9d640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f5940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.848+0000 7f070259c640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f577b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f0701d9b640 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06f8005f70 tx=0x7f06f8031d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd663d1410d6d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f06ebfff640 1 -- 172.21.15.1:0/2812775218 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031450 con 0x56096f571dc0 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f06ebfff640 1 -- 172.21.15.1:0/2812775218 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8036040 con 0x56096f571dc0 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f06ebfff640 1 -- 172.21.15.1:0/2812775218 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f80305c0 con 0x56096f571dc0 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 -- 172.21.15.1:0/2812775218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 msgr2=0x56096f593b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06f8005f70 tx=0x7f06f8031d80 comp rx=0 tx=0).stop 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 -- 172.21.15.1:0/2812775218 shutdown_connections 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f593b80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f57c680 0x56096f5940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 --2- 172.21.15.1:0/2812775218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f5714a0 0x56096f577b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 -- 172.21.15.1:0/2812775218 >> 172.21.15.1:0/2812775218 conn(0x56096f56da30 msgr2=0x56096f57b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 -- 172.21.15.1:0/2812775218 shutdown_connections 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.849+0000 7f070b23f740 1 -- 172.21.15.1:0/2812775218 wait complete. 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 -- start start 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 Processor -- start 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f5714a0 0x56096f584b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 0x56096f5823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f07041b0c20 con 0x56096f571dc0 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f07041b0550 con 0x56096f57c680 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07041ad790 con 0x56096f5714a0 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070b23f740 10 client.0 _ll_register_callbacks cb 0x7f06fc009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:00.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f070259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f5714a0 0x56096f584b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59304/0 (socket says 172.21.15.1:59304) 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 -- 172.21.15.1:0/602627535 learned_addr learned my addr 172.21.15.1:0/602627535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0702d9d640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 0x56096f5823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 -- 172.21.15.1:0/602627535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f5714a0 msgr2=0x56096f584b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f5714a0 0x56096f584b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 -- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 msgr2=0x56096f5823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 0x56096f5823d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0701d9b640 1 -- 172.21.15.1:0/602627535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56096f582c00 con 0x56096f571dc0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.850+0000 7f0702d9d640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 0x56096f5823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f0701d9b640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009ca0 tx=0x7f06f802f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65833383fb4b2087 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031650 con 0x56096f571dc0 2024-09-12T02:31:00.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f06f80317f0 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f8036040 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06f802f960 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f070b23f740 10 client.15312 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56096f5f6a50 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8036040 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.851+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06f804a740 con 0x56096f571dc0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 10 client.15312 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 20 client.15312 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f5f6e30 0x56096f5f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 4 client.15312 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56096f4ded60 con 0x56096f5f6e30 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070259c640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f5f6e30 0x56096f5f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070259c640 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f5f6e30 0x56096f5f9220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a01b24942bb3d34 server_cookie=37cfa5c0e3d86956 in_seq=0 out_seq=0 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f06e9ffb640 10 client.15312 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f06e9ffb640 1 -- 172.21.15.1:0/602627535 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56096f4ded60 con 0x56096f5f6e30 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f06e9ffb640 10 client.15312 handle_command_reply: tid=0 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 1 client.15312 shutdown 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.852+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 msgr2=0x56096f581e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009ca0 tx=0x7f06f802f4b0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 shutdown_connections 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56096f571dc0 0x56096f581e90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56096f5f6e30 0x56096f5f9220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56096f57c680 0x56096f5823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 --2- 172.21.15.1:0/602627535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56096f5714a0 0x56096f584b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f06e9ffb640 0 client.15312 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 >> 172.21.15.1:0/602627535 conn(0x56096f56da30 msgr2=0x56096f56cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 shutdown_connections 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 1 -- 172.21.15.1:0/602627535 wait complete. 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f070b23f740 20 client.15312 trim_cache size 0 max 16384 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "8a1c3570-cb67-4fde-919c-fd040df589ce": { 2024-09-12T02:31:00.869 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-12T02:31:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "8a1c3570-cb67-4fde-919c-fd040df589ce", 2024-09-12T02:31:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-12T02:31:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:00.870 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:00.870 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 msgr2=0x7f06ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 0x7f06ec0a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56096f56e890 tx=0x7f06f400b410 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 msgr2=0x7f070419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00d750 tx=0x7f06fc00dc10 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 shutdown_connections 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f06ec0a2b80 0x7f06ec0a5040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0704106f10 0x7f070419eee0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0704102790 0x7f070419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 --2- 172.21.15.1:0/2444611938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0704101de0 0x7f070419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 >> 172.21.15.1:0/2444611938 conn(0x7f07040fd8c0 msgr2=0x7f07040fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:00.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.853+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 shutdown_connections 2024-09-12T02:31:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:00.854+0000 7f0708e66640 1 -- 172.21.15.1:0/2444611938 wait complete. 2024-09-12T02:31:01.568 INFO:tasks.cephfs.filesystem:scrub status for tag:8a1c3570-cb67-4fde-919c-fd040df589ce - {'path': '/', 'tag': '8a1c3570-cb67-4fde-919c-fd040df589ce', 'options': 'recursive,force'} 2024-09-12T02:31:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:01 smithi001 ceph-mon[31252]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:01 smithi001 ceph-mon[31252]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:01 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:01 smithi134 ceph-mon[35091]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:01 smithi134 ceph-mon[35091]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:01.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:01 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:01 smithi173 ceph-mon[35036]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:01 smithi173 ceph-mon[35036]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:01 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:02.115 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-12T02:30:59.998892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665099,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1310,"num_read_kb":786,"num_write":445,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381160,"kb_used_data":11112,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560664,"statfs":{"total":1151940427776,"available":1151550119936,"internally_reserved":0,"allocated":11378688,"data_stored":7210569,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":79,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002735"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976962+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.976962+0000","last_peered":"2024-09-12T02:30:23.976962+0000","last_clean":"2024-09-12T02:30:23.976962+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.976962+0000","last_undegraded":"2024-09-12T02:30:23.976962+0000","last_fullsized":"2024-09-12T02:30:23.976962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968118+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.968118+0000","last_peered":"2024-09-12T02:30:23.968118+0000","last_clean":"2024-09-12T02:30:23.968118+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.968118+0000","last_undegraded":"2024-09-12T02:30:23.968118+0000","last_fullsized":"2024-09-12T02:30:23.968118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976560+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976560+0000","last_peered":"2024-09-12T02:30:23.976560+0000","last_clean":"2024-09-12T02:30:23.976560+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976560+0000","last_undegraded":"2024-09-12T02:30:23.976560+0000","last_fullsized":"2024-09-12T02:30:23.976560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966466+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966466+0000","last_peered":"2024-09-12T02:30:23.966466+0000","last_clean":"2024-09-12T02:30:23.966466+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966466+0000","last_undegraded":"2024-09-12T02:30:23.966466+0000","last_fullsized":"2024-09-12T02:30:23.966466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965785+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.965785+0000","last_peered":"2024-09-12T02:30:23.965785+0000","last_clean":"2024-09-12T02:30:23.965785+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.965785+0000","last_undegraded":"2024-09-12T02:30:23.965785+0000","last_fullsized":"2024-09-12T02:30:23.965785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967391+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.967391+0000","last_peered":"2024-09-12T02:30:23.967391+0000","last_clean":"2024-09-12T02:30:23.967391+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.967391+0000","last_undegraded":"2024-09-12T02:30:23.967391+0000","last_fullsized":"2024-09-12T02:30:23.967391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968312+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968312+0000","last_peered":"2024-09-12T02:30:23.968312+0000","last_clean":"2024-09-12T02:30:23.968312+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968312+0000","last_undegraded":"2024-09-12T02:30:23.968312+0000","last_fullsized":"2024-09-12T02:30:23.968312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970327+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970327+0000","last_peered":"2024-09-12T02:30:23.970327+0000","last_clean":"2024-09-12T02:30:23.970327+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970327+0000","last_undegraded":"2024-09-12T02:30:23.970327+0000","last_fullsized":"2024-09-12T02:30:23.970327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190688+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:54.190688+0000","last_peered":"2024-09-12T02:30:54.190688+0000","last_clean":"2024-09-12T02:30:54.190688+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:54.190688+0000","last_undegraded":"2024-09-12T02:30:54.190688+0000","last_fullsized":"2024-09-12T02:30:54.190688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":257,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.197623+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:59.197623+0000","last_peered":"2024-09-12T02:30:59.197623+0000","last_clean":"2024-09-12T02:30:59.197623+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:59.197623+0000","last_undegraded":"2024-09-12T02:30:59.197623+0000","last_fullsized":"2024-09-12T02:30:59.197623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":302,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.197486+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:59.197486+0000","last_peered":"2024-09-12T02:30:59.197486+0000","last_clean":"2024-09-12T02:30:59.197486+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:59.197486+0000","last_undegraded":"2024-09-12T02:30:59.197486+0000","last_fullsized":"2024-09-12T02:30:59.197486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66699,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":243,"num_read_kb":186,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:54.190067+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:54.190067+0000","last_peered":"2024-09-12T02:30:54.190067+0000","last_clean":"2024-09-12T02:30:54.190067+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:54.190067+0000","last_undegraded":"2024-09-12T02:30:54.190067+0000","last_fullsized":"2024-09-12T02:30:54.190067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:58.209862+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:58.209862+0000","last_peered":"2024-09-12T02:30:58.209862+0000","last_clean":"2024-09-12T02:30:58.209862+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:58.209862+0000","last_undegraded":"2024-09-12T02:30:58.209862+0000","last_fullsized":"2024-09-12T02:30:58.209862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639941+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639941+0000","last_peered":"2024-09-12T02:29:55.639941+0000","last_clean":"2024-09-12T02:29:55.639941+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639941+0000","last_undegraded":"2024-09-12T02:29:55.639941+0000","last_fullsized":"2024-09-12T02:29:55.639941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644878+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644878+0000","last_peered":"2024-09-12T02:29:55.644878+0000","last_clean":"2024-09-12T02:29:55.644878+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644878+0000","last_undegraded":"2024-09-12T02:29:55.644878+0000","last_fullsized":"2024-09-12T02:29:55.644878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972079+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.972079+0000","last_peered":"2024-09-12T02:30:23.972079+0000","last_clean":"2024-09-12T02:30:23.972079+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.972079+0000","last_undegraded":"2024-09-12T02:30:23.972079+0000","last_fullsized":"2024-09-12T02:30:23.972079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.194037+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:57.194037+0000","last_peered":"2024-09-12T02:30:57.194037+0000","last_clean":"2024-09-12T02:30:57.194037+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:57.194037+0000","last_undegraded":"2024-09-12T02:30:57.194037+0000","last_fullsized":"2024-09-12T02:30:57.194037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969068+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.969068+0000","last_peered":"2024-09-12T02:30:23.969068+0000","last_clean":"2024-09-12T02:30:23.969068+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.969068+0000","last_undegraded":"2024-09-12T02:30:23.969068+0000","last_fullsized":"2024-09-12T02:30:23.969068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.679759+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:57.679759+0000","last_peered":"2024-09-12T02:30:57.679759+0000","last_clean":"2024-09-12T02:30:57.679759+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:57.679759+0000","last_undegraded":"2024-09-12T02:30:57.679759+0000","last_fullsized":"2024-09-12T02:30:57.679759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961630+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961630+0000","last_peered":"2024-09-12T02:30:23.961630+0000","last_clean":"2024-09-12T02:30:23.961630+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961630+0000","last_undegraded":"2024-09-12T02:30:23.961630+0000","last_fullsized":"2024-09-12T02:30:23.961630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586466+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.586466+0000","last_peered":"2024-09-12T02:29:55.586466+0000","last_clean":"2024-09-12T02:29:55.586466+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.586466+0000","last_undegraded":"2024-09-12T02:29:55.586466+0000","last_fullsized":"2024-09-12T02:29:55.586466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966439+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.966439+0000","last_peered":"2024-09-12T02:30:23.966439+0000","last_clean":"2024-09-12T02:30:23.966439+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.966439+0000","last_undegraded":"2024-09-12T02:30:23.966439+0000","last_fullsized":"2024-09-12T02:30:23.966439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587848+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587848+0000","last_peered":"2024-09-12T02:29:55.587848+0000","last_clean":"2024-09-12T02:29:55.587848+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587848+0000","last_undegraded":"2024-09-12T02:29:55.587848+0000","last_fullsized":"2024-09-12T02:29:55.587848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972102+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.972102+0000","last_peered":"2024-09-12T02:30:23.972102+0000","last_clean":"2024-09-12T02:30:23.972102+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.972102+0000","last_undegraded":"2024-09-12T02:30:23.972102+0000","last_fullsized":"2024-09-12T02:30:23.972102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640246+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640246+0000","last_peered":"2024-09-12T02:29:55.640246+0000","last_clean":"2024-09-12T02:29:55.640246+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640246+0000","last_undegraded":"2024-09-12T02:29:55.640246+0000","last_fullsized":"2024-09-12T02:29:55.640246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638780+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638780+0000","last_peered":"2024-09-12T02:29:55.638780+0000","last_clean":"2024-09-12T02:29:55.638780+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638780+0000","last_undegraded":"2024-09-12T02:29:55.638780+0000","last_fullsized":"2024-09-12T02:29:55.638780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.933510+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.933510+0000","last_peered":"2024-09-12T02:30:23.933510+0000","last_clean":"2024-09-12T02:30:23.933510+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.933510+0000","last_undegraded":"2024-09-12T02:30:23.933510+0000","last_fullsized":"2024-09-12T02:30:23.933510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585714+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585714+0000","last_peered":"2024-09-12T02:29:55.585714+0000","last_clean":"2024-09-12T02:29:55.585714+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585714+0000","last_undegraded":"2024-09-12T02:29:55.585714+0000","last_fullsized":"2024-09-12T02:29:55.585714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:48.023186+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:30:48.023186+0000","last_peered":"2024-09-12T02:30:48.023186+0000","last_clean":"2024-09-12T02:30:48.023186+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:30:48.023186+0000","last_undegraded":"2024-09-12T02:30:48.023186+0000","last_fullsized":"2024-09-12T02:30:48.023186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976436+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976436+0000","last_peered":"2024-09-12T02:30:23.976436+0000","last_clean":"2024-09-12T02:30:23.976436+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976436+0000","last_undegraded":"2024-09-12T02:30:23.976436+0000","last_fullsized":"2024-09-12T02:30:23.976436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961761+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961761+0000","last_peered":"2024-09-12T02:30:23.961761+0000","last_clean":"2024-09-12T02:30:23.961761+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961761+0000","last_undegraded":"2024-09-12T02:30:23.961761+0000","last_fullsized":"2024-09-12T02:30:23.961761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":172,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.679275+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:57.679275+0000","last_peered":"2024-09-12T02:30:57.679275+0000","last_clean":"2024-09-12T02:30:57.679275+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:57.679275+0000","last_undegraded":"2024-09-12T02:30:57.679275+0000","last_fullsized":"2024-09-12T02:30:57.679275+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1184,"num_read_kb":677,"num_write":262,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579942,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1094060,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972402,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430268,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":503473,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":503591,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:31:02.119 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:31:02.120 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:31:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:03.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 -- 172.21.15.1:0/3630760594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458102e00 msgr2=0x7fb4581031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/3630760594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458102e00 0x7fb4581031e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb448009900 tx=0x7fb44802a480 comp rx=0 tx=0).stop 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 -- 172.21.15.1:0/3630760594 shutdown_connections 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/3630760594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb45810c1a0 0x7fb45810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/3630760594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb458103720 0x7fb45810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/3630760594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458102e00 0x7fb4581031e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 -- 172.21.15.1:0/3630760594 >> 172.21.15.1:0/3630760594 conn(0x7fb4580fc7a0 msgr2=0x7fb4580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 -- 172.21.15.1:0/3630760594 shutdown_connections 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.580+0000 7fb45d1f5640 1 -- 172.21.15.1:0/3630760594 wait complete. 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.581+0000 7fb45d1f5640 1 Processor -- start 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.581+0000 7fb45d1f5640 1 -- start start 2024-09-12T02:31:03.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 0x7fb458198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb45810c1a0 0x7fb45819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111f70 con 0x7fb458103720 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb458111df0 con 0x7fb45810c1a0 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45d1f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581120f0 con 0x7fb458102e00 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 0x7fb458198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42486/0 (socket says 172.21.15.1:42486) 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45659c640 1 -- 172.21.15.1:0/2428249276 learned_addr learned my addr 172.21.15.1:0/2428249276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45759e640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb45810c1a0 0x7fb45819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 -- 172.21.15.1:0/2428249276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb45810c1a0 msgr2=0x7fb45819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:03.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb45810c1a0 0x7fb45819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 -- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 msgr2=0x7fb4581989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 -- 172.21.15.1:0/2428249276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45819d420 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb45659c640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.582+0000 7fb456d9d640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 0x7fb458198470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb448005940 tx=0x7fb4480042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.583+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44803f030 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.583+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45819d6b0 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.583+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb448003ce0 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.583+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448035070 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.583+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a4ff0 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.584+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45806afb0 con 0x7fb458102e00 2024-09-12T02:31:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.585+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb448042030 con 0x7fb458102e00 2024-09-12T02:31:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.585+0000 7fb43ffff640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.585+0000 7fb45659c640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.586+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb4480ef820 con 0x7fb458102e00 2024-09-12T02:31:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.586+0000 7fb45659c640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 0x7fb4400a5040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb45810d620 tx=0x7fb44c00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:03.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.590+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4480bc110 con 0x7fb458102e00 2024-09-12T02:31:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.790+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 --> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb458062630 con 0x7fb4400a2b80 2024-09-12T02:31:03.791 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:03 smithi001 ceph-mon[31252]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:31:03.791 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.791 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.791 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.791 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:03 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.799+0000 7fb43ffff640 1 -- 172.21.15.1:0/2428249276 <== mgr.14150 v2:172.21.15.1:6800/3015676599 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259142 (secure 0 0 0) 0x7fb458062630 con 0x7fb4400a2b80 2024-09-12T02:31:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:03.803 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-12T02:31:03.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 msgr2=0x7fb4400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:03.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 0x7fb4400a5040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb45810d620 tx=0x7fb44c00a380 comp rx=0 tx=0).stop 2024-09-12T02:31:03.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 msgr2=0x7fb458198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:03.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 0x7fb458198470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb448005940 tx=0x7fb4480042f0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 shutdown_connections 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb4400a2b80 0x7fb4400a5040 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb458103720 0x7fb4581989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb45810c1a0 0x7fb45819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 --2- 172.21.15.1:0/2428249276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb458102e00 0x7fb458198470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 >> 172.21.15.1:0/2428249276 conn(0x7fb4580fc7a0 msgr2=0x7fb4580fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 shutdown_connections 2024-09-12T02:31:03.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:03.803+0000 7fb45d1f5640 1 -- 172.21.15.1:0/2428249276 wait complete. 2024-09-12T02:31:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:03 smithi134 ceph-mon[35091]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:31:03.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:03 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:03 smithi173 ceph-mon[35036]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-12T02:31:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:03.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:03 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:04.540 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-09-12T02:31:01.999332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665099,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":786,"num_write":445,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1181520,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381160,"kb_used_data":11112,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560664,"statfs":{"total":1151940427776,"available":1151550119936,"internally_reserved":0,"allocated":11378688,"data_stored":7210569,"data_compressed":178278,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4622,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":58,"num_write":2,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002679"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977073+0000","last_change":"2024-09-12T02:28:51.983897+0000","last_active":"2024-09-12T02:30:23.977073+0000","last_peered":"2024-09-12T02:30:23.977073+0000","last_clean":"2024-09-12T02:30:23.977073+0000","last_became_active":"2024-09-12T02:28:51.983588+0000","last_became_peered":"2024-09-12T02:28:51.983588+0000","last_unstale":"2024-09-12T02:30:23.977073+0000","last_undegraded":"2024-09-12T02:30:23.977073+0000","last_fullsized":"2024-09-12T02:30:23.977073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:43.089262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968118+0000","last_change":"2024-09-12T02:28:51.980204+0000","last_active":"2024-09-12T02:30:23.968118+0000","last_peered":"2024-09-12T02:30:23.968118+0000","last_clean":"2024-09-12T02:30:23.968118+0000","last_became_active":"2024-09-12T02:28:51.979894+0000","last_became_peered":"2024-09-12T02:28:51.979894+0000","last_unstale":"2024-09-12T02:30:23.968118+0000","last_undegraded":"2024-09-12T02:30:23.968118+0000","last_fullsized":"2024-09-12T02:30:23.968118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:47.857275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976560+0000","last_change":"2024-09-12T02:28:51.987285+0000","last_active":"2024-09-12T02:30:23.976560+0000","last_peered":"2024-09-12T02:30:23.976560+0000","last_clean":"2024-09-12T02:30:23.976560+0000","last_became_active":"2024-09-12T02:28:51.985824+0000","last_became_peered":"2024-09-12T02:28:51.985824+0000","last_unstale":"2024-09-12T02:30:23.976560+0000","last_undegraded":"2024-09-12T02:30:23.976560+0000","last_fullsized":"2024-09-12T02:30:23.976560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:34.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966466+0000","last_change":"2024-09-12T02:28:51.992120+0000","last_active":"2024-09-12T02:30:23.966466+0000","last_peered":"2024-09-12T02:30:23.966466+0000","last_clean":"2024-09-12T02:30:23.966466+0000","last_became_active":"2024-09-12T02:28:51.991813+0000","last_became_peered":"2024-09-12T02:28:51.991813+0000","last_unstale":"2024-09-12T02:30:23.966466+0000","last_undegraded":"2024-09-12T02:30:23.966466+0000","last_fullsized":"2024-09-12T02:30:23.966466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:05.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961925+0000","last_change":"2024-09-12T02:28:51.977698+0000","last_active":"2024-09-12T02:30:23.961925+0000","last_peered":"2024-09-12T02:30:23.961925+0000","last_clean":"2024-09-12T02:30:23.961925+0000","last_became_active":"2024-09-12T02:28:51.977356+0000","last_became_peered":"2024-09-12T02:28:51.977356+0000","last_unstale":"2024-09-12T02:30:23.961925+0000","last_undegraded":"2024-09-12T02:30:23.961925+0000","last_fullsized":"2024-09-12T02:30:23.961925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:02.317459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971810+0000","last_change":"2024-09-12T02:28:51.981532+0000","last_active":"2024-09-12T02:30:23.971810+0000","last_peered":"2024-09-12T02:30:23.971810+0000","last_clean":"2024-09-12T02:30:23.971810+0000","last_became_active":"2024-09-12T02:28:51.980419+0000","last_became_peered":"2024-09-12T02:28:51.980419+0000","last_unstale":"2024-09-12T02:30:23.971810+0000","last_undegraded":"2024-09-12T02:30:23.971810+0000","last_fullsized":"2024-09-12T02:30:23.971810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:26.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.971247+0000","last_change":"2024-09-12T02:28:51.986839+0000","last_active":"2024-09-12T02:30:23.971247+0000","last_peered":"2024-09-12T02:30:23.971247+0000","last_clean":"2024-09-12T02:30:23.971247+0000","last_became_active":"2024-09-12T02:28:51.985407+0000","last_became_peered":"2024-09-12T02:28:51.985407+0000","last_unstale":"2024-09-12T02:30:23.971247+0000","last_undegraded":"2024-09-12T02:30:23.971247+0000","last_fullsized":"2024-09-12T02:30:23.971247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:53.860612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966760+0000","last_change":"2024-09-12T02:28:51.984933+0000","last_active":"2024-09-12T02:30:23.966760+0000","last_peered":"2024-09-12T02:30:23.966760+0000","last_clean":"2024-09-12T02:30:23.966760+0000","last_became_active":"2024-09-12T02:28:51.984610+0000","last_became_peered":"2024-09-12T02:28:51.984610+0000","last_unstale":"2024-09-12T02:30:23.966760+0000","last_undegraded":"2024-09-12T02:30:23.966760+0000","last_fullsized":"2024-09-12T02:30:23.966760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:29.006081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981162+0000","last_change":"2024-09-12T02:28:51.980266+0000","last_active":"2024-09-12T02:30:23.981162+0000","last_peered":"2024-09-12T02:30:23.981162+0000","last_clean":"2024-09-12T02:30:23.981162+0000","last_became_active":"2024-09-12T02:28:51.979940+0000","last_became_peered":"2024-09-12T02:28:51.979940+0000","last_unstale":"2024-09-12T02:30:23.981162+0000","last_undegraded":"2024-09-12T02:30:23.981162+0000","last_fullsized":"2024-09-12T02:30:23.981162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.960300+0000","last_change":"2024-09-12T02:28:51.986726+0000","last_active":"2024-09-12T02:30:23.960300+0000","last_peered":"2024-09-12T02:30:23.960300+0000","last_clean":"2024-09-12T02:30:23.960300+0000","last_became_active":"2024-09-12T02:28:51.986363+0000","last_became_peered":"2024-09-12T02:28:51.986363+0000","last_unstale":"2024-09-12T02:30:23.960300+0000","last_undegraded":"2024-09-12T02:30:23.960300+0000","last_fullsized":"2024-09-12T02:30:23.960300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:27.448510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977161+0000","last_change":"2024-09-12T02:28:51.984200+0000","last_active":"2024-09-12T02:30:23.977161+0000","last_peered":"2024-09-12T02:30:23.977161+0000","last_clean":"2024-09-12T02:30:23.977161+0000","last_became_active":"2024-09-12T02:28:51.982337+0000","last_became_peered":"2024-09-12T02:28:51.982337+0000","last_unstale":"2024-09-12T02:30:23.977161+0000","last_undegraded":"2024-09-12T02:30:23.977161+0000","last_fullsized":"2024-09-12T02:30:23.977161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.469656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965419+0000","last_change":"2024-09-12T02:28:51.989096+0000","last_active":"2024-09-12T02:30:23.965419+0000","last_peered":"2024-09-12T02:30:23.965419+0000","last_clean":"2024-09-12T02:30:23.965419+0000","last_became_active":"2024-09-12T02:28:51.988766+0000","last_became_peered":"2024-09-12T02:28:51.988766+0000","last_unstale":"2024-09-12T02:30:23.965419+0000","last_undegraded":"2024-09-12T02:30:23.965419+0000","last_fullsized":"2024-09-12T02:30:23.965419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:46.684182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969903+0000","last_change":"2024-09-12T02:28:51.976880+0000","last_active":"2024-09-12T02:30:23.969903+0000","last_peered":"2024-09-12T02:30:23.969903+0000","last_clean":"2024-09-12T02:30:23.969903+0000","last_became_active":"2024-09-12T02:28:51.976586+0000","last_became_peered":"2024-09-12T02:28:51.976586+0000","last_unstale":"2024-09-12T02:30:23.969903+0000","last_undegraded":"2024-09-12T02:30:23.969903+0000","last_fullsized":"2024-09-12T02:30:23.969903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:32.577865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966260+0000","last_change":"2024-09-12T02:28:51.977992+0000","last_active":"2024-09-12T02:30:23.966260+0000","last_peered":"2024-09-12T02:30:23.966260+0000","last_clean":"2024-09-12T02:30:23.966260+0000","last_became_active":"2024-09-12T02:28:51.977612+0000","last_became_peered":"2024-09-12T02:28:51.977612+0000","last_unstale":"2024-09-12T02:30:23.966260+0000","last_undegraded":"2024-09-12T02:30:23.966260+0000","last_fullsized":"2024-09-12T02:30:23.966260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:56.296142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965164+0000","last_change":"2024-09-12T02:28:51.984405+0000","last_active":"2024-09-12T02:30:23.965164+0000","last_peered":"2024-09-12T02:30:23.965164+0000","last_clean":"2024-09-12T02:30:23.965164+0000","last_became_active":"2024-09-12T02:28:51.984083+0000","last_became_peered":"2024-09-12T02:28:51.984083+0000","last_unstale":"2024-09-12T02:30:23.965164+0000","last_undegraded":"2024-09-12T02:30:23.965164+0000","last_fullsized":"2024-09-12T02:30:23.965164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:07.978239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981074+0000","last_change":"2024-09-12T02:28:51.987259+0000","last_active":"2024-09-12T02:30:23.981074+0000","last_peered":"2024-09-12T02:30:23.981074+0000","last_clean":"2024-09-12T02:30:23.981074+0000","last_became_active":"2024-09-12T02:28:51.986923+0000","last_became_peered":"2024-09-12T02:28:51.986923+0000","last_unstale":"2024-09-12T02:30:23.981074+0000","last_undegraded":"2024-09-12T02:30:23.981074+0000","last_fullsized":"2024-09-12T02:30:23.981074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:06.223666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.977198+0000","last_change":"2024-09-12T02:28:51.984664+0000","last_active":"2024-09-12T02:30:23.977198+0000","last_peered":"2024-09-12T02:30:23.977198+0000","last_clean":"2024-09-12T02:30:23.977198+0000","last_became_active":"2024-09-12T02:28:51.984367+0000","last_became_peered":"2024-09-12T02:28:51.984367+0000","last_unstale":"2024-09-12T02:30:23.977198+0000","last_undegraded":"2024-09-12T02:30:23.977198+0000","last_fullsized":"2024-09-12T02:30:23.977198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:01.825379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973253+0000","last_change":"2024-09-12T02:28:51.976309+0000","last_active":"2024-09-12T02:30:23.973253+0000","last_peered":"2024-09-12T02:30:23.973253+0000","last_clean":"2024-09-12T02:30:23.973253+0000","last_became_active":"2024-09-12T02:28:51.975992+0000","last_became_peered":"2024-09-12T02:28:51.975992+0000","last_unstale":"2024-09-12T02:30:23.973253+0000","last_undegraded":"2024-09-12T02:30:23.973253+0000","last_fullsized":"2024-09-12T02:30:23.973253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:16.567934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967324+0000","last_change":"2024-09-12T02:28:51.992891+0000","last_active":"2024-09-12T02:30:23.967324+0000","last_peered":"2024-09-12T02:30:23.967324+0000","last_clean":"2024-09-12T02:30:23.967324+0000","last_became_active":"2024-09-12T02:28:51.992281+0000","last_became_peered":"2024-09-12T02:28:51.992281+0000","last_unstale":"2024-09-12T02:30:23.967324+0000","last_undegraded":"2024-09-12T02:30:23.967324+0000","last_fullsized":"2024-09-12T02:30:23.967324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:00.110100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970214+0000","last_change":"2024-09-12T02:28:51.990085+0000","last_active":"2024-09-12T02:30:23.970214+0000","last_peered":"2024-09-12T02:30:23.970214+0000","last_clean":"2024-09-12T02:30:23.970214+0000","last_became_active":"2024-09-12T02:28:51.989720+0000","last_became_peered":"2024-09-12T02:28:51.989720+0000","last_unstale":"2024-09-12T02:30:23.970214+0000","last_undegraded":"2024-09-12T02:30:23.970214+0000","last_fullsized":"2024-09-12T02:30:23.970214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:09.098573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973164+0000","last_change":"2024-09-12T02:28:51.985745+0000","last_active":"2024-09-12T02:30:23.973164+0000","last_peered":"2024-09-12T02:30:23.973164+0000","last_clean":"2024-09-12T02:30:23.973164+0000","last_became_active":"2024-09-12T02:28:51.985399+0000","last_became_peered":"2024-09-12T02:28:51.985399+0000","last_unstale":"2024-09-12T02:30:23.973164+0000","last_undegraded":"2024-09-12T02:30:23.973164+0000","last_fullsized":"2024-09-12T02:30:23.973164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:20.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981161+0000","last_change":"2024-09-12T02:28:51.992039+0000","last_active":"2024-09-12T02:30:23.981161+0000","last_peered":"2024-09-12T02:30:23.981161+0000","last_clean":"2024-09-12T02:30:23.981161+0000","last_became_active":"2024-09-12T02:28:51.991633+0000","last_became_peered":"2024-09-12T02:28:51.991633+0000","last_unstale":"2024-09-12T02:30:23.981161+0000","last_undegraded":"2024-09-12T02:30:23.981161+0000","last_fullsized":"2024-09-12T02:30:23.981161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:15.869090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967370+0000","last_change":"2024-09-12T02:28:51.986043+0000","last_active":"2024-09-12T02:30:23.967370+0000","last_peered":"2024-09-12T02:30:23.967370+0000","last_clean":"2024-09-12T02:30:23.967370+0000","last_became_active":"2024-09-12T02:28:51.985750+0000","last_became_peered":"2024-09-12T02:28:51.985750+0000","last_unstale":"2024-09-12T02:30:23.967370+0000","last_undegraded":"2024-09-12T02:30:23.967370+0000","last_fullsized":"2024-09-12T02:30:23.967370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:49.827002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.956196+0000","last_change":"2024-09-12T02:28:51.976428+0000","last_active":"2024-09-12T02:30:23.956196+0000","last_peered":"2024-09-12T02:30:23.956196+0000","last_clean":"2024-09-12T02:30:23.956196+0000","last_became_active":"2024-09-12T02:28:51.974605+0000","last_became_peered":"2024-09-12T02:28:51.974605+0000","last_unstale":"2024-09-12T02:30:23.956196+0000","last_undegraded":"2024-09-12T02:30:23.956196+0000","last_fullsized":"2024-09-12T02:30:23.956196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:32.530848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961601+0000","last_change":"2024-09-12T02:29:55.591023+0000","last_active":"2024-09-12T02:30:23.961601+0000","last_peered":"2024-09-12T02:30:23.961601+0000","last_clean":"2024-09-12T02:30:23.961601+0000","last_became_active":"2024-09-12T02:29:55.590651+0000","last_became_peered":"2024-09-12T02:29:55.590651+0000","last_unstale":"2024-09-12T02:30:23.961601+0000","last_undegraded":"2024-09-12T02:30:23.961601+0000","last_fullsized":"2024-09-12T02:30:23.961601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:17.590512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.981495+0000","last_change":"2024-09-12T02:28:51.988197+0000","last_active":"2024-09-12T02:30:23.981495+0000","last_peered":"2024-09-12T02:30:23.981495+0000","last_clean":"2024-09-12T02:30:23.981495+0000","last_became_active":"2024-09-12T02:28:51.987750+0000","last_became_peered":"2024-09-12T02:28:51.987750+0000","last_unstale":"2024-09-12T02:30:23.981495+0000","last_undegraded":"2024-09-12T02:30:23.981495+0000","last_fullsized":"2024-09-12T02:30:23.981495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:15.220318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969792+0000","last_change":"2024-09-12T02:28:51.980933+0000","last_active":"2024-09-12T02:30:23.969792+0000","last_peered":"2024-09-12T02:30:23.969792+0000","last_clean":"2024-09-12T02:30:23.969792+0000","last_became_active":"2024-09-12T02:28:51.980564+0000","last_became_peered":"2024-09-12T02:28:51.980564+0000","last_unstale":"2024-09-12T02:30:23.969792+0000","last_undegraded":"2024-09-12T02:30:23.969792+0000","last_fullsized":"2024-09-12T02:30:23.969792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:35.566048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965775+0000","last_change":"2024-09-12T02:28:51.980495+0000","last_active":"2024-09-12T02:30:23.965775+0000","last_peered":"2024-09-12T02:30:23.965775+0000","last_clean":"2024-09-12T02:30:23.965775+0000","last_became_active":"2024-09-12T02:28:51.980193+0000","last_became_peered":"2024-09-12T02:28:51.980193+0000","last_unstale":"2024-09-12T02:30:23.965775+0000","last_undegraded":"2024-09-12T02:30:23.965775+0000","last_fullsized":"2024-09-12T02:30:23.965775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:04.412506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965785+0000","last_change":"2024-09-12T02:28:51.981462+0000","last_active":"2024-09-12T02:30:23.965785+0000","last_peered":"2024-09-12T02:30:23.965785+0000","last_clean":"2024-09-12T02:30:23.965785+0000","last_became_active":"2024-09-12T02:28:51.979296+0000","last_became_peered":"2024-09-12T02:28:51.979296+0000","last_unstale":"2024-09-12T02:30:23.965785+0000","last_undegraded":"2024-09-12T02:30:23.965785+0000","last_fullsized":"2024-09-12T02:30:23.965785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:03.628289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967391+0000","last_change":"2024-09-12T02:28:51.993511+0000","last_active":"2024-09-12T02:30:23.967391+0000","last_peered":"2024-09-12T02:30:23.967391+0000","last_clean":"2024-09-12T02:30:23.967391+0000","last_became_active":"2024-09-12T02:28:51.992968+0000","last_became_peered":"2024-09-12T02:28:51.992968+0000","last_unstale":"2024-09-12T02:30:23.967391+0000","last_undegraded":"2024-09-12T02:30:23.967391+0000","last_fullsized":"2024-09-12T02:30:23.967391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.968312+0000","last_change":"2024-09-12T02:28:51.989279+0000","last_active":"2024-09-12T02:30:23.968312+0000","last_peered":"2024-09-12T02:30:23.968312+0000","last_clean":"2024-09-12T02:30:23.968312+0000","last_became_active":"2024-09-12T02:28:51.988919+0000","last_became_peered":"2024-09-12T02:28:51.988919+0000","last_unstale":"2024-09-12T02:30:23.968312+0000","last_undegraded":"2024-09-12T02:30:23.968312+0000","last_fullsized":"2024-09-12T02:30:23.968312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:24.448200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970397+0000","last_change":"2024-09-12T02:28:51.984508+0000","last_active":"2024-09-12T02:30:23.970397+0000","last_peered":"2024-09-12T02:30:23.970397+0000","last_clean":"2024-09-12T02:30:23.970397+0000","last_became_active":"2024-09-12T02:28:51.983365+0000","last_became_peered":"2024-09-12T02:28:51.983365+0000","last_unstale":"2024-09-12T02:30:23.970397+0000","last_undegraded":"2024-09-12T02:30:23.970397+0000","last_fullsized":"2024-09-12T02:30:23.970397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965091+0000","last_change":"2024-09-12T02:28:51.981410+0000","last_active":"2024-09-12T02:30:23.965091+0000","last_peered":"2024-09-12T02:30:23.965091+0000","last_clean":"2024-09-12T02:30:23.965091+0000","last_became_active":"2024-09-12T02:28:51.980912+0000","last_became_peered":"2024-09-12T02:28:51.980912+0000","last_unstale":"2024-09-12T02:30:23.965091+0000","last_undegraded":"2024-09-12T02:30:23.965091+0000","last_fullsized":"2024-09-12T02:30:23.965091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:14.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.198288+0000","last_change":"2024-09-12T02:28:49.866312+0000","last_active":"2024-09-12T02:30:59.198288+0000","last_peered":"2024-09-12T02:30:59.198288+0000","last_clean":"2024-09-12T02:30:59.198288+0000","last_became_active":"2024-09-12T02:28:49.865988+0000","last_became_peered":"2024-09-12T02:28:49.865988+0000","last_unstale":"2024-09-12T02:30:59.198288+0000","last_undegraded":"2024-09-12T02:30:59.198288+0000","last_fullsized":"2024-09-12T02:30:59.198288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:51.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966142+0000","last_change":"2024-09-12T02:28:51.986077+0000","last_active":"2024-09-12T02:30:23.966142+0000","last_peered":"2024-09-12T02:30:23.966142+0000","last_clean":"2024-09-12T02:30:23.966142+0000","last_became_active":"2024-09-12T02:28:51.984778+0000","last_became_peered":"2024-09-12T02:28:51.984778+0000","last_unstale":"2024-09-12T02:30:23.966142+0000","last_undegraded":"2024-09-12T02:30:23.966142+0000","last_fullsized":"2024-09-12T02:30:23.966142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:46.857174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.582357+0000","last_change":"2024-09-12T02:28:49.863783+0000","last_active":"2024-09-12T02:29:55.582357+0000","last_peered":"2024-09-12T02:29:55.582357+0000","last_clean":"2024-09-12T02:29:55.582357+0000","last_became_active":"2024-09-12T02:28:49.863474+0000","last_became_peered":"2024-09-12T02:28:49.863474+0000","last_unstale":"2024-09-12T02:29:55.582357+0000","last_undegraded":"2024-09-12T02:29:55.582357+0000","last_fullsized":"2024-09-12T02:29:55.582357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:10.701506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581165+0000","last_change":"2024-09-12T02:28:49.856506+0000","last_active":"2024-09-12T02:29:55.581165+0000","last_peered":"2024-09-12T02:29:55.581165+0000","last_clean":"2024-09-12T02:29:55.581165+0000","last_became_active":"2024-09-12T02:28:49.856236+0000","last_became_peered":"2024-09-12T02:28:49.856236+0000","last_unstale":"2024-09-12T02:29:55.581165+0000","last_undegraded":"2024-09-12T02:29:55.581165+0000","last_fullsized":"2024-09-12T02:29:55.581165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:16.135496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967245+0000","last_change":"2024-09-12T02:28:51.979619+0000","last_active":"2024-09-12T02:30:23.967245+0000","last_peered":"2024-09-12T02:30:23.967245+0000","last_clean":"2024-09-12T02:30:23.967245+0000","last_became_active":"2024-09-12T02:28:51.979309+0000","last_became_peered":"2024-09-12T02:28:51.979309+0000","last_unstale":"2024-09-12T02:30:23.967245+0000","last_undegraded":"2024-09-12T02:30:23.967245+0000","last_fullsized":"2024-09-12T02:30:23.967245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:47.679641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590863+0000","last_change":"2024-09-12T02:28:49.863691+0000","last_active":"2024-09-12T02:29:55.590863+0000","last_peered":"2024-09-12T02:29:55.590863+0000","last_clean":"2024-09-12T02:29:55.590863+0000","last_became_active":"2024-09-12T02:28:49.863295+0000","last_became_peered":"2024-09-12T02:28:49.863295+0000","last_unstale":"2024-09-12T02:29:55.590863+0000","last_undegraded":"2024-09-12T02:29:55.590863+0000","last_fullsized":"2024-09-12T02:29:55.590863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:46.806096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973753+0000","last_change":"2024-09-12T02:28:51.976669+0000","last_active":"2024-09-12T02:30:23.973753+0000","last_peered":"2024-09-12T02:30:23.973753+0000","last_clean":"2024-09-12T02:30:23.973753+0000","last_became_active":"2024-09-12T02:28:51.976348+0000","last_became_peered":"2024-09-12T02:28:51.976348+0000","last_unstale":"2024-09-12T02:30:23.973753+0000","last_undegraded":"2024-09-12T02:30:23.973753+0000","last_fullsized":"2024-09-12T02:30:23.973753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:49.233422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":257,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.197623+0000","last_change":"2024-09-12T02:28:49.864446+0000","last_active":"2024-09-12T02:30:59.197623+0000","last_peered":"2024-09-12T02:30:59.197623+0000","last_clean":"2024-09-12T02:30:59.197623+0000","last_became_active":"2024-09-12T02:28:49.863972+0000","last_became_peered":"2024-09-12T02:28:49.863972+0000","last_unstale":"2024-09-12T02:30:59.197623+0000","last_undegraded":"2024-09-12T02:30:59.197623+0000","last_fullsized":"2024-09-12T02:30:59.197623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.237879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980370+0000","last_change":"2024-09-12T02:28:51.974932+0000","last_active":"2024-09-12T02:30:23.980370+0000","last_peered":"2024-09-12T02:30:23.980370+0000","last_clean":"2024-09-12T02:30:23.980370+0000","last_became_active":"2024-09-12T02:28:51.974630+0000","last_became_peered":"2024-09-12T02:28:51.974630+0000","last_unstale":"2024-09-12T02:30:23.980370+0000","last_undegraded":"2024-09-12T02:30:23.980370+0000","last_fullsized":"2024-09-12T02:30:23.980370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:23.183324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585737+0000","last_change":"2024-09-12T02:28:49.864518+0000","last_active":"2024-09-12T02:29:55.585737+0000","last_peered":"2024-09-12T02:29:55.585737+0000","last_clean":"2024-09-12T02:29:55.585737+0000","last_became_active":"2024-09-12T02:28:49.863547+0000","last_became_peered":"2024-09-12T02:28:49.863547+0000","last_unstale":"2024-09-12T02:29:55.585737+0000","last_undegraded":"2024-09-12T02:29:55.585737+0000","last_fullsized":"2024-09-12T02:29:55.585737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:19.130728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965042+0000","last_change":"2024-09-12T02:29:55.593437+0000","last_active":"2024-09-12T02:30:23.965042+0000","last_peered":"2024-09-12T02:30:23.965042+0000","last_clean":"2024-09-12T02:30:23.965042+0000","last_became_active":"2024-09-12T02:29:55.593057+0000","last_became_peered":"2024-09-12T02:29:55.593057+0000","last_unstale":"2024-09-12T02:30:23.965042+0000","last_undegraded":"2024-09-12T02:30:23.965042+0000","last_fullsized":"2024-09-12T02:30:23.965042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:40.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591427+0000","last_change":"2024-09-12T02:28:50.032260+0000","last_active":"2024-09-12T02:29:55.591427+0000","last_peered":"2024-09-12T02:29:55.591427+0000","last_clean":"2024-09-12T02:29:55.591427+0000","last_became_active":"2024-09-12T02:28:50.031780+0000","last_became_peered":"2024-09-12T02:28:50.031780+0000","last_unstale":"2024-09-12T02:29:55.591427+0000","last_undegraded":"2024-09-12T02:29:55.591427+0000","last_fullsized":"2024-09-12T02:29:55.591427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:18.504043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980713+0000","last_change":"2024-09-12T02:28:51.978717+0000","last_active":"2024-09-12T02:30:23.980713+0000","last_peered":"2024-09-12T02:30:23.980713+0000","last_clean":"2024-09-12T02:30:23.980713+0000","last_became_active":"2024-09-12T02:28:51.978386+0000","last_became_peered":"2024-09-12T02:28:51.978386+0000","last_unstale":"2024-09-12T02:30:23.980713+0000","last_undegraded":"2024-09-12T02:30:23.980713+0000","last_fullsized":"2024-09-12T02:30:23.980713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.668891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":302,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.197486+0000","last_change":"2024-09-12T02:28:49.864691+0000","last_active":"2024-09-12T02:30:59.197486+0000","last_peered":"2024-09-12T02:30:59.197486+0000","last_clean":"2024-09-12T02:30:59.197486+0000","last_became_active":"2024-09-12T02:28:49.864367+0000","last_became_peered":"2024-09-12T02:28:49.864367+0000","last_unstale":"2024-09-12T02:30:59.197486+0000","last_undegraded":"2024-09-12T02:30:59.197486+0000","last_fullsized":"2024-09-12T02:30:59.197486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:09.971731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66699,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":243,"num_read_kb":186,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965558+0000","last_change":"2024-09-12T02:28:51.987995+0000","last_active":"2024-09-12T02:30:23.965558+0000","last_peered":"2024-09-12T02:30:23.965558+0000","last_clean":"2024-09-12T02:30:23.965558+0000","last_became_active":"2024-09-12T02:28:51.987644+0000","last_became_peered":"2024-09-12T02:28:51.987644+0000","last_unstale":"2024-09-12T02:30:23.965558+0000","last_undegraded":"2024-09-12T02:30:23.965558+0000","last_fullsized":"2024-09-12T02:30:23.965558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:07.573684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.584787+0000","last_change":"2024-09-12T02:28:49.863132+0000","last_active":"2024-09-12T02:29:55.584787+0000","last_peered":"2024-09-12T02:29:55.584787+0000","last_clean":"2024-09-12T02:29:55.584787+0000","last_became_active":"2024-09-12T02:28:49.862705+0000","last_became_peered":"2024-09-12T02:28:49.862705+0000","last_unstale":"2024-09-12T02:29:55.584787+0000","last_undegraded":"2024-09-12T02:29:55.584787+0000","last_fullsized":"2024-09-12T02:29:55.584787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:44.676578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957651+0000","last_change":"2024-09-12T02:28:51.991244+0000","last_active":"2024-09-12T02:30:23.957651+0000","last_peered":"2024-09-12T02:30:23.957651+0000","last_clean":"2024-09-12T02:30:23.957651+0000","last_became_active":"2024-09-12T02:28:51.990924+0000","last_became_peered":"2024-09-12T02:28:51.990924+0000","last_unstale":"2024-09-12T02:30:23.957651+0000","last_undegraded":"2024-09-12T02:30:23.957651+0000","last_fullsized":"2024-09-12T02:30:23.957651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:10.039070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.590941+0000","last_change":"2024-09-12T02:28:49.865051+0000","last_active":"2024-09-12T02:29:55.590941+0000","last_peered":"2024-09-12T02:29:55.590941+0000","last_clean":"2024-09-12T02:29:55.590941+0000","last_became_active":"2024-09-12T02:28:49.864600+0000","last_became_peered":"2024-09-12T02:28:49.864600+0000","last_unstale":"2024-09-12T02:29:55.590941+0000","last_undegraded":"2024-09-12T02:29:55.590941+0000","last_fullsized":"2024-09-12T02:29:55.590941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:40.863674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.974871+0000","last_change":"2024-09-12T02:28:51.989950+0000","last_active":"2024-09-12T02:30:23.974871+0000","last_peered":"2024-09-12T02:30:23.974871+0000","last_clean":"2024-09-12T02:30:23.974871+0000","last_became_active":"2024-09-12T02:28:51.989040+0000","last_became_peered":"2024-09-12T02:28:51.989040+0000","last_unstale":"2024-09-12T02:30:23.974871+0000","last_undegraded":"2024-09-12T02:30:23.974871+0000","last_fullsized":"2024-09-12T02:30:23.974871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.721609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:59.197754+0000","last_change":"2024-09-12T02:28:49.866329+0000","last_active":"2024-09-12T02:30:59.197754+0000","last_peered":"2024-09-12T02:30:59.197754+0000","last_clean":"2024-09-12T02:30:59.197754+0000","last_became_active":"2024-09-12T02:28:49.865906+0000","last_became_peered":"2024-09-12T02:28:49.865906+0000","last_unstale":"2024-09-12T02:30:59.197754+0000","last_undegraded":"2024-09-12T02:30:59.197754+0000","last_fullsized":"2024-09-12T02:30:59.197754+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:28.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966876+0000","last_change":"2024-09-12T02:28:51.986708+0000","last_active":"2024-09-12T02:30:23.966876+0000","last_peered":"2024-09-12T02:30:23.966876+0000","last_clean":"2024-09-12T02:30:23.966876+0000","last_became_active":"2024-09-12T02:28:51.985243+0000","last_became_peered":"2024-09-12T02:28:51.985243+0000","last_unstale":"2024-09-12T02:30:23.966876+0000","last_undegraded":"2024-09-12T02:30:23.966876+0000","last_fullsized":"2024-09-12T02:30:23.966876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:47.473660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.656731+0000","last_change":"2024-09-12T02:29:55.656731+0000","last_active":"2024-09-12T02:29:55.656731+0000","last_peered":"2024-09-12T02:29:55.656731+0000","last_clean":"2024-09-12T02:29:55.656731+0000","last_became_active":"2024-09-12T02:29:55.641034+0000","last_became_peered":"2024-09-12T02:29:55.641034+0000","last_unstale":"2024-09-12T02:29:55.656731+0000","last_undegraded":"2024-09-12T02:29:55.656731+0000","last_fullsized":"2024-09-12T02:29:55.656731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:39.065850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.975754+0000","last_change":"2024-09-12T02:28:51.985374+0000","last_active":"2024-09-12T02:30:23.975754+0000","last_peered":"2024-09-12T02:30:23.975754+0000","last_clean":"2024-09-12T02:30:23.975754+0000","last_became_active":"2024-09-12T02:28:51.984708+0000","last_became_peered":"2024-09-12T02:28:51.984708+0000","last_unstale":"2024-09-12T02:30:23.975754+0000","last_undegraded":"2024-09-12T02:30:23.975754+0000","last_fullsized":"2024-09-12T02:30:23.975754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.785834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587865+0000","last_change":"2024-09-12T02:28:49.860568+0000","last_active":"2024-09-12T02:29:55.587865+0000","last_peered":"2024-09-12T02:29:55.587865+0000","last_clean":"2024-09-12T02:29:55.587865+0000","last_became_active":"2024-09-12T02:28:49.860219+0000","last_became_peered":"2024-09-12T02:28:49.860219+0000","last_unstale":"2024-09-12T02:29:55.587865+0000","last_undegraded":"2024-09-12T02:29:55.587865+0000","last_fullsized":"2024-09-12T02:29:55.587865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.533076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.970786+0000","last_change":"2024-09-12T02:29:55.640291+0000","last_active":"2024-09-12T02:30:23.970786+0000","last_peered":"2024-09-12T02:30:23.970786+0000","last_clean":"2024-09-12T02:30:23.970786+0000","last_became_active":"2024-09-12T02:29:55.639906+0000","last_became_peered":"2024-09-12T02:29:55.639906+0000","last_unstale":"2024-09-12T02:30:23.970786+0000","last_undegraded":"2024-09-12T02:30:23.970786+0000","last_fullsized":"2024-09-12T02:30:23.970786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:07.396622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.581948+0000","last_change":"2024-09-12T02:28:49.860586+0000","last_active":"2024-09-12T02:29:55.581948+0000","last_peered":"2024-09-12T02:29:55.581948+0000","last_clean":"2024-09-12T02:29:55.581948+0000","last_became_active":"2024-09-12T02:28:49.860241+0000","last_became_peered":"2024-09-12T02:28:49.860241+0000","last_unstale":"2024-09-12T02:29:55.581948+0000","last_undegraded":"2024-09-12T02:29:55.581948+0000","last_fullsized":"2024-09-12T02:29:55.581948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:16.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.973452+0000","last_change":"2024-09-12T02:28:51.985140+0000","last_active":"2024-09-12T02:30:23.973452+0000","last_peered":"2024-09-12T02:30:23.973452+0000","last_clean":"2024-09-12T02:30:23.973452+0000","last_became_active":"2024-09-12T02:28:51.982794+0000","last_became_peered":"2024-09-12T02:28:51.982794+0000","last_unstale":"2024-09-12T02:30:23.973452+0000","last_undegraded":"2024-09-12T02:30:23.973452+0000","last_fullsized":"2024-09-12T02:30:23.973452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.858724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.591531+0000","last_change":"2024-09-12T02:28:49.862201+0000","last_active":"2024-09-12T02:29:55.591531+0000","last_peered":"2024-09-12T02:29:55.591531+0000","last_clean":"2024-09-12T02:29:55.591531+0000","last_became_active":"2024-09-12T02:28:49.861777+0000","last_became_peered":"2024-09-12T02:28:49.861777+0000","last_unstale":"2024-09-12T02:29:55.591531+0000","last_undegraded":"2024-09-12T02:29:55.591531+0000","last_fullsized":"2024-09-12T02:29:55.591531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:51.548977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966714+0000","last_change":"2024-09-12T02:28:51.988790+0000","last_active":"2024-09-12T02:30:23.966714+0000","last_peered":"2024-09-12T02:30:23.966714+0000","last_clean":"2024-09-12T02:30:23.966714+0000","last_became_active":"2024-09-12T02:28:51.985350+0000","last_became_peered":"2024-09-12T02:28:51.985350+0000","last_unstale":"2024-09-12T02:30:23.966714+0000","last_undegraded":"2024-09-12T02:30:23.966714+0000","last_fullsized":"2024-09-12T02:30:23.966714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:49.502967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:58.209862+0000","last_change":"2024-09-12T02:28:50.273535+0000","last_active":"2024-09-12T02:30:58.209862+0000","last_peered":"2024-09-12T02:30:58.209862+0000","last_clean":"2024-09-12T02:30:58.209862+0000","last_became_active":"2024-09-12T02:28:50.273169+0000","last_became_peered":"2024-09-12T02:28:50.273169+0000","last_unstale":"2024-09-12T02:30:58.209862+0000","last_undegraded":"2024-09-12T02:30:58.209862+0000","last_fullsized":"2024-09-12T02:30:58.209862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:47.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980301+0000","last_change":"2024-09-12T02:28:51.986360+0000","last_active":"2024-09-12T02:30:23.980301+0000","last_peered":"2024-09-12T02:30:23.980301+0000","last_clean":"2024-09-12T02:30:23.980301+0000","last_became_active":"2024-09-12T02:28:51.982771+0000","last_became_peered":"2024-09-12T02:28:51.982771+0000","last_unstale":"2024-09-12T02:30:23.980301+0000","last_undegraded":"2024-09-12T02:30:23.980301+0000","last_fullsized":"2024-09-12T02:30:23.980301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.286192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585656+0000","last_change":"2024-09-12T02:27:37.072044+0000","last_active":"2024-09-12T02:29:55.585656+0000","last_peered":"2024-09-12T02:29:55.585656+0000","last_clean":"2024-09-12T02:29:55.585656+0000","last_became_active":"2024-09-12T02:27:37.071690+0000","last_became_peered":"2024-09-12T02:27:37.071690+0000","last_unstale":"2024-09-12T02:29:55.585656+0000","last_undegraded":"2024-09-12T02:29:55.585656+0000","last_fullsized":"2024-09-12T02:29:55.585656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:24:10.660562+0000","last_clean_scrub_stamp":"2024-09-12T02:24:10.660562+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:10.874581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.639941+0000","last_change":"2024-09-12T02:28:49.860353+0000","last_active":"2024-09-12T02:29:55.639941+0000","last_peered":"2024-09-12T02:29:55.639941+0000","last_clean":"2024-09-12T02:29:55.639941+0000","last_became_active":"2024-09-12T02:28:49.859930+0000","last_became_peered":"2024-09-12T02:28:49.859930+0000","last_unstale":"2024-09-12T02:29:55.639941+0000","last_undegraded":"2024-09-12T02:29:55.639941+0000","last_fullsized":"2024-09-12T02:29:55.639941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:35.171417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969012+0000","last_change":"2024-09-12T02:29:55.639749+0000","last_active":"2024-09-12T02:30:23.969012+0000","last_peered":"2024-09-12T02:30:23.969012+0000","last_clean":"2024-09-12T02:30:23.969012+0000","last_became_active":"2024-09-12T02:29:55.639425+0000","last_became_peered":"2024-09-12T02:29:55.639425+0000","last_unstale":"2024-09-12T02:30:23.969012+0000","last_undegraded":"2024-09-12T02:30:23.969012+0000","last_fullsized":"2024-09-12T02:30:23.969012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:34.012522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644878+0000","last_change":"2024-09-12T02:29:55.644440+0000","last_active":"2024-09-12T02:29:55.644878+0000","last_peered":"2024-09-12T02:29:55.644878+0000","last_clean":"2024-09-12T02:29:55.644878+0000","last_became_active":"2024-09-12T02:29:55.641546+0000","last_became_peered":"2024-09-12T02:29:55.641546+0000","last_unstale":"2024-09-12T02:29:55.644878+0000","last_undegraded":"2024-09-12T02:29:55.644878+0000","last_fullsized":"2024-09-12T02:29:55.644878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:32.689237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972079+0000","last_change":"2024-09-12T02:29:55.589112+0000","last_active":"2024-09-12T02:30:23.972079+0000","last_peered":"2024-09-12T02:30:23.972079+0000","last_clean":"2024-09-12T02:30:23.972079+0000","last_became_active":"2024-09-12T02:29:55.588685+0000","last_became_peered":"2024-09-12T02:29:55.588685+0000","last_unstale":"2024-09-12T02:30:23.972079+0000","last_undegraded":"2024-09-12T02:30:23.972079+0000","last_fullsized":"2024-09-12T02:30:23.972079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:05.803058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.194037+0000","last_change":"2024-09-12T02:28:50.031625+0000","last_active":"2024-09-12T02:30:57.194037+0000","last_peered":"2024-09-12T02:30:57.194037+0000","last_clean":"2024-09-12T02:30:57.194037+0000","last_became_active":"2024-09-12T02:28:50.031207+0000","last_became_peered":"2024-09-12T02:28:50.031207+0000","last_unstale":"2024-09-12T02:30:57.194037+0000","last_undegraded":"2024-09-12T02:30:57.194037+0000","last_fullsized":"2024-09-12T02:30:57.194037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:42.935340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.969068+0000","last_change":"2024-09-12T02:28:51.984263+0000","last_active":"2024-09-12T02:30:23.969068+0000","last_peered":"2024-09-12T02:30:23.969068+0000","last_clean":"2024-09-12T02:30:23.969068+0000","last_became_active":"2024-09-12T02:28:51.983960+0000","last_became_peered":"2024-09-12T02:28:51.983960+0000","last_unstale":"2024-09-12T02:30:23.969068+0000","last_undegraded":"2024-09-12T02:30:23.969068+0000","last_fullsized":"2024-09-12T02:30:23.969068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:38.944480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'7","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.679759+0000","last_change":"2024-09-12T02:28:49.865185+0000","last_active":"2024-09-12T02:30:57.679759+0000","last_peered":"2024-09-12T02:30:57.679759+0000","last_clean":"2024-09-12T02:30:57.679759+0000","last_became_active":"2024-09-12T02:28:49.864826+0000","last_became_peered":"2024-09-12T02:28:49.864826+0000","last_unstale":"2024-09-12T02:30:57.679759+0000","last_undegraded":"2024-09-12T02:30:57.679759+0000","last_fullsized":"2024-09-12T02:30:57.679759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:20.736256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961630+0000","last_change":"2024-09-12T02:28:51.979158+0000","last_active":"2024-09-12T02:30:23.961630+0000","last_peered":"2024-09-12T02:30:23.961630+0000","last_clean":"2024-09-12T02:30:23.961630+0000","last_became_active":"2024-09-12T02:28:51.978768+0000","last_became_peered":"2024-09-12T02:28:51.978768+0000","last_unstale":"2024-09-12T02:30:23.961630+0000","last_undegraded":"2024-09-12T02:30:23.961630+0000","last_fullsized":"2024-09-12T02:30:23.961630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:13.143060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586466+0000","last_change":"2024-09-12T02:28:50.031628+0000","last_active":"2024-09-12T02:29:55.586466+0000","last_peered":"2024-09-12T02:29:55.586466+0000","last_clean":"2024-09-12T02:29:55.586466+0000","last_became_active":"2024-09-12T02:28:50.031287+0000","last_became_peered":"2024-09-12T02:28:50.031287+0000","last_unstale":"2024-09-12T02:29:55.586466+0000","last_undegraded":"2024-09-12T02:29:55.586466+0000","last_fullsized":"2024-09-12T02:29:55.586466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:51.508358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966439+0000","last_change":"2024-09-12T02:28:51.981264+0000","last_active":"2024-09-12T02:30:23.966439+0000","last_peered":"2024-09-12T02:30:23.966439+0000","last_clean":"2024-09-12T02:30:23.966439+0000","last_became_active":"2024-09-12T02:28:51.978905+0000","last_became_peered":"2024-09-12T02:28:51.978905+0000","last_unstale":"2024-09-12T02:30:23.966439+0000","last_undegraded":"2024-09-12T02:30:23.966439+0000","last_fullsized":"2024-09-12T02:30:23.966439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:57.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587848+0000","last_change":"2024-09-12T02:28:50.031458+0000","last_active":"2024-09-12T02:29:55.587848+0000","last_peered":"2024-09-12T02:29:55.587848+0000","last_clean":"2024-09-12T02:29:55.587848+0000","last_became_active":"2024-09-12T02:28:50.031089+0000","last_became_peered":"2024-09-12T02:28:50.031089+0000","last_unstale":"2024-09-12T02:29:55.587848+0000","last_undegraded":"2024-09-12T02:29:55.587848+0000","last_fullsized":"2024-09-12T02:29:55.587848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:20.399193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.972102+0000","last_change":"2024-09-12T02:28:51.983350+0000","last_active":"2024-09-12T02:30:23.972102+0000","last_peered":"2024-09-12T02:30:23.972102+0000","last_clean":"2024-09-12T02:30:23.972102+0000","last_became_active":"2024-09-12T02:28:51.983034+0000","last_became_peered":"2024-09-12T02:28:51.983034+0000","last_unstale":"2024-09-12T02:30:23.972102+0000","last_undegraded":"2024-09-12T02:30:23.972102+0000","last_fullsized":"2024-09-12T02:30:23.972102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:53.752927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:24.491679+0000","last_change":"2024-09-12T02:29:55.600546+0000","last_active":"2024-09-12T02:30:24.491679+0000","last_peered":"2024-09-12T02:30:24.491679+0000","last_clean":"2024-09-12T02:30:24.491679+0000","last_became_active":"2024-09-12T02:29:55.594184+0000","last_became_peered":"2024-09-12T02:29:55.594184+0000","last_unstale":"2024-09-12T02:30:24.491679+0000","last_undegraded":"2024-09-12T02:30:24.491679+0000","last_fullsized":"2024-09-12T02:30:24.491679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:26.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967549+0000","last_change":"2024-09-12T02:28:51.991186+0000","last_active":"2024-09-12T02:30:23.967549+0000","last_peered":"2024-09-12T02:30:23.967549+0000","last_clean":"2024-09-12T02:30:23.967549+0000","last_became_active":"2024-09-12T02:28:51.990867+0000","last_became_peered":"2024-09-12T02:28:51.990867+0000","last_unstale":"2024-09-12T02:30:23.967549+0000","last_undegraded":"2024-09-12T02:30:23.967549+0000","last_fullsized":"2024-09-12T02:30:23.967549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:59.189068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.640298+0000","last_change":"2024-09-12T02:28:50.273688+0000","last_active":"2024-09-12T02:29:55.640298+0000","last_peered":"2024-09-12T02:29:55.640298+0000","last_clean":"2024-09-12T02:29:55.640298+0000","last_became_active":"2024-09-12T02:28:50.273372+0000","last_became_peered":"2024-09-12T02:28:50.273372+0000","last_unstale":"2024-09-12T02:29:55.640298+0000","last_undegraded":"2024-09-12T02:29:55.640298+0000","last_fullsized":"2024-09-12T02:29:55.640298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.967877+0000","last_change":"2024-09-12T02:28:51.978570+0000","last_active":"2024-09-12T02:30:23.967877+0000","last_peered":"2024-09-12T02:30:23.967877+0000","last_clean":"2024-09-12T02:30:23.967877+0000","last_became_active":"2024-09-12T02:28:51.978249+0000","last_became_peered":"2024-09-12T02:28:51.978249+0000","last_unstale":"2024-09-12T02:30:23.967877+0000","last_undegraded":"2024-09-12T02:30:23.967877+0000","last_fullsized":"2024-09-12T02:30:23.967877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:55.937289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.638780+0000","last_change":"2024-09-12T02:28:50.031619+0000","last_active":"2024-09-12T02:29:55.638780+0000","last_peered":"2024-09-12T02:29:55.638780+0000","last_clean":"2024-09-12T02:29:55.638780+0000","last_became_active":"2024-09-12T02:28:50.031320+0000","last_became_peered":"2024-09-12T02:28:50.031320+0000","last_unstale":"2024-09-12T02:29:55.638780+0000","last_undegraded":"2024-09-12T02:29:55.638780+0000","last_fullsized":"2024-09-12T02:29:55.638780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:17.883697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.957143+0000","last_change":"2024-09-12T02:28:51.980252+0000","last_active":"2024-09-12T02:30:23.957143+0000","last_peered":"2024-09-12T02:30:23.957143+0000","last_clean":"2024-09-12T02:30:23.957143+0000","last_became_active":"2024-09-12T02:28:51.979908+0000","last_became_peered":"2024-09-12T02:28:51.979908+0000","last_unstale":"2024-09-12T02:30:23.957143+0000","last_undegraded":"2024-09-12T02:30:23.957143+0000","last_fullsized":"2024-09-12T02:30:23.957143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:08.801112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.585714+0000","last_change":"2024-09-12T02:28:49.860483+0000","last_active":"2024-09-12T02:29:55.585714+0000","last_peered":"2024-09-12T02:29:55.585714+0000","last_clean":"2024-09-12T02:29:55.585714+0000","last_became_active":"2024-09-12T02:28:49.860192+0000","last_became_peered":"2024-09-12T02:28:49.860192+0000","last_unstale":"2024-09-12T02:29:55.585714+0000","last_undegraded":"2024-09-12T02:29:55.585714+0000","last_fullsized":"2024-09-12T02:29:55.585714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.965195+0000","last_change":"2024-09-12T02:28:51.984312+0000","last_active":"2024-09-12T02:30:23.965195+0000","last_peered":"2024-09-12T02:30:23.965195+0000","last_clean":"2024-09-12T02:30:23.965195+0000","last_became_active":"2024-09-12T02:28:51.983885+0000","last_became_peered":"2024-09-12T02:28:51.983885+0000","last_unstale":"2024-09-12T02:30:23.965195+0000","last_undegraded":"2024-09-12T02:30:23.965195+0000","last_fullsized":"2024-09-12T02:30:23.965195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:04.743152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:48.023186+0000","last_change":"2024-09-12T02:28:49.858527+0000","last_active":"2024-09-12T02:30:48.023186+0000","last_peered":"2024-09-12T02:30:48.023186+0000","last_clean":"2024-09-12T02:30:48.023186+0000","last_became_active":"2024-09-12T02:28:49.858175+0000","last_became_peered":"2024-09-12T02:28:49.858175+0000","last_unstale":"2024-09-12T02:30:48.023186+0000","last_undegraded":"2024-09-12T02:30:48.023186+0000","last_fullsized":"2024-09-12T02:30:48.023186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:24.549391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.966637+0000","last_change":"2024-09-12T02:28:51.977683+0000","last_active":"2024-09-12T02:30:23.966637+0000","last_peered":"2024-09-12T02:30:23.966637+0000","last_clean":"2024-09-12T02:30:23.966637+0000","last_became_active":"2024-09-12T02:28:51.977392+0000","last_became_peered":"2024-09-12T02:28:51.977392+0000","last_unstale":"2024-09-12T02:30:23.966637+0000","last_undegraded":"2024-09-12T02:30:23.966637+0000","last_fullsized":"2024-09-12T02:30:23.966637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:44.181150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.644967+0000","last_change":"2024-09-12T02:29:55.644967+0000","last_active":"2024-09-12T02:29:55.644967+0000","last_peered":"2024-09-12T02:29:55.644967+0000","last_clean":"2024-09-12T02:29:55.644967+0000","last_became_active":"2024-09-12T02:29:55.640558+0000","last_became_peered":"2024-09-12T02:29:55.640558+0000","last_unstale":"2024-09-12T02:29:55.644967+0000","last_undegraded":"2024-09-12T02:29:55.644967+0000","last_fullsized":"2024-09-12T02:29:55.644967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.223747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980466+0000","last_change":"2024-09-12T02:28:51.989842+0000","last_active":"2024-09-12T02:30:23.980466+0000","last_peered":"2024-09-12T02:30:23.980466+0000","last_clean":"2024-09-12T02:30:23.980466+0000","last_became_active":"2024-09-12T02:28:51.982788+0000","last_became_peered":"2024-09-12T02:28:51.982788+0000","last_unstale":"2024-09-12T02:30:23.980466+0000","last_undegraded":"2024-09-12T02:30:23.980466+0000","last_fullsized":"2024-09-12T02:30:23.980466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:03.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980318+0000","last_change":"2024-09-12T02:28:51.983521+0000","last_active":"2024-09-12T02:30:23.980318+0000","last_peered":"2024-09-12T02:30:23.980318+0000","last_clean":"2024-09-12T02:30:23.980318+0000","last_became_active":"2024-09-12T02:28:51.983214+0000","last_became_peered":"2024-09-12T02:28:51.983214+0000","last_unstale":"2024-09-12T02:30:23.980318+0000","last_undegraded":"2024-09-12T02:30:23.980318+0000","last_fullsized":"2024-09-12T02:30:23.980318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:47.317012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587449+0000","last_change":"2024-09-12T02:28:49.860868+0000","last_active":"2024-09-12T02:29:55.587449+0000","last_peered":"2024-09-12T02:29:55.587449+0000","last_clean":"2024-09-12T02:29:55.587449+0000","last_became_active":"2024-09-12T02:28:49.860233+0000","last_became_peered":"2024-09-12T02:28:49.860233+0000","last_unstale":"2024-09-12T02:29:55.587449+0000","last_undegraded":"2024-09-12T02:29:55.587449+0000","last_fullsized":"2024-09-12T02:29:55.587449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:01.015611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.980260+0000","last_change":"2024-09-12T02:28:51.976077+0000","last_active":"2024-09-12T02:30:23.980260+0000","last_peered":"2024-09-12T02:30:23.980260+0000","last_clean":"2024-09-12T02:30:23.980260+0000","last_became_active":"2024-09-12T02:28:51.975709+0000","last_became_peered":"2024-09-12T02:28:51.975709+0000","last_unstale":"2024-09-12T02:30:23.980260+0000","last_undegraded":"2024-09-12T02:30:23.980260+0000","last_fullsized":"2024-09-12T02:30:23.980260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.447111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.587685+0000","last_change":"2024-09-12T02:28:49.865598+0000","last_active":"2024-09-12T02:29:55.587685+0000","last_peered":"2024-09-12T02:29:55.587685+0000","last_clean":"2024-09-12T02:29:55.587685+0000","last_became_active":"2024-09-12T02:28:49.865253+0000","last_became_peered":"2024-09-12T02:28:49.865253+0000","last_unstale":"2024-09-12T02:29:55.587685+0000","last_undegraded":"2024-09-12T02:29:55.587685+0000","last_fullsized":"2024-09-12T02:29:55.587685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:46.728364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.976436+0000","last_change":"2024-09-12T02:28:51.980364+0000","last_active":"2024-09-12T02:30:23.976436+0000","last_peered":"2024-09-12T02:30:23.976436+0000","last_clean":"2024-09-12T02:30:23.976436+0000","last_became_active":"2024-09-12T02:28:51.979472+0000","last_became_peered":"2024-09-12T02:28:51.979472+0000","last_unstale":"2024-09-12T02:30:23.976436+0000","last_undegraded":"2024-09-12T02:30:23.976436+0000","last_fullsized":"2024-09-12T02:30:23.976436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:56.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:29:55.586834+0000","last_change":"2024-09-12T02:28:50.031493+0000","last_active":"2024-09-12T02:29:55.586834+0000","last_peered":"2024-09-12T02:29:55.586834+0000","last_clean":"2024-09-12T02:29:55.586834+0000","last_became_active":"2024-09-12T02:28:50.031154+0000","last_became_peered":"2024-09-12T02:28:50.031154+0000","last_unstale":"2024-09-12T02:29:55.586834+0000","last_undegraded":"2024-09-12T02:29:55.586834+0000","last_fullsized":"2024-09-12T02:29:55.586834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:41.964307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:23.961761+0000","last_change":"2024-09-12T02:28:51.984172+0000","last_active":"2024-09-12T02:30:23.961761+0000","last_peered":"2024-09-12T02:30:23.961761+0000","last_clean":"2024-09-12T02:30:23.961761+0000","last_became_active":"2024-09-12T02:28:51.983876+0000","last_became_peered":"2024-09-12T02:28:51.983876+0000","last_unstale":"2024-09-12T02:30:23.961761+0000","last_undegraded":"2024-09-12T02:30:23.961761+0000","last_fullsized":"2024-09-12T02:30:23.961761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:50.955924+0000","last_clean_scrub_stamp":"2024-09-12T02:28:50.955924+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.573326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":172,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T02:30:57.679275+0000","last_change":"2024-09-12T02:29:55.607522+0000","last_active":"2024-09-12T02:30:57.679275+0000","last_peered":"2024-09-12T02:30:57.679275+0000","last_clean":"2024-09-12T02:30:57.679275+0000","last_became_active":"2024-09-12T02:29:55.593871+0000","last_became_peered":"2024-09-12T02:29:55.593871+0000","last_unstale":"2024-09-12T02:30:57.679275+0000","last_undegraded":"2024-09-12T02:30:57.679275+0000","last_fullsized":"2024-09-12T02:30:57.679275+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:28:48.844937+0000","last_clean_scrub_stamp":"2024-09-12T02:28:48.844937+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.033125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74497,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1194,"num_read_kb":677,"num_write":262,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":784,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285444,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436470,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1094060,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972402,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435728,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436106,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430268,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1028937,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":435979,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1028219,"data_compressed":42077,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":435952,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":435270,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":503473,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":503591,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":436784,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34658,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36294,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:31:04.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:04.809 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:04.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:04 smithi001 ceph-mon[31252]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:04.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:04 smithi134 ceph-mon[35091]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:04.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:04 smithi173 ceph-mon[35036]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- 172.21.15.1:0/1168100971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5590106f20 msgr2=0x7f559010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 --2- 172.21.15.1:0/1168100971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5590106f20 0x7f559010eaa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5588009ca0 tx=0x7f558802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- 172.21.15.1:0/1168100971 shutdown_connections 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 --2- 172.21.15.1:0/1168100971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5590106f20 0x7f559010eaa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 --2- 172.21.15.1:0/1168100971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55901027a0 0x7f55901067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 --2- 172.21.15.1:0/1168100971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 0x7f55901021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- 172.21.15.1:0/1168100971 >> 172.21.15.1:0/1168100971 conn(0x7f55900fd8b0 msgr2=0x7f55900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- 172.21.15.1:0/1168100971 shutdown_connections 2024-09-12T02:31:05.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- 172.21.15.1:0/1168100971 wait complete. 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 Processor -- start 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.331+0000 7f55965d9640 1 -- start start 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 0x7f5590198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 0x7f559019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5590111f80 con 0x7f55901027a0 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5590111e00 con 0x7f5590101df0 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f55965d9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5590112100 con 0x7f5590106f20 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42510/0 (socket says 172.21.15.1:42510) 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 -- 172.21.15.1:0/2228176472 learned_addr learned my addr 172.21.15.1:0/2228176472 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f558ffff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 0x7f5590198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5594b76640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 0x7f559019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 -- 172.21.15.1:0/2228176472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 msgr2=0x7f559019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 0x7f559019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 -- 172.21.15.1:0/2228176472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 msgr2=0x7f5590198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 0x7f5590198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 -- 172.21.15.1:0/2228176472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559019d310 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5594b76640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 0x7f559019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.332+0000 7f5587fff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f557800d770 tx=0x7f557800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.333+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578017070 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.333+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578005500 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.333+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559019d600 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.333+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578004e00 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.333+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901a4ee0 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.334+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55901021d0 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.336+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5578004fa0 con 0x7f55901027a0 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.336+0000 7f558dffb640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 0x7f557c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:05.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.337+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f55780ceea0 con 0x7f55901027a0 2024-09-12T02:31:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.337+0000 7f558ffff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 0x7f557c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.337+0000 7f558ffff640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 0x7f557c0a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55800058c0 tx=0x7f558000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:05.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.340+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f557809be00 con 0x7f55901027a0 2024-09-12T02:31:05.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.550+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f559010a160 con 0x7f55901027a0 2024-09-12T02:31:05.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.551+0000 7f558dffb640 1 -- 172.21.15.1:0/2228176472 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f557809b700 con 0x7f55901027a0 2024-09-12T02:31:05.552 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:05.552 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:05.552 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.553+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 msgr2=0x7f557c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.553+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 0x7f557c0a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55800058c0 tx=0x7f558000a2d0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.553+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 msgr2=0x7f55901988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f557800d770 tx=0x7f557800dc30 comp rx=0 tx=0).stop 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 shutdown_connections 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f557c0a2c00 0x7f557c0a50c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55901027a0 0x7f55901988a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5590106f20 0x7f559019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 --2- 172.21.15.1:0/2228176472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5590101df0 0x7f5590198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:05.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 >> 172.21.15.1:0/2228176472 conn(0x7f55900fd8b0 msgr2=0x7f55900fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:05.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 shutdown_connections 2024-09-12T02:31:05.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:05.554+0000 7f55965d9640 1 -- 172.21.15.1:0/2228176472 wait complete. 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.829 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:05 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2228176472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:05 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2228176472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:31:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:05 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2228176472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:06.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:06.522 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:07.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 -- 172.21.15.1:0/2199499516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850100a60 msgr2=0x7f9850100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 --2- 172.21.15.1:0/2199499516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850100a60 0x7f9850100ec0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9844009930 tx=0x7f984402a420 comp rx=0 tx=0).stop 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 -- 172.21.15.1:0/2199499516 shutdown_connections 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 --2- 172.21.15.1:0/2199499516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850100a60 0x7f9850100ec0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 --2- 172.21.15.1:0/2199499516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850101400 0x7f985010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 --2- 172.21.15.1:0/2199499516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 0x7f9850106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 -- 172.21.15.1:0/2199499516 >> 172.21.15.1:0/2199499516 conn(0x7f98500fc780 msgr2=0x7f98500feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 -- 172.21.15.1:0/2199499516 shutdown_connections 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.014+0000 7f9854a75640 1 -- 172.21.15.1:0/2199499516 wait complete. 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 Processor -- start 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 -- start start 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850100a60 0x7f9850199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 0x7f98501a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9850110e60 con 0x7f9850101400 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9850110ce0 con 0x7f9850100a60 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f9854a75640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9850110fe0 con 0x7f9850106a60 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42530/0 (socket says 172.21.15.1:42530) 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 -- 172.21.15.1:0/1882323390 learned_addr learned my addr 172.21.15.1:0/1882323390 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984e59c640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850100a60 0x7f9850199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984ed9d640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 0x7f98501a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 -- 172.21.15.1:0/1882323390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 msgr2=0x7f98501a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 0x7f98501a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 -- 172.21.15.1:0/1882323390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850100a60 msgr2=0x7f9850199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850100a60 0x7f9850199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.015+0000 7f984dd9b640 1 -- 172.21.15.1:0/1882323390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98501a48d0 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f984dd9b640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9844009230 tx=0x7f9844004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984403f030 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98501a4aa0 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9844003ad0 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844035070 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.016+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98501a4f00 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.017+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9850100ec0 con 0x7f9850101400 2024-09-12T02:31:07.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.019+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9844042030 con 0x7f9850101400 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.019+0000 7f983f7fe640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 0x7f98380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.020+0000 7f984e59c640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 0x7f98380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.020+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f98440efaf0 con 0x7f9850101400 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.020+0000 7f984e59c640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 0x7f98380a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f984000bb60 tx=0x7f984000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:07.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.023+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98440bca30 con 0x7f9850101400 2024-09-12T02:31:07.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.239+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9850108fd0 con 0x7f9850101400 2024-09-12T02:31:07.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.241+0000 7f983f7fe640 1 -- 172.21.15.1:0/1882323390 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f98440bc330 con 0x7f9850101400 2024-09-12T02:31:07.241 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:07.241 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:07.242 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 msgr2=0x7f98380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 0x7f98380a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f984000bb60 tx=0x7f984000b390 comp rx=0 tx=0).stop 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 msgr2=0x7f9850199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9844009230 tx=0x7f9844004270 comp rx=0 tx=0).stop 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 shutdown_connections 2024-09-12T02:31:07.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f98380a2b80 0x7f98380a5040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9850101400 0x7f9850199850 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9850106a60 0x7f98501a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 --2- 172.21.15.1:0/1882323390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9850100a60 0x7f9850199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 >> 172.21.15.1:0/1882323390 conn(0x7f98500fc780 msgr2=0x7f98500fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 shutdown_connections 2024-09-12T02:31:07.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:07.243+0000 7f9854a75640 1 -- 172.21.15.1:0/1882323390 wait complete. 2024-09-12T02:31:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:07 smithi001 ceph-mon[31252]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:31:07.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:07 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1882323390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:07.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:07 smithi134 ceph-mon[35091]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:31:07.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:07 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1882323390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:07 smithi173 ceph-mon[35036]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:31:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:07 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1882323390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:07.962 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:31:08.224 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:08.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 -- 172.21.15.1:0/3252962452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 msgr2=0x7fcc8810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 --2- 172.21.15.1:0/3252962452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8810e610 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009ca0 tx=0x7fcc8002a950 comp rx=0 tx=0).stop 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 -- 172.21.15.1:0/3252962452 shutdown_connections 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 --2- 172.21.15.1:0/3252962452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8810e610 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 --2- 172.21.15.1:0/3252962452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88103700 0x7fcc8810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 --2- 172.21.15.1:0/3252962452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88102de0 0x7fcc881031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 -- 172.21.15.1:0/3252962452 >> 172.21.15.1:0/3252962452 conn(0x7fcc880fc7a0 msgr2=0x7fcc880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 -- 172.21.15.1:0/3252962452 shutdown_connections 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.717+0000 7fcc9058a640 1 -- 172.21.15.1:0/3252962452 wait complete. 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 Processor -- start 2024-09-12T02:31:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 -- start start 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88102de0 0x7fcc88198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 0x7fcc88198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111f30 con 0x7fcc8810c180 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111db0 con 0x7fcc88103700 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc9058a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881120b0 con 0x7fcc88102de0 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42554/0 (socket says 172.21.15.1:42554) 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 -- 172.21.15.1:0/783808649 learned_addr learned my addr 172.21.15.1:0/783808649 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8e326640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88102de0 0x7fcc88198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8db25640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 0x7fcc88198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 -- 172.21.15.1:0/783808649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88102de0 msgr2=0x7fcc88198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88102de0 0x7fcc88198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 -- 172.21.15.1:0/783808649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 msgr2=0x7fcc88198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 0x7fcc88198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8eb27640 1 -- 172.21.15.1:0/783808649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8819d300 con 0x7fcc8810c180 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.718+0000 7fcc8db25640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 0x7fcc88198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc8eb27640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006010 tx=0x7fcc8002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80034040 con 0x7fcc8810c180 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc80003e00 con 0x7fcc8810c180 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8819d590 con 0x7fcc8810c180 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc800456e0 con 0x7fcc8810c180 2024-09-12T02:31:08.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.719+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc881a4ed0 con 0x7fcc8810c180 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.720+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc881031c0 con 0x7fcc8810c180 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.721+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fcc80037020 con 0x7fcc8810c180 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.722+0000 7fcc7f7fe640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 0x7fcc740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.722+0000 7fcc8e326640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 0x7fcc740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.722+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcc800f0340 con 0x7fcc8810c180 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.722+0000 7fcc8e326640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 0x7fcc740a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005e10 tx=0x7fcc84005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:08.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.725+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc800443e0 con 0x7fcc8810c180 2024-09-12T02:31:08.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.901+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc881a50a0 con 0x7fcc8810c180 2024-09-12T02:31:08.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.903+0000 7fcc7f7fe640 1 -- 172.21.15.1:0/783808649 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7fcc800bd220 con 0x7fcc8810c180 2024-09-12T02:31:08.903 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:08.904 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.905+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 msgr2=0x7fcc740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.905+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 0x7fcc740a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005e10 tx=0x7fcc84005da0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.905+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 msgr2=0x7fcc8819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.905+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006010 tx=0x7fcc8002f710 comp rx=0 tx=0).stop 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.905+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 shutdown_connections 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcc740a2b80 0x7fcc740a5040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc8810c180 0x7fcc8819cc20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc88103700 0x7fcc88198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 --2- 172.21.15.1:0/783808649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc88102de0 0x7fcc88198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 >> 172.21.15.1:0/783808649 conn(0x7fcc880fc7a0 msgr2=0x7fcc880fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:08.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 shutdown_connections 2024-09-12T02:31:08.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:08.906+0000 7fcc9058a640 1 -- 172.21.15.1:0/783808649 wait complete. 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 -- 172.21.15.1:0/2521796538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 msgr2=0x7f419c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 --2- 172.21.15.1:0/2521796538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c1049b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4198009ca0 tx=0x7f419802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 -- 172.21.15.1:0/2521796538 shutdown_connections 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 --2- 172.21.15.1:0/2521796538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 0x7f419c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 --2- 172.21.15.1:0/2521796538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 0x7f419c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 --2- 172.21.15.1:0/2521796538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c1049b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 -- 172.21.15.1:0/2521796538 >> 172.21.15.1:0/2521796538 conn(0x7f419c0fc1e0 msgr2=0x7f419c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 -- 172.21.15.1:0/2521796538 shutdown_connections 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.588+0000 7f41a2e27640 1 -- 172.21.15.1:0/2521796538 wait complete. 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 Processor -- start 2024-09-12T02:31:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 -- start start 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 0x7f419c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 0x7f419c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10d880 con 0x7f419c1025c0 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10d700 con 0x7f419c104ef0 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a2e27640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10da00 con 0x7f419c107820 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a0bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a0bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42578/0 (socket says 172.21.15.1:42578) 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a0bc3640 1 -- 172.21.15.1:0/583534714 learned_addr learned my addr 172.21.15.1:0/583534714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f41a13c4640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 0x7f419c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.589+0000 7f4193fff640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 0x7f419c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 -- 172.21.15.1:0/583534714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 msgr2=0x7f419c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 0x7f419c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 -- 172.21.15.1:0/583534714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 msgr2=0x7f419c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 0x7f419c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 -- 172.21.15.1:0/583534714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c1a1ca0 con 0x7f419c1025c0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4198000f80 tx=0x7f41980319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f4191ffb640 1 -- 172.21.15.1:0/583534714 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198003b70 con 0x7f419c1025c0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f4191ffb640 1 -- 172.21.15.1:0/583534714 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4198003d10 con 0x7f419c1025c0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f4191ffb640 1 -- 172.21.15.1:0/583534714 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419802fc70 con 0x7f419c1025c0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c1a1f30 con 0x7f419c1025c0 2024-09-12T02:31:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.590+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c1a23f0 con 0x7f419c1025c0 2024-09-12T02:31:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f4191ffb640 1 -- 172.21.15.1:0/583534714 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4198004040 con 0x7f419c1025c0 2024-09-12T02:31:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 Processor -- start 2024-09-12T02:31:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 -- start start 2024-09-12T02:31:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f20da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 0x559b85f23830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b85e7f2f0 con 0x559b85f1b9a0 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559b85e27270 con 0x559b85f21370 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b85e7b2b0 con 0x559b85f1c2e0 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42588/0 (socket says 172.21.15.1:42588) 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a13c4640 1 -- 172.21.15.1:0/2016128840 learned_addr learned my addr 172.21.15.1:0/2016128840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f20da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.593+0000 7f4191ffb640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 0x7f41840a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4193fff640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 0x559b85f23830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 -- 172.21.15.1:0/2016128840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 msgr2=0x559b85f20da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f20da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 -- 172.21.15.1:0/2016128840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 msgr2=0x559b85f23830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 0x559b85f23830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 -- 172.21.15.1:0/2016128840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b85e26340 con 0x559b85f1b9a0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4193fff640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 0x559b85f23830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4191ffb640 1 -- 172.21.15.1:0/583534714 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f41980f0390 con 0x7f419c1025c0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 0x7f41840a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f41a13c4640 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4194009da0 tx=0x7f4194011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e07e60618fee65f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4182ffd640 1 -- 172.21.15.1:0/2016128840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194017050 con 0x559b85f1b9a0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4182ffd640 1 -- 172.21.15.1:0/2016128840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f419401be10 con 0x559b85f1b9a0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.594+0000 7f4182ffd640 1 -- 172.21.15.1:0/2016128840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419400f880 con 0x559b85f1b9a0 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- 172.21.15.1:0/2016128840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 msgr2=0x559b85f1bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a13c4640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 0x7f41840a5170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4194023000 tx=0x7f4194024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4194009da0 tx=0x7f4194011810 comp rx=0 tx=0).stop 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- 172.21.15.1:0/2016128840 shutdown_connections 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f21370 0x559b85f23830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f20da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/2016128840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f1bda0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- 172.21.15.1:0/2016128840 >> 172.21.15.1:0/2016128840 conn(0x559b85f17010 msgr2=0x559b85f17410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- 172.21.15.1:0/2016128840 shutdown_connections 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- 172.21.15.1:0/2016128840 wait complete. 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 -- start start 2024-09-12T02:31:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.595+0000 7f41a5bc2740 1 Processor -- start 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f26140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b85f24340 con 0x559b85f21370 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559b85e08290 con 0x559b85f1c2e0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b85f244c0 con 0x559b85f1b9a0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a5bc2740 10 client.0 _ll_register_callbacks cb 0x559b85e39140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42598/0 (socket says 172.21.15.1:42598) 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 -- 172.21.15.1:0/335918167 learned_addr learned my addr 172.21.15.1:0/335918167 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f4193fff640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f26140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 -- 172.21.15.1:0/335918167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 msgr2=0x559b85f25c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 -- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 msgr2=0x559b85f26140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f26140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a13c4640 1 -- 172.21.15.1:0/335918167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b85b92210 con 0x559b85f21370 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f4193fff640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.596+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a13c4640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f419400f400 tx=0x7f419400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45546e4dbedad89d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194035020 con 0x559b85f21370 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4194026640 con 0x559b85f21370 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f419401be10 con 0x559b85f21370 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4194040050 con 0x559b85f21370 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 10 client.15348 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b85c5e620 con 0x559b85f21370 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f419401be10 con 0x559b85f21370 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f41940314e0 con 0x559b85f21370 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 10 client.15348 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 20 client.15348 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f31700 0x559b85f33b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 4 client.15348 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.597+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b85e8ca20 con 0x559b85f31700 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.598+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f31700 0x559b85f33b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.598+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f31700 0x559b85f33b50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebcbcff47457fe2e server_cookie=7a3babfcde43f3c2 in_seq=0 out_seq=0 2024-09-12T02:31:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.598+0000 7f417bfff640 10 client.15348 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f417bfff640 1 -- 172.21.15.1:0/335918167 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b85e8ca20 con 0x559b85f31700 2024-09-12T02:31:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f417bfff640 10 client.15348 handle_command_reply: tid=0 2024-09-12T02:31:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 client.15348 shutdown 2024-09-12T02:31:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 msgr2=0x559b85f2d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f419400f400 tx=0x7f419400fda0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 shutdown_connections 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f2d110 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f31700 0x559b85f33b50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/335918167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f417bfff640 0 client.15348 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 >> 172.21.15.1:0/335918167 conn(0x559b85f17010 msgr2=0x559b85f18820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 shutdown_connections 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 1 -- 172.21.15.1:0/335918167 wait complete. 2024-09-12T02:31:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.599+0000 7f41a5bc2740 20 client.15348 trim_cache size 0 max 16384 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 Processor -- start 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 -- start start 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f2d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f21370 0x559b85f26140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1ab2e0 con 0x559b85f1b9a0 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1ace20 con 0x559b85f1c2e0 2024-09-12T02:31:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1ab9b0 con 0x559b85f21370 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42614/0 (socket says 172.21.15.1:42614) 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 -- 172.21.15.1:0/3505866454 learned_addr learned my addr 172.21.15.1:0/3505866454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 -- 172.21.15.1:0/3505866454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f21370 msgr2=0x559b85f26140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f21370 0x559b85f26140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f4193fff640 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f2d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 -- 172.21.15.1:0/3505866454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 msgr2=0x559b85f2d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f2d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 -- 172.21.15.1:0/3505866454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b85f16e30 con 0x559b85f1b9a0 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f4193fff640 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f2d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.614+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f41980bc9f0 tx=0x7f41980edd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d2955f29518e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41827fc640 1 -- 172.21.15.1:0/3505866454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980d9030 con 0x559b85f1b9a0 2024-09-12T02:31:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41827fc640 1 -- 172.21.15.1:0/3505866454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4198036040 con 0x559b85f1b9a0 2024-09-12T02:31:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41827fc640 1 -- 172.21.15.1:0/3505866454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980c5960 con 0x559b85f1b9a0 2024-09-12T02:31:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 -- 172.21.15.1:0/3505866454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 msgr2=0x559b85f25c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f41980bc9f0 tx=0x7f41980edd40 comp rx=0 tx=0).stop 2024-09-12T02:31:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 -- 172.21.15.1:0/3505866454 shutdown_connections 2024-09-12T02:31:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f21370 0x559b85f26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1c2e0 0x559b85f2d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/3505866454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f1b9a0 0x559b85f25c00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 -- 172.21.15.1:0/3505866454 >> 172.21.15.1:0/3505866454 conn(0x559b85f17010 msgr2=0x559b85f1ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 -- 172.21.15.1:0/3505866454 shutdown_connections 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.615+0000 7f41a5bc2740 1 -- 172.21.15.1:0/3505866454 wait complete. 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 -- start start 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 Processor -- start 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1b9a0 0x559b85f29f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f2a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1ac750 con 0x559b85f21370 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1ac080 con 0x559b85f1b9a0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f419c1a92c0 con 0x559b85f1c2e0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a5bc2740 10 client.0 _ll_register_callbacks cb 0x7f41980bcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42620/0 (socket says 172.21.15.1:42620) 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 -- 172.21.15.1:0/554461770 learned_addr learned my addr 172.21.15.1:0/554461770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f4193fff640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f2a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1b9a0 0x559b85f29f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 -- 172.21.15.1:0/554461770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 msgr2=0x559b85f2a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f2a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 -- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1b9a0 msgr2=0x559b85f29f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.616+0000 7f41a13c4640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1b9a0 0x559b85f29f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a13c4640 1 -- 172.21.15.1:0/554461770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b85f9a960 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a13c4640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4194009be0 tx=0x7f4194005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f10fab9cb70919 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194049060 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f4194031b70 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4198036040 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4194017030 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 10 client.15354 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b85f9baa0 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4198036040 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4194026920 con 0x559b85f21370 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 10 client.15354 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 20 client.15354 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f9c450 0x559b85f9e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.617+0000 7f41a5bc2740 4 client.15354 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.618+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b85e86d70 con 0x559b85f9c450 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.618+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f9c450 0x559b85f9e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.618+0000 7f417bfff640 10 client.15354 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.618+0000 7f41a0bc3640 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f9c450 0x559b85f9e870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2801402734312c9b server_cookie=d4251cec508acbf6 in_seq=0 out_seq=0 2024-09-12T02:31:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f417bfff640 1 -- 172.21.15.1:0/554461770 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b85e86d70 con 0x559b85f9c450 2024-09-12T02:31:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f417bfff640 10 client.15354 handle_command_reply: tid=0 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 client.15354 shutdown 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 msgr2=0x559b85f9a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4194009be0 tx=0x7f4194005830 comp rx=0 tx=0).stop 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 shutdown_connections 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b85f21370 0x559b85f9a420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b85f9c450 0x559b85f9e870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b85f1c2e0 0x559b85f2a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f417bfff640 0 client.15354 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 --2- 172.21.15.1:0/554461770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b85f1b9a0 0x559b85f29f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 >> 172.21.15.1:0/554461770 conn(0x559b85f17010 msgr2=0x559b85f25bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 shutdown_connections 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 1 -- 172.21.15.1:0/554461770 wait complete. 2024-09-12T02:31:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.629+0000 7f41a5bc2740 20 client.15354 trim_cache size 0 max 16384 2024-09-12T02:31:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:31:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:31:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:31:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 msgr2=0x7f41840a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 0x7f41840a5170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4194023000 tx=0x7f4194024000 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 msgr2=0x7f419c19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4198000f80 tx=0x7f41980319f0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 shutdown_connections 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f41840a2cb0 0x7f41840a5170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f419c107820 0x7f419c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f419c104ef0 0x7f419c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 --2- 172.21.15.1:0/583534714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c1025c0 0x7f419c19a080 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 >> 172.21.15.1:0/583534714 conn(0x7f419c0fc1e0 msgr2=0x7f419c101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 shutdown_connections 2024-09-12T02:31:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:09.630+0000 7f41a2e27640 1 -- 172.21.15.1:0/583534714 wait complete. 2024-09-12T02:31:09.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:09 smithi001 ceph-mon[31252]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:31:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:09 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/783808649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:09.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T02:31:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:09 smithi134 ceph-mon[35091]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:31:09.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:09 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/783808649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:09 smithi173 ceph-mon[35036]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:31:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:09 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/783808649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:10.084 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:11.327 INFO:teuthology.orchestra.run.smithi001.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T02:31:11.327 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T02:31:11.328 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T02:31:11.328 DEBUG:tasks.quiescer:Yielding 2024-09-12T02:31:11.328 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:31:11.342 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:31:11.343 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:31:11.343 INFO:tasks.workunit:timeout=3h 2024-09-12T02:31:11.343 INFO:tasks.workunit:cleanup=True 2024-09-12T02:31:11.343 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:11.344 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-12 02:29:12.187121185 +0000 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-12 02:29:12.187121185 +0000 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-12 02:30:47.317049432 +0000 2024-09-12T02:31:11.364 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-12 02:29:12.187121185 +0000 2024-09-12T02:31:11.364 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:31:11.365 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:31:11.440 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:31:11.497 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:31:11.619 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:11.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:11 smithi001 ceph-mon[31252]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:31:11.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:11 smithi134 ceph-mon[35091]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:31:11.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:11 smithi173 ceph-mon[35036]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:31:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 -- 172.21.15.1:0/1772930998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 msgr2=0x7fc86c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 --2- 172.21.15.1:0/1772930998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c1029b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc860009900 tx=0x7fc86002a480 comp rx=0 tx=0).stop 2024-09-12T02:31:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 -- 172.21.15.1:0/1772930998 shutdown_connections 2024-09-12T02:31:12.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 --2- 172.21.15.1:0/1772930998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c1029b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 --2- 172.21.15.1:0/1772930998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102ef0 0x7fc86c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 --2- 172.21.15.1:0/1772930998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c100e20 0x7fc86c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 -- 172.21.15.1:0/1772930998 >> 172.21.15.1:0/1772930998 conn(0x7fc86c0fc7d0 msgr2=0x7fc86c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 -- 172.21.15.1:0/1772930998 shutdown_connections 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.112+0000 7fc871682640 1 -- 172.21.15.1:0/1772930998 wait complete. 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 Processor -- start 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 -- start start 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100e20 0x7fc86c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 0x7fc86c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c110f80 con 0x7fc86c102570 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c110e00 con 0x7fc86c102ef0 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc871682640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c111100 con 0x7fc86c100e20 2024-09-12T02:31:12.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc86a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc86a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49740/0 (socket says 172.21.15.1:49740) 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.113+0000 7fc86a7fc640 1 -- 172.21.15.1:0/3152761095 learned_addr learned my addr 172.21.15.1:0/3152761095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86affd640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100e20 0x7fc86c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86b7fe640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 0x7fc86c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 -- 172.21.15.1:0/3152761095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100e20 msgr2=0x7fc86c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100e20 0x7fc86c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 -- 172.21.15.1:0/3152761095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 msgr2=0x7fc86c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 0x7fc86c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 -- 172.21.15.1:0/3152761095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c19d490 con 0x7fc86c102570 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86b7fe640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 0x7fc86c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc86a7fc640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86003f070 con 0x7fc86c102570 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc860031c30 con 0x7fc86c102570 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860035030 con 0x7fc86c102570 2024-09-12T02:31:12.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86c19d720 con 0x7fc86c102570 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.114+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86c19db20 con 0x7fc86c102570 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.116+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86c101200 con 0x7fc86c102570 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.117+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc860042070 con 0x7fc86c102570 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.118+0000 7fc853fff640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 0x7fc8540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.118+0000 7fc86affd640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 0x7fc8540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.118+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc8600ef790 con 0x7fc86c102570 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.118+0000 7fc86affd640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 0x7fc8540a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009bd0 tx=0x7fc85c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:12.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.122+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8600bc6d0 con 0x7fc86c102570 2024-09-12T02:31:12.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.341+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc86c02d7c0 con 0x7fc86c102570 2024-09-12T02:31:12.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.342+0000 7fc853fff640 1 -- 172.21.15.1:0/3152761095 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7fc8600bbfd0 con 0x7fc86c102570 2024-09-12T02:31:12.342 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:12.342 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:12.343 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:12.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 msgr2=0x7fc8540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 0x7fc8540a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009bd0 tx=0x7fc85c005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 msgr2=0x7fc86c198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860003c10 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 shutdown_connections 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc8540a2b80 0x7fc8540a5040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc86c102570 0x7fc86c198a20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc86c102ef0 0x7fc86c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 --2- 172.21.15.1:0/3152761095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100e20 0x7fc86c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 >> 172.21.15.1:0/3152761095 conn(0x7fc86c0fc7d0 msgr2=0x7fc86c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 shutdown_connections 2024-09-12T02:31:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:12.344+0000 7fc871682640 1 -- 172.21.15.1:0/3152761095 wait complete. 2024-09-12T02:31:12.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:12 smithi001 ceph-mon[31252]: scrub summary: idle 2024-09-12T02:31:12.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:12 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3152761095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:12.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:12 smithi134 ceph-mon[35091]: scrub summary: idle 2024-09-12T02:31:12.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:12 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3152761095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:12.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:12 smithi173 ceph-mon[35036]: scrub summary: idle 2024-09-12T02:31:12.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:12 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3152761095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:13.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:28:52.748371+0000', 'modified': '2024-09-12T02:30:48.047449+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24494, 'mds_1': 24475, 'mds_2': 24470, 'mds_3': 24457, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6839/1207631170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6838', 'nonce': 1207631170}, {'type': 'v1', 'addr': '172.21.15.1:6839', 'nonce': 1207631170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.1:6841/2292917282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6840', 'nonce': 2292917282}, {'type': 'v1', 'addr': '172.21.15.1:6841', 'nonce': 2292917282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24415': {'gid': 24415, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/743947684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 743947684}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 743947684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/1137270315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1137270315}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 1137270315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/4061904482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 4061904482}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4061904482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.173:6835/7391882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 7391882}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 7391882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/2489188498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 2489188498}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 2489188498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.134:6837/2931886461', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2931886461}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2931886461}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/3274926052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 3274926052}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 3274926052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6839/3689768435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 3689768435}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 3689768435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24451, 24457, 24470, 24475, 24494]} 2024-09-12T02:31:13.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:31:13.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T02:31:13.367 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:13.763 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:13 smithi001 ceph-mon[31252]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:31:13.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/170552627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 msgr2=0x7fc99c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/170552627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c10ec40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc994009cd0 tx=0x7fc99402a910 comp rx=0 tx=0).stop 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/170552627 shutdown_connections 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/170552627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c10ec40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/170552627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 0x7fc99c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/170552627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 0x7fc99c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/170552627 >> 172.21.15.1:0/170552627 conn(0x7fc99c0fc7d0 msgr2=0x7fc99c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/170552627 shutdown_connections 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/170552627 wait complete. 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 Processor -- start 2024-09-12T02:31:13.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.847+0000 7fc9a0c2f640 1 -- start start 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 0x7fc99c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 0x7fc99c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1120e0 con 0x7fc99c1082a0 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c111f60 con 0x7fc99c102d30 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc9a0c2f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c112260 con 0x7fc99c1036e0 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49760/0 (socket says 172.21.15.1:49760) 2024-09-12T02:31:13.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 -- 172.21.15.1:0/691224380 learned_addr learned my addr 172.21.15.1:0/691224380 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc999d9b640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 0x7fc99c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99a59c640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 0x7fc99c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 -- 172.21.15.1:0/691224380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 msgr2=0x7fc99c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 0x7fc99c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 -- 172.21.15.1:0/691224380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 msgr2=0x7fc99c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 0x7fc99c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 -- 172.21.15.1:0/691224380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c1a69e0 con 0x7fc99c1082a0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.848+0000 7fc99ad9d640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc994005cc0 tx=0x7fc994031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.849+0000 7fc98b7fe640 1 -- 172.21.15.1:0/691224380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994031850 con 0x7fc99c1082a0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.849+0000 7fc98b7fe640 1 -- 172.21.15.1:0/691224380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc994004520 con 0x7fc99c1082a0 2024-09-12T02:31:13.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.849+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1a6c70 con 0x7fc99c1082a0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.849+0000 7fc98b7fe640 1 -- 172.21.15.1:0/691224380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99402fcd0 con 0x7fc99c1082a0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.849+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a7200 con 0x7fc99c1082a0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.851+0000 7fc98b7fe640 1 -- 172.21.15.1:0/691224380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc9940046d0 con 0x7fc99c1082a0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.851+0000 7fc9a3008740 1 Processor -- start 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.851+0000 7fc9a3008740 1 -- start start 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a042f0 0x559ee5a0e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a0ebb0 0x559ee5a10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ee596a090 con 0x559ee5a042f0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ee5911a70 con 0x559ee5a0ebb0 2024-09-12T02:31:13.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc9a3008740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559ee5966050 con 0x559ee5a039d0 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc99a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a042f0 0x559ee5a0e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:38086/0 (socket says 172.21.15.1:38086) 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 -- 172.21.15.1:0/659772314 learned_addr learned my addr 172.21.15.1:0/659772314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc98b7fe640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 0x7fc9840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a0ebb0 0x559ee5a10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc99ad9d640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 0x7fc9840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 -- 172.21.15.1:0/659772314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a0ebb0 msgr2=0x559ee5a10fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a0ebb0 0x559ee5a10fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 -- 172.21.15.1:0/659772314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a042f0 msgr2=0x559ee5a0e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a042f0 0x559ee5a0e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 -- 172.21.15.1:0/659772314 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee591e130 con 0x559ee5a039d0 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc98b7fe640 1 -- 172.21.15.1:0/691224380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc9940f05c0 con 0x7fc99c1082a0 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.852+0000 7fc999d9b640 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc990009330 tx=0x7fc990009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53ffe33c3973034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc99ad9d640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 0x7fc9840a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9940b97d0 tx=0x7fc9940879d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc988ff9640 1 -- 172.21.15.1:0/659772314 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990017470 con 0x559ee5a039d0 2024-09-12T02:31:13.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc988ff9640 1 -- 172.21.15.1:0/659772314 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99001c070 con 0x559ee5a039d0 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc988ff9640 1 -- 172.21.15.1:0/659772314 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900159b0 con 0x559ee5a039d0 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 -- 172.21.15.1:0/659772314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 msgr2=0x559ee5a03db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc990009330 tx=0x7fc990009580 comp rx=0 tx=0).stop 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 -- 172.21.15.1:0/659772314 shutdown_connections 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a042f0 0x559ee5a0e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a0ebb0 0x559ee5a10fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 --2- 172.21.15.1:0/659772314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a03db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.853+0000 7fc9a3008740 1 -- 172.21.15.1:0/659772314 >> 172.21.15.1:0/659772314 conn(0x559ee59fff60 msgr2=0x559ee5a00340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- 172.21.15.1:0/659772314 shutdown_connections 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- 172.21.15.1:0/659772314 wait complete. 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- start start 2024-09-12T02:31:13.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 Processor -- start 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a0e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a042f0 0x559ee5a0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a11780 con 0x559ee5a0ebb0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ee5924f20 con 0x559ee5a042f0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a11900 con 0x559ee5a039d0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.854+0000 7fc9a3008740 10 client.0 _ll_register_callbacks cb 0x559ee58ee030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49782/0 (socket says 172.21.15.1:49782) 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 -- 172.21.15.1:0/2447545765 learned_addr learned my addr 172.21.15.1:0/2447545765 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a0e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc99a59c640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a042f0 0x559ee5a0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 -- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 msgr2=0x559ee5a0e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a0e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 -- 172.21.15.1:0/2447545765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a042f0 msgr2=0x559ee5a0b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a042f0 0x559ee5a0b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 -- 172.21.15.1:0/2447545765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee56db2b0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc999d9b640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a010 tx=0x7fc990008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f0cefd698af59d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900100b0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc990017670 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99001c070 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc9900059c0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc9a3008740 10 client.15372 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.855+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ee5a1d130 con 0x559ee5a0ebb0 2024-09-12T02:31:13.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99001c070 con 0x559ee5a0ebb0 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc990022440 con 0x559ee5a0ebb0 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 10 client.15372 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 20 client.15372 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a1f340 0x559ee5a207b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 4 client.15372 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ee5977600 con 0x559ee5a1f340 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.856+0000 7fc99a59c640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a1f340 0x559ee5a207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.857+0000 7fc99a59c640 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a1f340 0x559ee5a207b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae20a8a10bbde157 server_cookie=3c42ea2fa9329a2 in_seq=0 out_seq=0 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.857+0000 7fc981ffb640 10 client.15372 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.857+0000 7fc981ffb640 1 -- 172.21.15.1:0/2447545765 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ee5977600 con 0x559ee5a1f340 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.857+0000 7fc981ffb640 10 client.15372 handle_command_reply: tid=0 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 client.15372 shutdown 2024-09-12T02:31:13.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 msgr2=0x559ee5a0bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a010 tx=0x7fc990008040 comp rx=0 tx=0).stop 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 shutdown_connections 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a1f340 0x559ee5a207b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a0bd50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a042f0 0x559ee5a0b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 --2- 172.21.15.1:0/2447545765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a039d0 0x559ee5a0e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc981ffb640 0 client.15372 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 >> 172.21.15.1:0/2447545765 conn(0x559ee59fff60 msgr2=0x559ee5a05c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 shutdown_connections 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 1 -- 172.21.15.1:0/2447545765 wait complete. 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.858+0000 7fc9a3008740 20 client.15372 trim_cache size 0 max 16384 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 Processor -- start 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 -- start start 2024-09-12T02:31:13.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a207b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a1eaf0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a1f1c0 con 0x559ee5a039d0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.876+0000 7fc9a3008740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a1f890 con 0x559ee5a042f0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49798/0 (socket says 172.21.15.1:49798) 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 -- 172.21.15.1:0/1752952575 learned_addr learned my addr 172.21.15.1:0/1752952575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc99a59c640 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 -- 172.21.15.1:0/1752952575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 msgr2=0x559ee5a0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a0b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 -- 172.21.15.1:0/1752952575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 msgr2=0x559ee5a207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a207b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 -- 172.21.15.1:0/1752952575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee5a112e0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc990011010 tx=0x7fc990009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f66f42be2dd8c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc983fff640 1 -- 172.21.15.1:0/1752952575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990015590 con 0x559ee5a0ebb0 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc983fff640 1 -- 172.21.15.1:0/1752952575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99001c030 con 0x559ee5a0ebb0 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.877+0000 7fc983fff640 1 -- 172.21.15.1:0/1752952575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990017950 con 0x559ee5a0ebb0 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- 172.21.15.1:0/1752952575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 msgr2=0x559ee5a08a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc990011010 tx=0x7fc990009110 comp rx=0 tx=0).stop 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- 172.21.15.1:0/1752952575 shutdown_connections 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a08a70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1752952575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- 172.21.15.1:0/1752952575 >> 172.21.15.1:0/1752952575 conn(0x559ee59fff60 msgr2=0x559ee5a0a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- 172.21.15.1:0/1752952575 shutdown_connections 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- 172.21.15.1:0/1752952575 wait complete. 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 -- start start 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.878+0000 7fc9a3008740 1 Processor -- start 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a28e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a20630 con 0x559ee5a0ebb0 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a1ff60 con 0x559ee5a039d0 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559ee5a20d00 con 0x559ee5a042f0 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc9a3008740 10 client.0 _ll_register_callbacks cb 0x7fc98c00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49812/0 (socket says 172.21.15.1:49812) 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 -- 172.21.15.1:0/1914284781 learned_addr learned my addr 172.21.15.1:0/1914284781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:13.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc99a59c640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a28e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 -- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 msgr2=0x559ee5a293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 -- 172.21.15.1:0/1914284781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 msgr2=0x559ee5a28e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a28e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 -- 172.21.15.1:0/1914284781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee5a24c10 con 0x559ee5a0ebb0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc999d9b640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc990009da0 tx=0x7fc990000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2c882b6c8e52c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.879+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900093a0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc990017bb0 con 0x559ee5a0ebb0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99001c030 con 0x559ee5a0ebb0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc990017470 con 0x559ee5a0ebb0 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 10 client.15378 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:13.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ee5a89700 con 0x559ee5a0ebb0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99001c030 con 0x559ee5a0ebb0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc99003b950 con 0x559ee5a0ebb0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 10 client.15378 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 10 client.15378 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 20 client.15378 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a8df60 0x559ee5a8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 4 client.15378 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "status"}) -- 0x559ee5971b10 con 0x559ee5a8df60 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.880+0000 7fc99a59c640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a8df60 0x559ee5a8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc981ffb640 10 client.15378 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc99a59c640 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a8df60 0x559ee5a8cc70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1eaca1d334b8700 server_cookie=4443becbe63895f1 in_seq=0 out_seq=0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc981ffb640 1 -- 172.21.15.1:0/1914284781 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x559ee5971b10 con 0x559ee5a8df60 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc981ffb640 10 client.15378 handle_command_reply: tid=0 2024-09-12T02:31:13.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 client.15378 shutdown 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 msgr2=0x559ee5a243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc990009da0 tx=0x7fc990000bc0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 shutdown_connections 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x559ee5a8df60 0x559ee5a8cc70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc981ffb640 0 client.15378 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ee5a0ebb0 0x559ee5a243e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559ee5a042f0 0x559ee5a293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 --2- 172.21.15.1:0/1914284781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ee5a039d0 0x559ee5a28e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 >> 172.21.15.1:0/1914284781 conn(0x559ee59fff60 msgr2=0x559ee5a0ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 shutdown_connections 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 1 -- 172.21.15.1:0/1914284781 wait complete. 2024-09-12T02:31:13.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.881+0000 7fc9a3008740 20 client.15378 trim_cache size 0 max 16384 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 4, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24451, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 129.85773555, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 28, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 168.96277316600001 2024-09-12T02:31:13.900 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:13.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 msgr2=0x7fc9840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 0x7fc9840a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9940b97d0 tx=0x7fc9940879d0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 msgr2=0x7fc99c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:13.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc994005cc0 tx=0x7fc994031460 comp rx=0 tx=0).stop 2024-09-12T02:31:13.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 shutdown_connections 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc9840a2c00 0x7fc9840a50c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc99c1082a0 0x7fc99c101410 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc99c1036e0 0x7fc99c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 --2- 172.21.15.1:0/691224380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc99c102d30 0x7fc99c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 >> 172.21.15.1:0/691224380 conn(0x7fc99c0fc7d0 msgr2=0x7fc99c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 shutdown_connections 2024-09-12T02:31:13.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:13.882+0000 7fc9a0c2f640 1 -- 172.21.15.1:0/691224380 wait complete. 2024-09-12T02:31:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:13 smithi134 ceph-mon[35091]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:31:13.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:13 smithi173 ceph-mon[35036]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-12T02:31:14.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:31:14.900 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 -- 172.21.15.1:0/3007224283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564102ef0 msgr2=0x7f656410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 --2- 172.21.15.1:0/3007224283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564102ef0 0x7f656410da40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f655c009ca0 tx=0x7f655c02a950 comp rx=0 tx=0).stop 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 -- 172.21.15.1:0/3007224283 shutdown_connections 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 --2- 172.21.15.1:0/3007224283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564102ef0 0x7f656410da40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 --2- 172.21.15.1:0/3007224283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f65641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 --2- 172.21.15.1:0/3007224283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564100e20 0x7f6564101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 -- 172.21.15.1:0/3007224283 >> 172.21.15.1:0/3007224283 conn(0x7f65640fc7d0 msgr2=0x7f65640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 -- 172.21.15.1:0/3007224283 shutdown_connections 2024-09-12T02:31:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.424+0000 7f656a5a4640 1 -- 172.21.15.1:0/3007224283 wait complete. 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 Processor -- start 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 -- start start 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f656419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 0x7f656419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6564110fd0 con 0x7f6564100e20 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6564110e50 con 0x7f6564102ef0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f656a5a4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6564111150 con 0x7f6564102570 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49830/0 (socket says 172.21.15.1:49830) 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 -- 172.21.15.1:0/4567305 learned_addr learned my addr 172.21.15.1:0/4567305 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6568b41640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 0x7f656419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f655bfff640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f656419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 -- 172.21.15.1:0/4567305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 msgr2=0x7f656419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f656419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 -- 172.21.15.1:0/4567305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 msgr2=0x7f656419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 0x7f656419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6563fff640 1 -- 172.21.15.1:0/4567305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656419f640 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f6568b41640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 0x7f656419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.425+0000 7f655bfff640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f656419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f6563fff640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f655400c890 tx=0x7f655400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f6561ffb640 1 -- 172.21.15.1:0/4567305 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004220 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f6561ffb640 1 -- 172.21.15.1:0/4567305 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65540043c0 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656419f930 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f6561ffb640 1 -- 172.21.15.1:0/4567305 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540049e0 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.426+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65641a7210 con 0x7f6564100e20 2024-09-12T02:31:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 Processor -- start 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f6561ffb640 1 -- 172.21.15.1:0/4567305 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f65540079b0 con 0x7f6564100e20 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 -- start start 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb447db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb452670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.428+0000 7f656c97d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560bfb3ae090 con 0x560bfb452bb0 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f656c97d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560bfb355a70 con 0x560bfb4479d0 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f656c97d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560bfb3aa050 con 0x560bfb4482f0 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49844/0 (socket says 172.21.15.1:49844) 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 -- 172.21.15.1:0/3436473687 learned_addr learned my addr 172.21.15.1:0/3436473687 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f6563fff640 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb452670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f6568b41640 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb447db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 -- 172.21.15.1:0/3436473687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 msgr2=0x560bfb452670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb452670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 -- 172.21.15.1:0/3436473687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 msgr2=0x560bfb447db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb447db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 -- 172.21.15.1:0/3436473687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bfb362130 con 0x560bfb452bb0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f6561ffb640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 0x7f65500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655bfff640 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f654c00bd30 tx=0x7f654c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3537da76f85be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f6568b41640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 0x7f65500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655a7fc640 1 -- 172.21.15.1:0/3436473687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c015070 con 0x560bfb452bb0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f6561ffb640 1 -- 172.21.15.1:0/4567305 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f65540cf0e0 con 0x7f6564100e20 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655a7fc640 1 -- 172.21.15.1:0/3436473687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f654c00be20 con 0x560bfb452bb0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.429+0000 7f655a7fc640 1 -- 172.21.15.1:0/3436473687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c011a10 con 0x560bfb452bb0 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 -- 172.21.15.1:0/3436473687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 msgr2=0x560bfb454fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f6568b41640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 0x7f65500a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f655c009430 tx=0x7f655c0093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f654c00bd30 tx=0x7f654c00f730 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 -- 172.21.15.1:0/3436473687 shutdown_connections 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb454fa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb452670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 --2- 172.21.15.1:0/3436473687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb447db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 -- 172.21.15.1:0/3436473687 >> 172.21.15.1:0/3436473687 conn(0x560bfb443f60 msgr2=0x560bfb444340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 -- 172.21.15.1:0/3436473687 shutdown_connections 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.430+0000 7f656c97d740 1 -- 172.21.15.1:0/3436473687 wait complete. 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 -- start start 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 Processor -- start 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb452bb0 0x560bfb44fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560bfb455780 con 0x560bfb4479d0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560bfb368f20 con 0x560bfb452bb0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560bfb455900 con 0x560bfb4482f0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f656c97d740 10 client.0 _ll_register_callbacks cb 0x560bfb332030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f6563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f6563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49854/0 (socket says 172.21.15.1:49854) 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f6563fff640 1 -- 172.21.15.1:0/2557978407 learned_addr learned my addr 172.21.15.1:0/2557978407 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.431+0000 7f655bfff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6568b41640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb452bb0 0x560bfb44fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 -- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 msgr2=0x560bfb44f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 -- 172.21.15.1:0/2557978407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb452bb0 msgr2=0x560bfb44fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb452bb0 0x560bfb44fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 -- 172.21.15.1:0/2557978407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bfb11f2b0 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f655bfff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f6563fff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6554007590 tx=0x7f65540053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bae57325705c2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655401d040 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6554007ca0 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f654c00be20 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f655409b460 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f656c97d740 10 client.15390 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560bfb461160 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f654c00be20 con 0x560bfb4479d0 2024-09-12T02:31:15.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f65540a4100 con 0x560bfb4479d0 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.432+0000 7f656c97d740 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f656c97d740 10 client.15390 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f656c97d740 20 client.15390 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb463710 0x560bfb464b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f656c97d740 4 client.15390 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bfb3bb600 con 0x560bfb463710 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f655bfff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb463710 0x560bfb464b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f65437fe640 10 client.15390 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.433+0000 7f655bfff640 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb463710 0x560bfb464b80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=273191b1b1e56f8 server_cookie=badce89c8ee61f9a in_seq=0 out_seq=0 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f65437fe640 1 -- 172.21.15.1:0/2557978407 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bfb3bb600 con 0x560bfb463710 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f65437fe640 10 client.15390 handle_command_reply: tid=0 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 client.15390 shutdown 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 msgr2=0x560bfb4524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6554007590 tx=0x7f65540053a0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 shutdown_connections 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb463710 0x560bfb464b80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb452bb0 0x560bfb44fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 --2- 172.21.15.1:0/2557978407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb4479d0 0x560bfb4524c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 >> 172.21.15.1:0/2557978407 conn(0x560bfb443f60 msgr2=0x560bfb449c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f65437fe640 0 client.15390 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 shutdown_connections 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 1 -- 172.21.15.1:0/2557978407 wait complete. 2024-09-12T02:31:15.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.434+0000 7f656c97d740 20 client.15390 trim_cache size 0 max 16384 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.452+0000 7f656c97d740 1 Processor -- start 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.452+0000 7f656c97d740 1 -- start start 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb463710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb444340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560bfb462ec0 con 0x560bfb452bb0 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560bfb463590 con 0x560bfb4479d0 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f656c97d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560bfb463c60 con 0x560bfb4482f0 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49870/0 (socket says 172.21.15.1:49870) 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 -- 172.21.15.1:0/1715045090 learned_addr learned my addr 172.21.15.1:0/1715045090 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6563fff640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb463710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f655bfff640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb444340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 -- 172.21.15.1:0/1715045090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 msgr2=0x560bfb444340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb444340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 -- 172.21.15.1:0/1715045090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 msgr2=0x560bfb463710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb463710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 -- 172.21.15.1:0/1715045090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bfb452830 con 0x560bfb452bb0 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f655bfff640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb444340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6563fff640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb463710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6568b41640 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f655c009ca0 tx=0x7f655c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a47e367625be94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.453+0000 7f6559ffb640 1 -- 172.21.15.1:0/1715045090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c034040 con 0x560bfb452bb0 2024-09-12T02:31:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f6559ffb640 1 -- 172.21.15.1:0/1715045090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655c004040 con 0x560bfb452bb0 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f6559ffb640 1 -- 172.21.15.1:0/1715045090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c030770 con 0x560bfb452bb0 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 -- 172.21.15.1:0/1715045090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 msgr2=0x560bfb444880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f655c009ca0 tx=0x7f655c040000 comp rx=0 tx=0).stop 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 -- 172.21.15.1:0/1715045090 shutdown_connections 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb444880 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb444340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 --2- 172.21.15.1:0/1715045090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb463710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 -- 172.21.15.1:0/1715045090 >> 172.21.15.1:0/1715045090 conn(0x560bfb443f60 msgr2=0x560bfb44f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 -- 172.21.15.1:0/1715045090 shutdown_connections 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.454+0000 7f656c97d740 1 -- 172.21.15.1:0/1715045090 wait complete. 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 -- start start 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 Processor -- start 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb44baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560bfb464a00 con 0x560bfb452bb0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560bfb464330 con 0x560bfb4479d0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560bfb4650d0 con 0x560bfb4482f0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f656c97d740 10 client.0 _ll_register_callbacks cb 0x7f65540057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f6568b41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f6568b41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49884/0 (socket says 172.21.15.1:49884) 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f6568b41640 1 -- 172.21.15.1:0/3262505497 learned_addr learned my addr 172.21.15.1:0/3262505497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.455+0000 7f6563fff640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb44baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f655bfff640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 -- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 msgr2=0x560bfb44bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 -- 172.21.15.1:0/3262505497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 msgr2=0x560bfb44baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb44baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 -- 172.21.15.1:0/3262505497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bfb4cbe10 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6563fff640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb44baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f6568b41640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f655c004870 tx=0x7f655c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8d11708eb6af57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f65437fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c056070 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f655c02fa70 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f655c004040 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f655c062050 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f656c97d740 10 client.15396 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560bfb4cd060 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.456+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655c004040 con 0x560bfb452bb0 2024-09-12T02:31:15.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f655c052430 con 0x560bfb452bb0 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 10 client.15396 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 10 client.15396 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 20 client.15396 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb4d1700 0x560bfb4d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 4 client.15396 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "status"}) -- 0x560bfb3b5b10 con 0x560bfb4d1700 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.457+0000 7f6563fff640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb4d1700 0x560bfb4d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f6563fff640 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb4d1700 0x560bfb4d0410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b19fcdf99e9afa02 server_cookie=597a58ad78bfcd08 in_seq=0 out_seq=0 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f65437fe640 10 client.15396 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f65437fe640 1 -- 172.21.15.1:0/3262505497 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560bfb3b5b10 con 0x560bfb4d1700 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f65437fe640 10 client.15396 handle_command_reply: tid=0 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 client.15396 shutdown 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 msgr2=0x560bfb44c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f655c004870 tx=0x7f655c0048a0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 shutdown_connections 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560bfb4d1700 0x560bfb4d0410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560bfb452bb0 0x560bfb44c520 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560bfb4482f0 0x560bfb44bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 --2- 172.21.15.1:0/3262505497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560bfb4479d0 0x560bfb44baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f65437fe640 0 client.15396 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 >> 172.21.15.1:0/3262505497 conn(0x560bfb443f60 msgr2=0x560bfb444340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 shutdown_connections 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 1 -- 172.21.15.1:0/3262505497 wait complete. 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.458+0000 7f656c97d740 20 client.15396 trim_cache size 0 max 16384 2024-09-12T02:31:15.470 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 3, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24457, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 132.44233670700001, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 28, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 167.88112610499999 2024-09-12T02:31:15.471 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 msgr2=0x7f65500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 0x7f65500a50c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f655c009430 tx=0x7f655c0093a0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 msgr2=0x7f656419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f655400c890 tx=0x7f655400cd50 comp rx=0 tx=0).stop 2024-09-12T02:31:15.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 shutdown_connections 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f65500a2c00 0x7f65500a50c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6564102ef0 0x7f656419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6564102570 0x7f656419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 --2- 172.21.15.1:0/4567305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6564100e20 0x7f656419a690 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 >> 172.21.15.1:0/4567305 conn(0x7f65640fc7d0 msgr2=0x7f656406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 shutdown_connections 2024-09-12T02:31:15.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:15.459+0000 7f656a5a4640 1 -- 172.21.15.1:0/4567305 wait complete. 2024-09-12T02:31:15.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:15 smithi001 ceph-mon[31252]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:15.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:15 smithi134 ceph-mon[35091]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:15.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:15 smithi173 ceph-mon[35036]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:16.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:31:16.436 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:16.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.924+0000 7fe838fca640 1 -- 172.21.15.1:0/2490300619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834106f10 msgr2=0x7fe83410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.924+0000 7fe838fca640 1 --2- 172.21.15.1:0/2490300619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834106f10 0x7fe83410ea90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009900 tx=0x7fe82c02a410 comp rx=0 tx=0).stop 2024-09-12T02:31:16.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 -- 172.21.15.1:0/2490300619 shutdown_connections 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 --2- 172.21.15.1:0/2490300619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834106f10 0x7fe83410ea90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 --2- 172.21.15.1:0/2490300619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834102790 0x7fe8341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 --2- 172.21.15.1:0/2490300619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 0x7fe8341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 -- 172.21.15.1:0/2490300619 >> 172.21.15.1:0/2490300619 conn(0x7fe8340fd8c0 msgr2=0x7fe8340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 -- 172.21.15.1:0/2490300619 shutdown_connections 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 -- 172.21.15.1:0/2490300619 wait complete. 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 Processor -- start 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.925+0000 7fe838fca640 1 -- start start 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 0x7fe83419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834106f10 0x7fe83419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe834111f90 con 0x7fe834102790 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe834111e10 con 0x7fe834101de0 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe838fca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe834112110 con 0x7fe834106f10 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49906/0 (socket says 172.21.15.1:49906) 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 -- 172.21.15.1:0/3300989692 learned_addr learned my addr 172.21.15.1:0/3300989692 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe83259c640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 0x7fe83419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe832d9d640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834106f10 0x7fe83419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 -- 172.21.15.1:0/3300989692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834106f10 msgr2=0x7fe83419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834106f10 0x7fe83419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 -- 172.21.15.1:0/3300989692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 msgr2=0x7fe83419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 0x7fe83419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 -- 172.21.15.1:0/3300989692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83419f640 con 0x7fe834102790 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.926+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00b4a0 tx=0x7fe81c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.927+0000 7fe82b7fe640 1 -- 172.21.15.1:0/3300989692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c014070 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.927+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83419f930 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.927+0000 7fe82b7fe640 1 -- 172.21.15.1:0/3300989692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe81c010af0 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.927+0000 7fe82b7fe640 1 -- 172.21.15.1:0/3300989692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c017d10 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.927+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8341a7210 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.929+0000 7fe82b7fe640 1 -- 172.21.15.1:0/3300989692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe81c017070 con 0x7fe834102790 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.929+0000 7fe83b3a3740 1 Processor -- start 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 -- start start 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cc4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90cd1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c90c2b090 con 0x556c90cc52f0 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556c90bd2a70 con 0x556c90cc49d0 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c90c27050 con 0x556c90ccfbb0 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe82b7fe640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 0x7fe8200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49914/0 (socket says 172.21.15.1:49914) 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83259c640 1 -- 172.21.15.1:0/4178992231 learned_addr learned my addr 172.21.15.1:0/4178992231 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe832d9d640 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cc4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe82b7fe640 1 -- 172.21.15.1:0/3300989692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe81c0ce3e0 con 0x7fe834102790 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe831d9b640 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90cd1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe832d9d640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 0x7fe8200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.930+0000 7fe83259c640 1 -- 172.21.15.1:0/4178992231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 msgr2=0x556c90cd1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe83259c640 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90cd1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe83259c640 1 -- 172.21.15.1:0/4178992231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 msgr2=0x556c90cc4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe83259c640 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cc4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe83259c640 1 -- 172.21.15.1:0/4178992231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c90bdf130 con 0x556c90cc52f0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe832d9d640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 0x7fe8200a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0096c0 tx=0x7fe82c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe83259c640 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe8240039f0 tx=0x7fe824003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33dea8efef2919 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe828ff9640 1 -- 172.21.15.1:0/4178992231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824004b20 con 0x556c90cc52f0 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe828ff9640 1 -- 172.21.15.1:0/4178992231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe824004cc0 con 0x556c90cc52f0 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.931+0000 7fe828ff9640 1 -- 172.21.15.1:0/4178992231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8240126b0 con 0x556c90cc52f0 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4178992231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 msgr2=0x556c90ccf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe8240039f0 tx=0x7fe824003eb0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4178992231 shutdown_connections 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ccf670 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90cd1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4178992231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cc4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4178992231 >> 172.21.15.1:0/4178992231 conn(0x556c90cc0f60 msgr2=0x556c90cc1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4178992231 shutdown_connections 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4178992231 wait complete. 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 -- start start 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.932+0000 7fe83b3a3740 1 Processor -- start 2024-09-12T02:31:16.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ccc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90cccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c90cd2780 con 0x556c90cc49d0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556c90be5f20 con 0x556c90ccfbb0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c90cd2900 con 0x556c90cc52f0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 10 client.0 _ll_register_callbacks cb 0x556c90baf030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49930/0 (socket says 172.21.15.1:49930) 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 -- 172.21.15.1:0/1907995750 learned_addr learned my addr 172.21.15.1:0/1907995750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe831d9b640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ccc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe832d9d640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90cccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 -- 172.21.15.1:0/1907995750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 msgr2=0x556c90ccc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ccc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 -- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 msgr2=0x556c90cccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90cccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 -- 172.21.15.1:0/1907995750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9099c2b0 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe831d9b640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ccc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83259c640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe824009cd0 tx=0x7fe824009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13c6f3c6867841a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824005280 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe824004cc0 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe824005420 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe824005620 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.933+0000 7fe83b3a3740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c90cde050 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe824004cc0 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe82400f040 con 0x556c90cc49d0 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 10 client.15408 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 20 client.15408 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90ce04e0 0x556c90ce1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 4 client.15408 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c90c38600 con 0x556c90ce04e0 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.934+0000 7fe831d9b640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90ce04e0 0x556c90ce1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.935+0000 7fe831d9b640 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90ce04e0 0x556c90ce1950 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89057cb26a67bb31 server_cookie=41cb0833e9e40378 in_seq=0 out_seq=0 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.935+0000 7fe819ffb640 10 client.15408 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.935+0000 7fe819ffb640 1 -- 172.21.15.1:0/1907995750 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c90c38600 con 0x556c90ce04e0 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.935+0000 7fe819ffb640 10 client.15408 handle_command_reply: tid=0 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 client.15408 shutdown 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 msgr2=0x556c90ccf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe824009cd0 tx=0x7fe824009d00 comp rx=0 tx=0).stop 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 shutdown_connections 2024-09-12T02:31:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90ce04e0 0x556c90ce1950 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90cccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ccc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe819ffb640 0 client.15408 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/1907995750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ccf3a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 >> 172.21.15.1:0/1907995750 conn(0x556c90cc0f60 msgr2=0x556c90cc6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 shutdown_connections 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 1 -- 172.21.15.1:0/1907995750 wait complete. 2024-09-12T02:31:16.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.936+0000 7fe83b3a3740 20 client.15408 trim_cache size 0 max 16384 2024-09-12T02:31:16.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 Processor -- start 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 -- start start 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cdfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90ce9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c90cdfc90 con 0x556c90cc52f0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556c90ce0360 con 0x556c90cc49d0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.954+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c90ce0a30 con 0x556c90ccfbb0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49946/0 (socket says 172.21.15.1:49946) 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 -- 172.21.15.1:0/4110913835 learned_addr learned my addr 172.21.15.1:0/4110913835 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe832d9d640 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90ce9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe83259c640 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cdfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 -- 172.21.15.1:0/4110913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 msgr2=0x556c90ce9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90ce9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 -- 172.21.15.1:0/4110913835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 msgr2=0x556c90cdfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cdfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 -- 172.21.15.1:0/4110913835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c90cc5120 con 0x556c90cc52f0 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe831d9b640 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0970d0 tx=0x7fe81c0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac0f3ec1898f55f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe81bfff640 1 -- 172.21.15.1:0/4110913835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c01e040 con 0x556c90cc52f0 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe81bfff640 1 -- 172.21.15.1:0/4110913835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe81c0cbf70 con 0x556c90cc52f0 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.955+0000 7fe81bfff640 1 -- 172.21.15.1:0/4110913835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c09a0c0 con 0x556c90cc52f0 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4110913835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 msgr2=0x556c90ce1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0970d0 tx=0x7fe81c0d0040 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4110913835 shutdown_connections 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc52f0 0x556c90ce1950 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90ccfbb0 0x556c90ce9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/4110913835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90cc49d0 0x556c90cdfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4110913835 >> 172.21.15.1:0/4110913835 conn(0x556c90cc0f60 msgr2=0x556c90cdf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4110913835 shutdown_connections 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- 172.21.15.1:0/4110913835 wait complete. 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 -- start start 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.956+0000 7fe83b3a3740 1 Processor -- start 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ce5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90d48be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c90ce17d0 con 0x556c90cc49d0 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556c90ce1100 con 0x556c90ccfbb0 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c90ce1ea0 con 0x556c90cc52f0 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83b3a3740 10 client.0 _ll_register_callbacks cb 0x7fe82c032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49948/0 (socket says 172.21.15.1:49948) 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 -- 172.21.15.1:0/3220229297 learned_addr learned my addr 172.21.15.1:0/3220229297 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe832d9d640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90d48be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ce5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 -- 172.21.15.1:0/3220229297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 msgr2=0x556c90ce5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ce5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 -- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 msgr2=0x556c90d48be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90d48be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 -- 172.21.15.1:0/3220229297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c90d49120 con 0x556c90cc49d0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe83259c640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe824004940 tx=0x7fe8240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614e1ef69a6ec2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.957+0000 7fe819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824009680 con 0x556c90cc49d0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe824005a50 con 0x556c90cc49d0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe81c0cbf70 con 0x556c90cc49d0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8240057c0 con 0x556c90cc49d0 2024-09-12T02:31:16.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 10 client.15414 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c90d4a260 con 0x556c90cc49d0 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe81c0cbf70 con 0x556c90cc49d0 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe824011bb0 con 0x556c90cc49d0 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 10 client.15414 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 10 client.15414 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 20 client.15414 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90d4ed20 0x556c90d4da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 4 client.15414 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "status"}) -- 0x556c90c32b10 con 0x556c90d4ed20 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.958+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90d4ed20 0x556c90d4da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe831d9b640 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90d4ed20 0x556c90d4da30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f7e6617c8c82ce5 server_cookie=ce9316997b187941 in_seq=0 out_seq=0 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe819ffb640 10 client.15414 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe819ffb640 1 -- 172.21.15.1:0/3220229297 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556c90c32b10 con 0x556c90d4ed20 2024-09-12T02:31:16.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe819ffb640 10 client.15414 handle_command_reply: tid=0 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 client.15414 shutdown 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 msgr2=0x556c90ce4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe824004940 tx=0x7fe8240047c0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 shutdown_connections 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x556c90d4ed20 0x556c90d4da30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556c90ccfbb0 0x556c90d48be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c90cc52f0 0x556c90ce5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 --2- 172.21.15.1:0/3220229297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c90cc49d0 0x556c90ce4e30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 >> 172.21.15.1:0/3220229297 conn(0x556c90cc0f60 msgr2=0x556c90cbf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe819ffb640 0 client.15414 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 shutdown_connections 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.959+0000 7fe83b3a3740 1 -- 172.21.15.1:0/3220229297 wait complete. 2024-09-12T02:31:16.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe83b3a3740 20 client.15414 trim_cache size 0 max 16384 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24470, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 134.949060608, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 28, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:31:16.971 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 166.68845720300001 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 msgr2=0x7fe8200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 0x7fe8200a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0096c0 tx=0x7fe82c009260 comp rx=0 tx=0).stop 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 msgr2=0x7fe83419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00b4a0 tx=0x7fe81c00b960 comp rx=0 tx=0).stop 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 shutdown_connections 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe8200a2b80 0x7fe8200a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe834102790 0x7fe83419abd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe834106f10 0x7fe83419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 --2- 172.21.15.1:0/3300989692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe834101de0 0x7fe83419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 >> 172.21.15.1:0/3300989692 conn(0x7fe8340fd8c0 msgr2=0x7fe8340fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 shutdown_connections 2024-09-12T02:31:16.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:16.960+0000 7fe838fca640 1 -- 172.21.15.1:0/3300989692 wait complete. 2024-09-12T02:31:17.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:31:17.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:17 smithi001 ceph-mon[31252]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-12T02:31:17.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:17 smithi134 ceph-mon[35091]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-12T02:31:17.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:17 smithi173 ceph-mon[35036]: pgmap v353: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-12T02:31:17.974 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 -- 172.21.15.1:0/3155264507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c102570 msgr2=0x7f607c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 --2- 172.21.15.1:0/3155264507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c102570 0x7f607c1029b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f606c009900 tx=0x7f606c02a480 comp rx=0 tx=0).stop 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 -- 172.21.15.1:0/3155264507 shutdown_connections 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 --2- 172.21.15.1:0/3155264507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c102570 0x7f607c1029b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 --2- 172.21.15.1:0/3155264507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 0x7f607c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 --2- 172.21.15.1:0/3155264507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c100e20 0x7f607c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 -- 172.21.15.1:0/3155264507 >> 172.21.15.1:0/3155264507 conn(0x7f607c0fc7d0 msgr2=0x7f607c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 -- 172.21.15.1:0/3155264507 shutdown_connections 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.484+0000 7f6083d60640 1 -- 172.21.15.1:0/3155264507 wait complete. 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 Processor -- start 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 -- start start 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c102570 0x7f607c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 0x7f607c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110f80 con 0x7f607c100e20 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110e00 con 0x7f607c102570 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6083d60640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f607c111100 con 0x7f607c102ef0 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6081afc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6081afc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49962/0 (socket says 172.21.15.1:49962) 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f6081afc640 1 -- 172.21.15.1:0/2481356597 learned_addr learned my addr 172.21.15.1:0/2481356597 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f60812fb640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c102570 0x7f607c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.485+0000 7f60822fd640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 0x7f607c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 -- 172.21.15.1:0/2481356597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 msgr2=0x7f607c19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 0x7f607c19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 -- 172.21.15.1:0/2481356597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c102570 msgr2=0x7f607c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c102570 0x7f607c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 -- 172.21.15.1:0/2481356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c19f700 con 0x7f607c100e20 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6081afc640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f607800d950 tx=0x7f607800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6072ffd640 1 -- 172.21.15.1:0/2481356597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078017070 con 0x7f607c100e20 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c19f9f0 con 0x7f607c100e20 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6072ffd640 1 -- 172.21.15.1:0/2481356597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078009c30 con 0x7f607c100e20 2024-09-12T02:31:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6072ffd640 1 -- 172.21.15.1:0/2481356597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607800f6b0 con 0x7f607c100e20 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.486+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c1a72d0 con 0x7f607c100e20 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.488+0000 7f6072ffd640 1 -- 172.21.15.1:0/2481356597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f60780109d0 con 0x7f607c100e20 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.488+0000 7f6086139740 1 Processor -- start 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 -- start start 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9dbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e36f935090 con 0x55e36f9ce9d0 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e36f8dca70 con 0x55e36f9cf2f0 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6086139740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e36f931050 con 0x55e36f9d9bb0 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49976/0 (socket says 172.21.15.1:49976) 2024-09-12T02:31:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 -- 172.21.15.1:0/507237603 learned_addr learned my addr 172.21.15.1:0/507237603 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60812fb640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9dbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f6081afc640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 -- 172.21.15.1:0/507237603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 msgr2=0x55e36f9dbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9dbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 -- 172.21.15.1:0/507237603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 msgr2=0x55e36f9d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.489+0000 7f60822fd640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f60822fd640 1 -- 172.21.15.1:0/507237603 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e36f8e9130 con 0x55e36f9ce9d0 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6072ffd640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 0x7f60680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f60812fb640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9dbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6081afc640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6081afc640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 0x7f60680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f60822fd640 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6074009f50 tx=0x7f60740118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707509dee5e3b30f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6072ffd640 1 -- 172.21.15.1:0/2481356597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f60780cec40 con 0x7f607c100e20 2024-09-12T02:31:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6067fff640 1 -- 172.21.15.1:0/507237603 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074004d20 con 0x55e36f9ce9d0 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6067fff640 1 -- 172.21.15.1:0/507237603 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074004050 con 0x55e36f9ce9d0 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.490+0000 7f6067fff640 1 -- 172.21.15.1:0/507237603 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074005260 con 0x55e36f9ce9d0 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- 172.21.15.1:0/507237603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 msgr2=0x55e36f9cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6074009f50 tx=0x7f60740118d0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6081afc640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 0x7f60680a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60780cca90 tx=0x7f607800bf60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- 172.21.15.1:0/507237603 shutdown_connections 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9dbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 --2- 172.21.15.1:0/507237603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9cedb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- 172.21.15.1:0/507237603 >> 172.21.15.1:0/507237603 conn(0x55e36f9caf60 msgr2=0x55e36f9cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- 172.21.15.1:0/507237603 shutdown_connections 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- 172.21.15.1:0/507237603 wait complete. 2024-09-12T02:31:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 -- start start 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.491+0000 7f6086139740 1 Processor -- start 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9dc780 con 0x55e36f9ce9d0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e36f8eff20 con 0x55e36f9cf2f0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9dc900 con 0x55e36f9d9bb0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f6086139740 10 client.0 _ll_register_callbacks cb 0x55e36f8b9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49982/0 (socket says 172.21.15.1:49982) 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 -- 172.21.15.1:0/1382557401 learned_addr learned my addr 172.21.15.1:0/1382557401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60812fb640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 -- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 msgr2=0x55e36f9d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 -- 172.21.15.1:0/1382557401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 msgr2=0x55e36f9d6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 -- 172.21.15.1:0/1382557401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e36f6a62b0 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60812fb640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60822fd640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6074011dd0 tx=0x7f6074009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25f088cd11777 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.492+0000 7f60657fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607402b020 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6074025870 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6074004050 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6074025a70 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 10 client.15426 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e36f9e8060 con 0x55e36f9ce9d0 2024-09-12T02:31:18.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074004050 con 0x55e36f9ce9d0 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f607400f480 con 0x55e36f9ce9d0 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 10 client.15426 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 20 client.15426 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36f9ea410 0x55e36f9eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 4 client.15426 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.493+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e36f942600 con 0x55e36f9ea410 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.494+0000 7f60812fb640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36f9ea410 0x55e36f9eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.494+0000 7f60812fb640 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36f9ea410 0x55e36f9eb880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebe3324d726df700 server_cookie=a0eb74d600dbfa1d in_seq=0 out_seq=0 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.494+0000 7f60657fa640 10 client.15426 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f60657fa640 1 -- 172.21.15.1:0/1382557401 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e36f942600 con 0x55e36f9ea410 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f60657fa640 10 client.15426 handle_command_reply: tid=0 2024-09-12T02:31:18.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 client.15426 shutdown 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 msgr2=0x55e36f9d94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6074011dd0 tx=0x7f6074009d20 comp rx=0 tx=0).stop 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 shutdown_connections 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36f9ea410 0x55e36f9eb880 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 --2- 172.21.15.1:0/1382557401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9d94b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f60657fa640 0 client.15426 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 >> 172.21.15.1:0/1382557401 conn(0x55e36f9caf60 msgr2=0x55e36f9d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 shutdown_connections 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.495+0000 7f6086139740 1 -- 172.21.15.1:0/1382557401 wait complete. 2024-09-12T02:31:18.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.496+0000 7f6086139740 20 client.15426 trim_cache size 0 max 16384 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 Processor -- start 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 -- start start 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9e9bc0 con 0x55e36f9ce9d0 2024-09-12T02:31:18.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9ea290 con 0x55e36f9cf2f0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f6086139740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9ea960 con 0x55e36f9d9bb0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49984/0 (socket says 172.21.15.1:49984) 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f60822fd640 1 -- 172.21.15.1:0/1840948064 learned_addr learned my addr 172.21.15.1:0/1840948064 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.514+0000 7f60812fb640 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 -- 172.21.15.1:0/1840948064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 msgr2=0x55e36f9c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 -- 172.21.15.1:0/1840948064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 msgr2=0x55e36f9d6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 -- 172.21.15.1:0/1840948064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e36f9d7340 con 0x55e36f9ce9d0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60822fd640 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f80 tx=0x7f6074004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd0a153ece0624e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60677fe640 1 -- 172.21.15.1:0/1840948064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607402b040 con 0x55e36f9ce9d0 2024-09-12T02:31:18.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60677fe640 1 -- 172.21.15.1:0/1840948064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074004000 con 0x55e36f9ce9d0 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.515+0000 7f60677fe640 1 -- 172.21.15.1:0/1840948064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60740258d0 con 0x55e36f9ce9d0 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- 172.21.15.1:0/1840948064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 msgr2=0x55e36f9eaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f80 tx=0x7f6074004410 comp rx=0 tx=0).stop 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- 172.21.15.1:0/1840948064 shutdown_connections 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9d9bb0 0x55e36f9c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9cf2f0 0x55e36f9d6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 --2- 172.21.15.1:0/1840948064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9eaae0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- 172.21.15.1:0/1840948064 >> 172.21.15.1:0/1840948064 conn(0x55e36f9caf60 msgr2=0x55e36f9c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- 172.21.15.1:0/1840948064 shutdown_connections 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- 172.21.15.1:0/1840948064 wait complete. 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.516+0000 7f6086139740 1 -- start start 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 Processor -- start 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 0x55e36f9ef480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9d9bb0 0x55e36f9ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9eb700 con 0x55e36f9ce9d0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9eb030 con 0x55e36f9d9bb0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e36f9ebdd0 con 0x55e36f9cf2f0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f6086139740 10 client.0 _ll_register_callbacks cb 0x7f6074009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f60822fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49992/0 (socket says 172.21.15.1:49992) 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.517+0000 7f60822fd640 1 -- 172.21.15.1:0/1093951194 learned_addr learned my addr 172.21.15.1:0/1093951194 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9d9bb0 0x55e36f9ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60812fb640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 0x55e36f9ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 -- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 msgr2=0x55e36f9ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 0x55e36f9ef480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 -- 172.21.15.1:0/1093951194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9d9bb0 msgr2=0x55e36f9ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9d9bb0 0x55e36f9ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 -- 172.21.15.1:0/1093951194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e36f9ce800 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60812fb640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 0x55e36f9ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60822fd640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6074025fd0 tx=0x7f6074025df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1f890e5040768d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60657fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607402b070 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f607400f480 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6074004000 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6074049070 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f6086139740 10 client.15432 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.518+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e36fa54810 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074004000 con 0x55e36f9ce9d0 2024-09-12T02:31:18.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6074027800 con 0x55e36f9ce9d0 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 10 client.15432 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 10 client.15432 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 20 client.15432 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36fa58f30 0x55e36fa57c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 4 client.15432 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "status"}) -- 0x55e36f93cb10 con 0x55e36fa58f30 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.519+0000 7f60812fb640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36fa58f30 0x55e36fa57c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f60812fb640 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36fa58f30 0x55e36fa57c40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7f253aaacdf7a4e server_cookie=cd4f8a2b0cb55484 in_seq=0 out_seq=0 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f60657fa640 10 client.15432 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f60657fa640 1 -- 172.21.15.1:0/1093951194 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e36f93cb10 con 0x55e36fa58f30 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f60657fa640 10 client.15432 handle_command_reply: tid=0 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 client.15432 shutdown 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 msgr2=0x55e36f9f4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6074025fd0 tx=0x7f6074025df0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 shutdown_connections 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55e36fa58f30 0x55e36fa57c40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e36f9d9bb0 0x55e36f9ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e36f9cf2f0 0x55e36f9ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f60657fa640 0 client.15432 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 --2- 172.21.15.1:0/1093951194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e36f9ce9d0 0x55e36f9f4150 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 >> 172.21.15.1:0/1093951194 conn(0x55e36f9caf60 msgr2=0x55e36f9ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 shutdown_connections 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 1 -- 172.21.15.1:0/1093951194 wait complete. 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.520+0000 7f6086139740 20 client.15432 trim_cache size 0 max 16384 2024-09-12T02:31:18.531 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24475, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 137.51738900999999, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 28, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 165.67007867500001 2024-09-12T02:31:18.532 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:18.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 msgr2=0x7f60680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 0x7f60680a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60780cca90 tx=0x7f607800bf60 comp rx=0 tx=0).stop 2024-09-12T02:31:18.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 msgr2=0x7f607c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f607800d950 tx=0x7f607800de10 comp rx=0 tx=0).stop 2024-09-12T02:31:18.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 shutdown_connections 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f60680a2b80 0x7f60680a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607c102ef0 0x7f607c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c102570 0x7f607c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 --2- 172.21.15.1:0/2481356597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f607c100e20 0x7f607c19a750 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 >> 172.21.15.1:0/2481356597 conn(0x7f607c0fc7d0 msgr2=0x7f607c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 shutdown_connections 2024-09-12T02:31:18.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:18.521+0000 7f6083d60640 1 -- 172.21.15.1:0/2481356597 wait complete. 2024-09-12T02:31:19.244 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:31:19.509 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:19.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:19 smithi001 ceph-mon[31252]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T02:31:19.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:19 smithi134 ceph-mon[35091]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T02:31:19.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:19 smithi173 ceph-mon[35036]: pgmap v354: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T02:31:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/549724878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc106a80 msgr2=0x7f9fdc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/549724878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc106a80 0x7f9fdc106e60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009930 tx=0x7f9fd802a420 comp rx=0 tx=0).stop 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/549724878 shutdown_connections 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/549724878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fdc101420 0x7f9fdc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/549724878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc100a80 0x7f9fdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/549724878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc106a80 0x7f9fdc106e60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.020+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/549724878 >> 172.21.15.1:0/549724878 conn(0x7f9fdc0fc7a0 msgr2=0x7f9fdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/549724878 shutdown_connections 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/549724878 wait complete. 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 Processor -- start 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 -- start start 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fdc101420 0x7f9fdc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.021+0000 7f9fe3eb2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 0x7f9fdc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe3eb2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc110e40 con 0x7f9fdc100a80 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe3eb2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc110cc0 con 0x7f9fdc101420 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe3eb2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc110fc0 con 0x7f9fdc106a80 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50014/0 (socket says 172.21.15.1:50014) 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/120333223 learned_addr learned my addr 172.21.15.1:0/120333223 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe244f640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 0x7f9fdc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/120333223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 msgr2=0x7f9fdc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 0x7f9fdc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/120333223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fdc101420 msgr2=0x7f9fdc198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fdc101420 0x7f9fdc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/120333223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc19d3f0 con 0x7f9fdc100a80 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe244f640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 0x7f9fdc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009230 tx=0x7f9fd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fd2ffd640 1 -- 172.21.15.1:0/120333223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd803f030 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fd2ffd640 1 -- 172.21.15.1:0/120333223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd8003ad0 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc19d680 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fd2ffd640 1 -- 172.21.15.1:0/120333223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8035070 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.022+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc1a4fc0 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fd2ffd640 1 -- 172.21.15.1:0/120333223 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9fd8042030 con 0x7f9fdc100a80 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 Processor -- start 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 -- start start 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5608cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d5617fc0 0x55a6d561a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6d556f090 con 0x55a6d56091f0 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5516a70 con 0x55a6d56088d0 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fe628b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a6d556b050 con 0x55a6d5617fc0 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.025+0000 7f9fd2ffd640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 0x7f9fc80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50024/0 (socket says 172.21.15.1:50024) 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe244f640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 0x7f9fc80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/43090466 learned_addr learned my addr 172.21.15.1:0/43090466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe144d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d5617fc0 0x55a6d561a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe244f640 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5608cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fd2ffd640 1 -- 172.21.15.1:0/120333223 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9fd80ef600 con 0x7f9fdc100a80 2024-09-12T02:31:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/43090466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d5617fc0 msgr2=0x55a6d561a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d5617fc0 0x55a6d561a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/43090466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 msgr2=0x55a6d5608cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5608cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 -- 172.21.15.1:0/43090466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6d5523130 con 0x55a6d56091f0 2024-09-12T02:31:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe244f640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 0x7f9fc80a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005c40 tx=0x7f9fd4009cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80b8250 tx=0x7f9fd8047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd014c3a6c655b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fc7fff640 1 -- 172.21.15.1:0/43090466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8049070 con 0x55a6d56091f0 2024-09-12T02:31:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fc7fff640 1 -- 172.21.15.1:0/43090466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80d00c0 con 0x55a6d56091f0 2024-09-12T02:31:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.026+0000 7f9fc7fff640 1 -- 172.21.15.1:0/43090466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8003c80 con 0x55a6d56091f0 2024-09-12T02:31:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 -- 172.21.15.1:0/43090466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 msgr2=0x55a6d5617a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80b8250 tx=0x7f9fd8047000 comp rx=0 tx=0).stop 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 -- 172.21.15.1:0/43090466 shutdown_connections 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5617a80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d5617fc0 0x55a6d561a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 --2- 172.21.15.1:0/43090466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5608cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 -- 172.21.15.1:0/43090466 >> 172.21.15.1:0/43090466 conn(0x55a6d5604f60 msgr2=0x55a6d5605340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 -- 172.21.15.1:0/43090466 shutdown_connections 2024-09-12T02:31:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.027+0000 7f9fe628b740 1 -- 172.21.15.1:0/43090466 wait complete. 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 -- start start 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 Processor -- start 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5617940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56091f0 0x55a6d5614c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6d561a9b0 con 0x55a6d5617fc0 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5529f20 con 0x55a6d56088d0 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a6d561ab30 con 0x55a6d56091f0 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe628b740 10 client.0 _ll_register_callbacks cb 0x55a6d54f3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe244f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe244f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50034/0 (socket says 172.21.15.1:50034) 2024-09-12T02:31:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.028+0000 7f9fe244f640 1 -- 172.21.15.1:0/1958144726 learned_addr learned my addr 172.21.15.1:0/1958144726 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe144d640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56091f0 0x55a6d5614c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5617940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 -- 172.21.15.1:0/1958144726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56091f0 msgr2=0x55a6d5614c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56091f0 0x55a6d5614c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 -- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 msgr2=0x55a6d5617940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5617940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 -- 172.21.15.1:0/1958144726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6d52e02b0 con 0x55a6d5617fc0 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5617940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe244f640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4011c50 tx=0x7f9fd4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ca2f230c92ef55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4011e90 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9fd40283f0 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd80d00c0 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9fd40285f0 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe628b740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6d56262d0 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.029+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80d00c0 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9fd400f050 con 0x55a6d5617fc0 2024-09-12T02:31:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 10 client.15444 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 20 client.15444 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d56289a0 0x55a6d5629e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 4 client.15444 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6d557c600 con 0x55a6d56289a0 2024-09-12T02:31:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d56289a0 0x55a6d5629e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fc57fa640 10 client.15444 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.030+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d56289a0 0x55a6d5629e10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519ff1b1f0eb4dc7 server_cookie=23d68bf3a5a2b6f2 in_seq=0 out_seq=0 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.031+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1958144726 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6d557c600 con 0x55a6d56289a0 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.031+0000 7f9fc57fa640 10 client.15444 handle_command_reply: tid=0 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.031+0000 7f9fe628b740 1 client.15444 shutdown 2024-09-12T02:31:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 msgr2=0x55a6d5615210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4011c50 tx=0x7f9fd4005bd0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 shutdown_connections 2024-09-12T02:31:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d5617fc0 0x55a6d5615210 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d56289a0 0x55a6d5629e10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56091f0 0x55a6d5614c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1958144726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d56088d0 0x55a6d5617940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fc57fa640 0 client.15444 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 >> 172.21.15.1:0/1958144726 conn(0x55a6d5604f60 msgr2=0x55a6d560acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 shutdown_connections 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 1 -- 172.21.15.1:0/1958144726 wait complete. 2024-09-12T02:31:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.032+0000 7f9fe628b740 20 client.15444 trim_cache size 0 max 16384 2024-09-12T02:31:20.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 Processor -- start 2024-09-12T02:31:20.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 -- start start 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5629e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56239a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5628150 con 0x55a6d56091f0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5628820 con 0x55a6d5617fc0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.050+0000 7f9fe628b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5628ef0 con 0x55a6d56088d0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50040/0 (socket says 172.21.15.1:50040) 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 -- 172.21.15.1:0/2276554133 learned_addr learned my addr 172.21.15.1:0/2276554133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5629e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe244f640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 -- 172.21.15.1:0/2276554133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 msgr2=0x55a6d5629e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5629e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 -- 172.21.15.1:0/2276554133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 msgr2=0x55a6d56239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56239a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 -- 172.21.15.1:0/2276554133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6d5617cb0 con 0x55a6d56091f0 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5629e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fe144d640 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00ab40 tx=0x7f9fcc011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e5132db908cdd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fc77fe640 1 -- 172.21.15.1:0/2276554133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc01e070 con 0x55a6d56091f0 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fc77fe640 1 -- 172.21.15.1:0/2276554133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fcc00fd40 con 0x55a6d56091f0 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.051+0000 7f9fc77fe640 1 -- 172.21.15.1:0/2276554133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00e3b0 con 0x55a6d56091f0 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 -- 172.21.15.1:0/2276554133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 msgr2=0x55a6d5614550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00ab40 tx=0x7f9fcc011440 comp rx=0 tx=0).stop 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 -- 172.21.15.1:0/2276554133 shutdown_connections 2024-09-12T02:31:20.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5614550 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56239a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 --2- 172.21.15.1:0/2276554133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5629e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 -- 172.21.15.1:0/2276554133 >> 172.21.15.1:0/2276554133 conn(0x55a6d5604f60 msgr2=0x55a6d5605340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 -- 172.21.15.1:0/2276554133 shutdown_connections 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.052+0000 7f9fe628b740 1 -- 172.21.15.1:0/2276554133 wait complete. 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 -- start start 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 Processor -- start 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5630a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a6d5629c90 con 0x55a6d56091f0 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6d56295c0 con 0x55a6d5617fc0 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a6d562a360 con 0x55a6d56088d0 2024-09-12T02:31:20.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe628b740 10 client.0 _ll_register_callbacks cb 0x7f9fd4014f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe144d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe144d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50046/0 (socket says 172.21.15.1:50046) 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.053+0000 7f9fe144d640 1 -- 172.21.15.1:0/1296750076 learned_addr learned my addr 172.21.15.1:0/1296750076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5630a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe244f640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 -- 172.21.15.1:0/1296750076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 msgr2=0x55a6d5630a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5630a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 -- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 msgr2=0x55a6d56314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56314b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 -- 172.21.15.1:0/1296750076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6d562b1c0 con 0x55a6d56091f0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe144d640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc000c00 tx=0x7f9fcc00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc3e654ad80e577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc029070 con 0x55a6d56091f0 2024-09-12T02:31:20.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9fcc00f860 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fcc00fd40 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9fcc034050 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe628b740 10 client.15450 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6d562fc50 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.054+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fcc00fd40 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9fcc018030 con 0x55a6d56091f0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 10 client.15450 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 20 client.15450 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d5696e90 0x55a6d5695ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 4 client.15450 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "status"}) -- 0x55a6d5576b10 con 0x55a6d5696e90 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d5696e90 0x55a6d5695ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fe1c4e640 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d5696e90 0x55a6d5695ba0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24df78818343c30e server_cookie=9dc0be543b1eaf49 in_seq=0 out_seq=0 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.055+0000 7f9fc57fa640 10 client.15450 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fc57fa640 1 -- 172.21.15.1:0/1296750076 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a6d5576b10 con 0x55a6d5696e90 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fc57fa640 10 client.15450 handle_command_reply: tid=0 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 client.15450 shutdown 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 msgr2=0x55a6d5630f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc000c00 tx=0x7f9fcc00ff70 comp rx=0 tx=0).stop 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 shutdown_connections 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a6d56091f0 0x55a6d5630f70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a6d5696e90 0x55a6d5695ba0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6d5617fc0 0x55a6d56314b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 --2- 172.21.15.1:0/1296750076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a6d56088d0 0x55a6d5630a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fc57fa640 0 client.15450 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:20.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 >> 172.21.15.1:0/1296750076 conn(0x55a6d5604f60 msgr2=0x55a6d5614c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 shutdown_connections 2024-09-12T02:31:20.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 1 -- 172.21.15.1:0/1296750076 wait complete. 2024-09-12T02:31:20.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.056+0000 7f9fe628b740 20 client.15450 trim_cache size 0 max 16384 2024-09-12T02:31:20.066 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "877143dc-70ad-11ef-bcea-c7b262605968", 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24494, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 146.58325315499999, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 28, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 82, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 158.105293684 2024-09-12T02:31:20.067 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:20.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 msgr2=0x7f9fc80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 0x7f9fc80a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005c40 tx=0x7f9fd4009cd0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 msgr2=0x7f9fdc198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009230 tx=0x7f9fd8004270 comp rx=0 tx=0).stop 2024-09-12T02:31:20.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 shutdown_connections 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9fc80a2b80 0x7f9fc80a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fdc106a80 0x7f9fdc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fdc101420 0x7f9fdc198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 --2- 172.21.15.1:0/120333223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fdc100a80 0x7f9fdc198440 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 >> 172.21.15.1:0/120333223 conn(0x7f9fdc0fc7a0 msgr2=0x7f9fdc06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 shutdown_connections 2024-09-12T02:31:20.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:20.057+0000 7f9fe3eb2640 1 -- 172.21.15.1:0/120333223 wait complete. 2024-09-12T02:31:20.822 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T02:31:21.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:21 smithi001 ceph-mon[31252]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T02:31:21.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:21 smithi134 ceph-mon[35091]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T02:31:21.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:21 smithi173 ceph-mon[35036]: pgmap v355: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T02:31:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 -- 172.21.15.1:0/2586400433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 msgr2=0x7f6e6c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2586400433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c1020b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009900 tx=0x7f6e5c02a410 comp rx=0 tx=0).stop 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 -- 172.21.15.1:0/2586400433 shutdown_connections 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2586400433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c1020b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2586400433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2586400433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 -- 172.21.15.1:0/2586400433 >> 172.21.15.1:0/2586400433 conn(0x7f6e6c0fc1e0 msgr2=0x7f6e6c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 -- 172.21.15.1:0/2586400433 shutdown_connections 2024-09-12T02:31:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.730+0000 7f6e740f1640 1 -- 172.21.15.1:0/2586400433 wait complete. 2024-09-12T02:31:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 Processor -- start 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 -- start start 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c19f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c10c790 con 0x7f6e6c101c30 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c10c610 con 0x7f6e6c100a40 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e740f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c10c910 con 0x7f6e6c1025f0 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e7168c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e7168c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33120/0 (socket says 172.21.15.1:33120) 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e7168c640 1 -- 172.21.15.1:0/2128430767 learned_addr learned my addr 172.21.15.1:0/2128430767 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.731+0000 7f6e7268e640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c19f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 -- 172.21.15.1:0/2128430767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 msgr2=0x7f6e6c19f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c19f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 -- 172.21.15.1:0/2128430767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 msgr2=0x7f6e6c06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 -- 172.21.15.1:0/2128430767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c19fa10 con 0x7f6e6c101c30 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7268e640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c19f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e7168c640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c02aa00 tx=0x7f6e5c032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e62ffd640 1 -- 172.21.15.1:0/2128430767 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c03f030 con 0x7f6e6c101c30 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e62ffd640 1 -- 172.21.15.1:0/2128430767 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5c003ce0 con 0x7f6e6c101c30 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c19fca0 con 0x7f6e6c101c30 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e62ffd640 1 -- 172.21.15.1:0/2128430767 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c035070 con 0x7f6e6c101c30 2024-09-12T02:31:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.732+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c1a0210 con 0x7f6e6c101c30 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.734+0000 7f6e62ffd640 1 -- 172.21.15.1:0/2128430767 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6e5c042030 con 0x7f6e6c101c30 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 Processor -- start 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 -- start start 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c4b2332f0 con 0x559c4b2d02e0 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559c4b1db270 con 0x559c4b2d5370 2024-09-12T02:31:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e76e91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c4b22f2b0 con 0x559c4b2cf9a0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e71e8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e71e8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33134/0 (socket says 172.21.15.1:33134) 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.735+0000 7f6e71e8d640 1 -- 172.21.15.1:0/3024930914 learned_addr learned my addr 172.21.15.1:0/3024930914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e7268e640 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e7168c640 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e62ffd640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 0x7f6e580a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 -- 172.21.15.1:0/3024930914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 msgr2=0x559c4b2cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 -- 172.21.15.1:0/3024930914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 msgr2=0x559c4b2d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 -- 172.21.15.1:0/3024930914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4b1da340 con 0x559c4b2d02e0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e7268e640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 0x7f6e580a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e62ffd640 1 -- 172.21.15.1:0/2128430767 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6e5c0ef4b0 con 0x7f6e6c101c30 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800a9d0 tx=0x7f6e6800ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c2a903a6c3668c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e57fff640 1 -- 172.21.15.1:0/3024930914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68015070 con 0x559c4b2d02e0 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e57fff640 1 -- 172.21.15.1:0/3024930914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e6800cc60 con 0x559c4b2d02e0 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e57fff640 1 -- 172.21.15.1:0/3024930914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680185c0 con 0x559c4b2d02e0 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.736+0000 7f6e7268e640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 0x7f6e580a5170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e64004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 -- 172.21.15.1:0/3024930914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 msgr2=0x559c4b2d4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800a9d0 tx=0x7f6e6800ae90 comp rx=0 tx=0).stop 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 -- 172.21.15.1:0/3024930914 shutdown_connections 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b2d4da0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3024930914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 -- 172.21.15.1:0/3024930914 >> 172.21.15.1:0/3024930914 conn(0x559c4b2cb010 msgr2=0x559c4b2cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 -- 172.21.15.1:0/3024930914 shutdown_connections 2024-09-12T02:31:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.737+0000 7f6e76e91740 1 -- 172.21.15.1:0/3024930914 wait complete. 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 -- start start 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 Processor -- start 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d02e0 0x559c4b2da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559c4b2d8340 con 0x559c4b2cf9a0 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559c4b1bc290 con 0x559c4b2d5370 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c4b2d84c0 con 0x559c4b2d02e0 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e76e91740 10 client.0 _ll_register_callbacks cb 0x559c4b1ed140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e71e8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e71e8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33142/0 (socket says 172.21.15.1:33142) 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e71e8d640 1 -- 172.21.15.1:0/1471192469 learned_addr learned my addr 172.21.15.1:0/1471192469 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.738+0000 7f6e7168c640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d02e0 0x559c4b2da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e7268e640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 -- 172.21.15.1:0/1471192469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d02e0 msgr2=0x559c4b2da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d02e0 0x559c4b2da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 -- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 msgr2=0x559c4b2e10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2e10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 -- 172.21.15.1:0/1471192469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4af46210 con 0x559c4b2cf9a0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e7268e640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2e10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf00c0b29902bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e557fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68020070 con 0x559c4b2cf9a0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6e6801a650 con 0x559c4b2cf9a0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e6800cc60 con 0x559c4b2cf9a0 2024-09-12T02:31:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e68015040 con 0x559c4b2cf9a0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e76e91740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.739+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559c4b012620 con 0x559c4b2cf9a0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e6800cc60 con 0x559c4b2cf9a0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e6802e8a0 con 0x559c4b2cf9a0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 20 client.15462 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b2e54a0 0x559c4b2e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 4 client.15462 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c4b240a20 con 0x559c4b2e54a0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.740+0000 7f6e7168c640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b2e54a0 0x559c4b2e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.741+0000 7f6e557fa640 10 client.15462 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.741+0000 7f6e7168c640 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b2e54a0 0x559c4b2e7890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fdf9b274308c453 server_cookie=805f65ed6cbe0cba in_seq=0 out_seq=0 2024-09-12T02:31:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.741+0000 7f6e557fa640 1 -- 172.21.15.1:0/1471192469 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c4b240a20 con 0x559c4b2e54a0 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.741+0000 7f6e557fa640 10 client.15462 handle_command_reply: tid=0 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.741+0000 7f6e76e91740 1 client.15462 shutdown 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 msgr2=0x559c4b2d9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68011a10 comp rx=0 tx=0).stop 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 shutdown_connections 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b2e54a0 0x559c4b2e7890 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d5370 0x559c4b2e10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d02e0 0x559c4b2da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 --2- 172.21.15.1:0/1471192469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2cf9a0 0x559c4b2d9b60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e557fa640 0 client.15462 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 >> 172.21.15.1:0/1471192469 conn(0x559c4b2cb010 msgr2=0x559c4b2cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 shutdown_connections 2024-09-12T02:31:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 1 -- 172.21.15.1:0/1471192469 wait complete. 2024-09-12T02:31:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.742+0000 7f6e76e91740 20 client.15462 trim_cache size 0 max 16384 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 Processor -- start 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 -- start start 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 0x559c4b2cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1a9070 con 0x559c4b2d5370 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1aabb0 con 0x559c4b2d02e0 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.756+0000 7f6e76e91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1a9740 con 0x559c4b2cf9a0 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33144/0 (socket says 172.21.15.1:33144) 2024-09-12T02:31:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 -- 172.21.15.1:0/3708236635 learned_addr learned my addr 172.21.15.1:0/3708236635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7168c640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 0x559c4b2cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 -- 172.21.15.1:0/3708236635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 msgr2=0x559c4b2cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 -- 172.21.15.1:0/3708236635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 msgr2=0x559c4b2cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 0x559c4b2cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 -- 172.21.15.1:0/3708236635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4b2cae30 con 0x559c4b2d5370 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7168c640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 0x559c4b2cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e7268e640 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6e6401d700 tx=0x7f6e64012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c368c5e499907a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e577fe640 1 -- 172.21.15.1:0/3708236635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011a90 con 0x559c4b2d5370 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e577fe640 1 -- 172.21.15.1:0/3708236635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e64011c30 con 0x559c4b2d5370 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.757+0000 7f6e577fe640 1 -- 172.21.15.1:0/3708236635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6401a7a0 con 0x559c4b2d5370 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- 172.21.15.1:0/3708236635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 msgr2=0x559c4b2cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6e6401d700 tx=0x7f6e64012000 comp rx=0 tx=0).stop 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- 172.21.15.1:0/3708236635 shutdown_connections 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d5370 0x559c4b2cc910 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2d02e0 0x559c4b2cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 --2- 172.21.15.1:0/3708236635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2cf9a0 0x559c4b2cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- 172.21.15.1:0/3708236635 >> 172.21.15.1:0/3708236635 conn(0x559c4b2cb010 msgr2=0x559c4b2d9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- 172.21.15.1:0/3708236635 shutdown_connections 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- 172.21.15.1:0/3708236635 wait complete. 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 -- start start 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.758+0000 7f6e76e91740 1 Processor -- start 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2cf9a0 0x559c4b34bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d5370 0x559c4b353220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1aa4e0 con 0x559c4b2d02e0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1a9e10 con 0x559c4b2cf9a0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1a7050 con 0x559c4b2d5370 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e76e91740 10 client.0 _ll_register_callbacks cb 0x7f6e6800a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33154/0 (socket says 172.21.15.1:33154) 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 -- 172.21.15.1:0/397152678 learned_addr learned my addr 172.21.15.1:0/397152678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7268e640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d5370 0x559c4b353220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2cf9a0 0x559c4b34bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 -- 172.21.15.1:0/397152678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d5370 msgr2=0x559c4b353220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d5370 0x559c4b353220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 -- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2cf9a0 msgr2=0x559c4b34bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2cf9a0 0x559c4b34bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.759+0000 7f6e7168c640 1 -- 172.21.15.1:0/397152678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4b353830 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e7168c640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0bbc20 tx=0x7f6e5c03b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30ac4afa3c66441 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c049040 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6e5c0b8300 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e64011c30 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e5c0bbc90 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559c4b354b20 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e64011c30 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e5c03b5f0 con 0x559c4b2d02e0 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 20 client.15468 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b355480 0x559c4b3578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 4 client.15468 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.760+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c4b23ad70 con 0x559c4b355480 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.761+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b355480 0x559c4b3578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.761+0000 7f6e71e8d640 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b355480 0x559c4b3578a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b5fafbbe0986b43 server_cookie=1946410e41999545 in_seq=0 out_seq=0 2024-09-12T02:31:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.761+0000 7f6e557fa640 10 client.15468 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e557fa640 1 -- 172.21.15.1:0/397152678 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c4b23ad70 con 0x559c4b355480 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e557fa640 10 client.15468 handle_command_reply: tid=0 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 client.15468 shutdown 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 msgr2=0x559c4b34c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0bbc20 tx=0x7f6e5c03b990 comp rx=0 tx=0).stop 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 shutdown_connections 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559c4b2d02e0 0x559c4b34c1e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559c4b355480 0x559c4b3578a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c4b2d5370 0x559c4b353220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 --2- 172.21.15.1:0/397152678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559c4b2cf9a0 0x559c4b34bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e557fa640 0 client.15468 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 >> 172.21.15.1:0/397152678 conn(0x559c4b2cb010 msgr2=0x559c4b2c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 shutdown_connections 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.768+0000 7f6e76e91740 1 -- 172.21.15.1:0/397152678 wait complete. 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e76e91740 20 client.15468 trim_cache size 0 max 16384 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:31:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:31:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 msgr2=0x7f6e580a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 0x7f6e580a5170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e64004a40 comp rx=0 tx=0).stop 2024-09-12T02:31:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 msgr2=0x7f6e6c19cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c02aa00 tx=0x7f6e5c032da0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 shutdown_connections 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f6e580a2cb0 0x7f6e580a5170 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e6c101c30 0x7f6e6c19cb00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6c1025f0 0x7f6e6c19f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 --2- 172.21.15.1:0/2128430767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c100a40 0x7f6e6c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 >> 172.21.15.1:0/2128430767 conn(0x7f6e6c0fc1e0 msgr2=0x7f6e6c104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 shutdown_connections 2024-09-12T02:31:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:22.769+0000 7f6e740f1640 1 -- 172.21.15.1:0/2128430767 wait complete. 2024-09-12T02:31:23.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:23 smithi001 ceph-mon[31252]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:31:23.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:23 smithi134 ceph-mon[35091]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:31:23.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:23 smithi173 ceph-mon[35036]: pgmap v356: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T02:31:25.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:25 smithi001 ceph-mon[31252]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-12T02:31:25.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:25 smithi134 ceph-mon[35091]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-12T02:31:25.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:25 smithi173 ceph-mon[35036]: pgmap v357: 97 pgs: 97 active+clean; 660 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-12T02:31:27.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:27 smithi001 ceph-mon[31252]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:27.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:27 smithi134 ceph-mon[35091]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:27.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:27 smithi173 ceph-mon[35036]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-12T02:31:29.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:29 smithi001 ceph-mon[31252]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:29.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:29 smithi134 ceph-mon[35091]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:29.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:29 smithi173 ceph-mon[35036]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:31.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:31:31.846 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:31.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:31 smithi001 ceph-mon[31252]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T02:31:31.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:31 smithi134 ceph-mon[35091]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T02:31:31.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:31 smithi173 ceph-mon[35036]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T02:31:32.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 -- 172.21.15.1:0/1288643021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818102570 msgr2=0x7ff8181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1288643021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818102570 0x7ff8181029b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff808009900 tx=0x7ff80802a480 comp rx=0 tx=0).stop 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 -- 172.21.15.1:0/1288643021 shutdown_connections 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1288643021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818102570 0x7ff8181029b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1288643021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff81810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1288643021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818100e20 0x7ff818101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.374+0000 7ff81f30e640 1 -- 172.21.15.1:0/1288643021 >> 172.21.15.1:0/1288643021 conn(0x7ff8180fc7d0 msgr2=0x7ff8180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.375+0000 7ff81f30e640 1 -- 172.21.15.1:0/1288643021 shutdown_connections 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.375+0000 7ff81f30e640 1 -- 172.21.15.1:0/1288643021 wait complete. 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.375+0000 7ff81f30e640 1 Processor -- start 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.375+0000 7ff81f30e640 1 -- start start 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818102570 0x7ff818199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff8181a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff818110f80 con 0x7ff818100e20 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff818110e00 con 0x7ff818102ef0 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81f30e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff818111100 con 0x7ff818102570 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35760/0 (socket says 172.21.15.1:35760) 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 -- 172.21.15.1:0/1643742885 learned_addr learned my addr 172.21.15.1:0/1643742885 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818102570 0x7ff818199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 -- 172.21.15.1:0/1643742885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818102570 msgr2=0x7ff818199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818102570 0x7ff818199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 -- 172.21.15.1:0/1643742885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 msgr2=0x7ff8181a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff8181a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff8181a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d0aa640 1 -- 172.21.15.1:0/1643742885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8181a48d0 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.376+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff8181a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff81d0aa640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff81400d770 tx=0x7ff81400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff80e7fc640 1 -- 172.21.15.1:0/1643742885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814017070 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8181a4aa0 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff80e7fc640 1 -- 172.21.15.1:0/1643742885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff814005500 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8181a4fb0 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.377+0000 7ff80e7fc640 1 -- 172.21.15.1:0/1643742885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814004e00 con 0x7ff818100e20 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 Processor -- start 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 -- start start 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf55dc0 0x5603acf60140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf62a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5603acebb2e0 con 0x5603acf554a0 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5603ace62ce0 con 0x5603acf55dc0 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.380+0000 7ff8216e7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603aceb72a0 con 0x5603acf60680 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35768/0 (socket says 172.21.15.1:35768) 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1340600818 learned_addr learned my addr 172.21.15.1:0/1340600818 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf62a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1340600818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 msgr2=0x5603acf62a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf62a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1340600818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf55dc0 msgr2=0x5603acf60140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:32.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf55dc0 0x5603acf60140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1340600818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ace47440 con 0x5603acf554a0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff810009ea0 tx=0x7ff810009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2af573de06a756 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff80e7fc640 1 -- 172.21.15.1:0/1643742885 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff814004fa0 con 0x7ff818100e20 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.381+0000 7ff8037fe640 1 -- 172.21.15.1:0/1340600818 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810016070 con 0x5603acf554a0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff8037fe640 1 -- 172.21.15.1:0/1340600818 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff81000ee80 con 0x5603acf554a0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff8037fe640 1 -- 172.21.15.1:0/1340600818 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810011690 con 0x5603acf554a0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff80e7fc640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 0x7ff8040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff8216e7740 1 -- 172.21.15.1:0/1340600818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 msgr2=0x5603acf55880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff810009ea0 tx=0x7ff810009f90 comp rx=0 tx=0).stop 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.382+0000 7ff80e7fc640 1 -- 172.21.15.1:0/1643742885 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff8140ceaa0 con 0x7ff818100e20 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff81d0aa640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 0x7ff8040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 -- 172.21.15.1:0/1340600818 shutdown_connections 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf62a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf55dc0 0x5603acf60140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1340600818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf55880 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 -- 172.21.15.1:0/1340600818 >> 172.21.15.1:0/1340600818 conn(0x5603acf51a30 msgr2=0x5603acf51e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 -- 172.21.15.1:0/1340600818 shutdown_connections 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 -- 172.21.15.1:0/1340600818 wait complete. 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff81d0aa640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 0x7ff8040a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff814097cb0 tx=0x7ff8140bb040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 -- start start 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.383+0000 7ff8216e7740 1 Processor -- start 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf60020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf5d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5603acf63250 con 0x5603acf60680 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5603ace76050 con 0x5603acf554a0 2024-09-12T02:31:32.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603acf633d0 con 0x5603acf55dc0 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff8216e7740 10 client.0 _ll_register_callbacks cb 0x5603aceb6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff81c8a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf5d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35778/0 (socket says 172.21.15.1:35778) 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1044070410 learned_addr learned my addr 172.21.15.1:0/1044070410 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.384+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf60020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1044070410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 msgr2=0x5603acf5d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf5d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 msgr2=0x5603acf60020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf60020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 -- 172.21.15.1:0/1044070410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603acc2c3c0 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff810005aa0 tx=0x7ff8100059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8afe32f441c7966 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff800ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810016040 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff810028440 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603acec8850 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff810028640 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.385+0000 7ff8216e7740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603acf6ec60 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5603acec8850 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff810026020 con 0x5603acf60680 2024-09-12T02:31:32.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 20 client.15480 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acf70120 0x5603acf72510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 4 client.15480 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.386+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603acec2d60 con 0x5603acf70120 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.387+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acf70120 0x5603acf72510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.387+0000 7ff800ff9640 10 client.15480 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.387+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acf70120 0x5603acf72510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f2da68b3f7e907 server_cookie=15152f13ef372f0f in_seq=0 out_seq=0 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff800ff9640 1 -- 172.21.15.1:0/1044070410 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603acec2d60 con 0x5603acf70120 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff800ff9640 10 client.15480 handle_command_reply: tid=0 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 client.15480 shutdown 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 msgr2=0x5603acf5d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff810005aa0 tx=0x7ff8100059a0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 shutdown_connections 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf60680 0x5603acf5d870 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acf70120 0x5603acf72510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf5d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 --2- 172.21.15.1:0/1044070410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf60020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 >> 172.21.15.1:0/1044070410 conn(0x5603acf51a30 msgr2=0x5603acf57760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff800ff9640 0 client.15480 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 shutdown_connections 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 1 -- 172.21.15.1:0/1044070410 wait complete. 2024-09-12T02:31:32.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.388+0000 7ff8216e7740 20 client.15480 trim_cache size 0 max 16384 2024-09-12T02:31:32.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.406+0000 7ff8216e7740 1 Processor -- start 2024-09-12T02:31:32.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.406+0000 7ff8216e7740 1 -- start start 2024-09-12T02:31:32.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf6c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf77bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181ad740 con 0x5603acf55dc0 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181af280 con 0x5603acf554a0 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff8216e7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181ade10 con 0x5603acf60680 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35794/0 (socket says 172.21.15.1:35794) 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 -- 172.21.15.1:0/4265540813 learned_addr learned my addr 172.21.15.1:0/4265540813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf6c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf77bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 -- 172.21.15.1:0/4265540813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 msgr2=0x5603acf77bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf77bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 -- 172.21.15.1:0/4265540813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 msgr2=0x5603acf6c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf6c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 -- 172.21.15.1:0/4265540813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603acf60390 con 0x5603acf55dc0 2024-09-12T02:31:32.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf77bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:32.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.407+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff80802a9a0 tx=0x7ff8080045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b57ec12e56c62e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.408+0000 7ff802ffd640 1 -- 172.21.15.1:0/4265540813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808035040 con 0x5603acf55dc0 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.408+0000 7ff802ffd640 1 -- 172.21.15.1:0/4265540813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff808005500 con 0x5603acf55dc0 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.408+0000 7ff802ffd640 1 -- 172.21.15.1:0/4265540813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808003910 con 0x5603acf55dc0 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.408+0000 7ff8216e7740 1 -- 172.21.15.1:0/4265540813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 msgr2=0x5603acf50a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.408+0000 7ff8216e7740 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff80802a9a0 tx=0x7ff8080045c0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 -- 172.21.15.1:0/4265540813 shutdown_connections 2024-09-12T02:31:32.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf55dc0 0x5603acf50a60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf60680 0x5603acf77bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 --2- 172.21.15.1:0/4265540813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf554a0 0x5603acf6c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 -- 172.21.15.1:0/4265540813 >> 172.21.15.1:0/4265540813 conn(0x5603acf51a30 msgr2=0x5603acf50350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 -- 172.21.15.1:0/4265540813 shutdown_connections 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 -- 172.21.15.1:0/4265540813 wait complete. 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 -- start start 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.409+0000 7ff8216e7740 1 Processor -- start 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf68b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf60680 0x5603acfd4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181aebb0 con 0x5603acf554a0 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181ae4e0 con 0x5603acf60680 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8181ab720 con 0x5603acf55dc0 2024-09-12T02:31:32.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff8216e7740 10 client.0 _ll_register_callbacks cb 0x7ff808005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35798/0 (socket says 172.21.15.1:35798) 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 -- 172.21.15.1:0/3192433125 learned_addr learned my addr 172.21.15.1:0/3192433125 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf68b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf60680 0x5603acfd4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 -- 172.21.15.1:0/3192433125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 msgr2=0x5603acf68b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf68b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 -- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf60680 msgr2=0x5603acfd4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf60680 0x5603acfd4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 -- 172.21.15.1:0/3192433125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603acf5b130 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff81d8ab640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff810009c60 tx=0x7ff810005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6d501187947525 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.410+0000 7ff800ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810016040 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff810032ca0 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff808005500 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff810032ea0 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff8216e7740 10 client.15486 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603acfe3ad0 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.411+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff808005500 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff81003f070 con 0x5603acf554a0 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:32.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 20 client.15486 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acfe4130 0x5603acfe6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 4 client.15486 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603ace3f210 con 0x5603acfe4130 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acfe4130 0x5603acfe6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff800ff9640 10 client.15486 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.412+0000 7ff81c8a9640 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acfe4130 0x5603acfe6520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa6dbfd88d100bb server_cookie=22c52714effeb8b in_seq=0 out_seq=0 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff800ff9640 1 -- 172.21.15.1:0/3192433125 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5603ace3f210 con 0x5603acfe4130 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff800ff9640 10 client.15486 handle_command_reply: tid=0 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 client.15486 shutdown 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 msgr2=0x5603acf68620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff810009c60 tx=0x7ff810005900 comp rx=0 tx=0).stop 2024-09-12T02:31:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 shutdown_connections 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5603acfe4130 0x5603acfe6520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603acf60680 0x5603acfd4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603acf55dc0 0x5603acf68b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 --2- 172.21.15.1:0/3192433125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603acf554a0 0x5603acf68620 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff800ff9640 0 client.15486 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 >> 172.21.15.1:0/3192433125 conn(0x5603acf51a30 msgr2=0x5603acf50350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 shutdown_connections 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 1 -- 172.21.15.1:0/3192433125 wait complete. 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.413+0000 7ff8216e7740 20 client.15486 trim_cache size 0 max 16384 2024-09-12T02:31:32.417 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:32.418 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-12T02:31:32.418 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-12T02:31:32.418 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:32.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 msgr2=0x7ff8040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 0x7ff8040a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff814097cb0 tx=0x7ff8140bb040 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 msgr2=0x7ff818199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff81400d770 tx=0x7ff81400dc30 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 shutdown_connections 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff8040a2b80 0x7ff8040a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff818102ef0 0x7ff8181a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff818102570 0x7ff818199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 --2- 172.21.15.1:0/1643742885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff818100e20 0x7ff818199310 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.414+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 >> 172.21.15.1:0/1643742885 conn(0x7ff8180fc7d0 msgr2=0x7ff8180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.415+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 shutdown_connections 2024-09-12T02:31:32.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:32.415+0000 7ff81f30e640 1 -- 172.21.15.1:0/1643742885 wait complete. 2024-09-12T02:31:33.170 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:31:33.171 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:33.453 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:33.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:33 smithi001 ceph-mon[31252]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:33.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:33 smithi134 ceph-mon[35091]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:33.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:33 smithi173 ceph-mon[35036]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 -- 172.21.15.1:0/3824887159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc101e10 msgr2=0x7f05fc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 --2- 172.21.15.1:0/3824887159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc101e10 0x7f05fc1021f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009900 tx=0x7f05ec02a410 comp rx=0 tx=0).stop 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 -- 172.21.15.1:0/3824887159 shutdown_connections 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 --2- 172.21.15.1:0/3824887159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 0x7f05fc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 --2- 172.21.15.1:0/3824887159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc1027c0 0x7f05fc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 --2- 172.21.15.1:0/3824887159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc101e10 0x7f05fc1021f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 -- 172.21.15.1:0/3824887159 >> 172.21.15.1:0/3824887159 conn(0x7f05fc0fd8d0 msgr2=0x7f05fc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 -- 172.21.15.1:0/3824887159 shutdown_connections 2024-09-12T02:31:33.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.968+0000 7f0601092640 1 -- 172.21.15.1:0/3824887159 wait complete. 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 Processor -- start 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 -- start start 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 0x7f05fc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 0x7f05fc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc111f60 con 0x7f05fc1027c0 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc111de0 con 0x7f05fc106f40 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.969+0000 7f0601092640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05fc1120e0 con 0x7f05fc101e10 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35818/0 (socket says 172.21.15.1:35818) 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 -- 172.21.15.1:0/147266745 learned_addr learned my addr 172.21.15.1:0/147266745 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fb59e640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 0x7f05fc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fad9d640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 0x7f05fc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 -- 172.21.15.1:0/147266745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 msgr2=0x7f05fc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 0x7f05fc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 -- 172.21.15.1:0/147266745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 msgr2=0x7f05fc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 0x7f05fc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 -- 172.21.15.1:0/147266745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05fc19d410 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fad9d640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 0x7f05fc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05fa59c640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c890 tx=0x7f05f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0004220 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05fc19d700 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f00043c0 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.970+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0004a00 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.971+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05fc1a4fe0 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.972+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05fc1021f0 con 0x7f05fc1027c0 2024-09-12T02:31:33.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.973+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f05f00079b0 con 0x7f05fc1027c0 2024-09-12T02:31:33.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.974+0000 7f05e3fff640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 0x7f05e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.974+0000 7f05fad9d640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 0x7f05e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.974+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f05f00cf140 con 0x7f05fc1027c0 2024-09-12T02:31:33.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.974+0000 7f05fad9d640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 0x7f05e40a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005ab0 tx=0x7f05ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:33.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:33.977+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05f0014030 con 0x7f05fc1027c0 2024-09-12T02:31:34.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.223+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05fc1997c0 con 0x7f05fc1027c0 2024-09-12T02:31:34.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.224+0000 7f05e3fff640 1 -- 172.21.15.1:0/147266745 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f05fc1997c0 con 0x7f05fc1027c0 2024-09-12T02:31:34.224 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:34.224 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 msgr2=0x7f05e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 0x7f05e40a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f05ec005ab0 tx=0x7f05ec005a20 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 msgr2=0x7f05fc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f05f000c890 tx=0x7f05f000cd50 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 shutdown_connections 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f05e40a2b80 0x7f05e40a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05fc1027c0 0x7f05fc1989a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05fc106f40 0x7f05fc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 --2- 172.21.15.1:0/147266745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05fc101e10 0x7f05fc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 >> 172.21.15.1:0/147266745 conn(0x7f05fc0fd8d0 msgr2=0x7f05fc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 shutdown_connections 2024-09-12T02:31:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:34.226+0000 7f0601092640 1 -- 172.21.15.1:0/147266745 wait complete. 2024-09-12T02:31:34.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:34 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/147266745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:34.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:34 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/147266745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:34.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:34 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/147266745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:35.822 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T02:31:35.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 -- 172.21.15.1:0/1382337380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c41025d0 msgr2=0x7f19c41049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 --2- 172.21.15.1:0/1382337380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c41025d0 0x7f19c41049c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009900 tx=0x7f19b402a410 comp rx=0 tx=0).stop 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 -- 172.21.15.1:0/1382337380 shutdown_connections 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 --2- 172.21.15.1:0/1382337380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4107830 0x7f19c4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 --2- 172.21.15.1:0/1382337380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c4104f00 0x7f19c41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 --2- 172.21.15.1:0/1382337380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c41025d0 0x7f19c41049c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 -- 172.21.15.1:0/1382337380 >> 172.21.15.1:0/1382337380 conn(0x7f19c40fc1b0 msgr2=0x7f19c40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 -- 172.21.15.1:0/1382337380 shutdown_connections 2024-09-12T02:31:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.863+0000 7f19ca427640 1 -- 172.21.15.1:0/1382337380 wait complete. 2024-09-12T02:31:35.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.864+0000 7f19ca427640 1 Processor -- start 2024-09-12T02:31:35.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.864+0000 7f19ca427640 1 -- start start 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.864+0000 7f19ca427640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.864+0000 7f19ca427640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 0x7f19c4100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19ca427640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19ca427640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19c410d830 con 0x7f19c4107830 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19ca427640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c410d6b0 con 0x7f19c4104f00 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19ca427640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19c410d9b0 con 0x7f19c41025d0 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:57296/0 (socket says 172.21.15.1:57296) 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35842/0 (socket says 172.21.15.1:35842) 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c3fff640 1 -- 172.21.15.1:0/1758066631 learned_addr learned my addr 172.21.15.1:0/1758066631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c37fe640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 0x7f19c4100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 -- 172.21.15.1:0/1758066631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 msgr2=0x7f19c4101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 -- 172.21.15.1:0/1758066631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 msgr2=0x7f19c4100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 0x7f19c4100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 -- 172.21.15.1:0/1758066631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c4101350 con 0x7f19c4107830 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c3fff640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c37fe640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 0x7f19c4100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.865+0000 7f19c89c4640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19bc005fd0 tx=0x7f19bc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.866+0000 7f19c17fa640 1 -- 172.21.15.1:0/1758066631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00cdf0 con 0x7f19c4107830 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.866+0000 7f19c17fa640 1 -- 172.21.15.1:0/1758066631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19bc005020 con 0x7f19c4107830 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.866+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c41a1f80 con 0x7f19c4107830 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.866+0000 7f19c17fa640 1 -- 172.21.15.1:0/1758066631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0106d0 con 0x7f19c4107830 2024-09-12T02:31:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.866+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c41a2390 con 0x7f19c4107830 2024-09-12T02:31:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 Processor -- start 2024-09-12T02:31:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19c17fa640 1 -- 172.21.15.1:0/1758066631 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f19bc0054d0 con 0x7f19c4107830 2024-09-12T02:31:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 -- start start 2024-09-12T02:31:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e52e0 0x5632965e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965ec830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5632965482f0 con 0x5632965e49a0 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5632964f0270 con 0x5632965ea370 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5632965442b0 con 0x5632965e52e0 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35852/0 (socket says 172.21.15.1:35852) 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.869+0000 7f19c37fe640 1 -- 172.21.15.1:0/2140454503 learned_addr learned my addr 172.21.15.1:0/2140454503 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c3fff640 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e52e0 0x5632965e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 -- 172.21.15.1:0/2140454503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e52e0 msgr2=0x5632965e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e52e0 0x5632965e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 -- 172.21.15.1:0/2140454503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 msgr2=0x5632965ec830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965ec830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 -- 172.21.15.1:0/2140454503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632964ef340 con 0x5632965e49a0 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c17fa640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 0x7f19ac0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c37fe640 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009fd0 tx=0x7f19b80139f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7467eed9d54658aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c3fff640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 0x7f19ac0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19c17fa640 1 -- 172.21.15.1:0/1758066631 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f19bc0cf740 con 0x7f19c4107830 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19aa7fc640 1 -- 172.21.15.1:0/2140454503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b8004030 con 0x5632965e49a0 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19aa7fc640 1 -- 172.21.15.1:0/2140454503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b8017070 con 0x5632965e49a0 2024-09-12T02:31:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.870+0000 7f19aa7fc640 1 -- 172.21.15.1:0/2140454503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b800f810 con 0x5632965e49a0 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 -- 172.21.15.1:0/2140454503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 msgr2=0x5632965e4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19c3fff640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 0x7f19ac0a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19b4031440 tx=0x7f19b40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009fd0 tx=0x7f19b80139f0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 -- 172.21.15.1:0/2140454503 shutdown_connections 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965ec830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e52e0 0x5632965e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/2140454503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e4da0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 -- 172.21.15.1:0/2140454503 >> 172.21.15.1:0/2140454503 conn(0x5632965e0010 msgr2=0x5632965e0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 -- 172.21.15.1:0/2140454503 shutdown_connections 2024-09-12T02:31:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.871+0000 7f19cd1c5740 1 -- 172.21.15.1:0/2140454503 wait complete. 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 -- start start 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 Processor -- start 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e49a0 0x5632965eec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5632965ed340 con 0x5632965e52e0 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5632964d1290 con 0x5632965ea370 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5632965ed4c0 con 0x5632965e49a0 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.872+0000 7f19cd1c5740 10 client.0 _ll_register_callbacks cb 0x563296502140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35866/0 (socket says 172.21.15.1:35866) 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 -- 172.21.15.1:0/249771141 learned_addr learned my addr 172.21.15.1:0/249771141 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c3fff640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e49a0 0x5632965eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c89c4640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 -- 172.21.15.1:0/249771141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e49a0 msgr2=0x5632965eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e49a0 0x5632965eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 -- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 msgr2=0x5632965f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 -- 172.21.15.1:0/249771141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56329625b210 con 0x5632965e52e0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19c37fe640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f19b8003b80 tx=0x7f19b8003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c342595464e7270e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b80041b0 con 0x5632965e52e0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f19b8004350 con 0x5632965e52e0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.873+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19b8017070 con 0x5632965e52e0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19b802b050 con 0x5632965e52e0 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563296327620 con 0x5632965e52e0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b8017070 con 0x5632965e52e0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19b8004c70 con 0x5632965e52e0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 20 client.15504 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5632965fa5c0 0x5632965fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 4 client.15504 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563296555a20 con 0x5632965fa5c0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.874+0000 7f19c3fff640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5632965fa5c0 0x5632965fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.875+0000 7f19c3fff640 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5632965fa5c0 0x5632965fc9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d486eb647b45bc server_cookie=5fbd0054e3cf005f in_seq=0 out_seq=0 2024-09-12T02:31:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.875+0000 7f19a37fe640 10 client.15504 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:35.880 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:35 smithi001 ceph-mon[31252]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:35.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19a37fe640 1 -- 172.21.15.1:0/249771141 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563296555a20 con 0x5632965fa5c0 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19a37fe640 10 client.15504 handle_command_reply: tid=0 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 client.15504 shutdown 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 msgr2=0x5632965ef1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f19b8003b80 tx=0x7f19b8003bb0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 shutdown_connections 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e52e0 0x5632965ef1c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5632965fa5c0 0x5632965fc9b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19a37fe640 0 client.15504 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965ea370 0x5632965f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/249771141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965e49a0 0x5632965eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 >> 172.21.15.1:0/249771141 conn(0x5632965e0010 msgr2=0x5632965e1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 shutdown_connections 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 1 -- 172.21.15.1:0/249771141 wait complete. 2024-09-12T02:31:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.876+0000 7f19cd1c5740 20 client.15504 trim_cache size 0 max 16384 2024-09-12T02:31:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 Processor -- start 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 -- start start 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965e1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41ab300 con 0x5632965e49a0 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41ace40 con 0x5632965fa5c0 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41ab9d0 con 0x5632965ea370 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35880/0 (socket says 172.21.15.1:35880) 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.906+0000 7f19c3fff640 1 -- 172.21.15.1:0/240559416 learned_addr learned my addr 172.21.15.1:0/240559416 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c37fe640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c89c4640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 -- 172.21.15.1:0/240559416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 msgr2=0x5632965f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 -- 172.21.15.1:0/240559416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 msgr2=0x5632965e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 -- 172.21.15.1:0/240559416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632965dfe30 con 0x5632965e49a0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c89c4640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19c3fff640 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c0fe38e1e2156c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19a9ffb640 1 -- 172.21.15.1:0/240559416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4042070 con 0x5632965e49a0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19a9ffb640 1 -- 172.21.15.1:0/240559416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b4057070 con 0x5632965e49a0 2024-09-12T02:31:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.907+0000 7f19a9ffb640 1 -- 172.21.15.1:0/240559416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4035040 con 0x5632965e49a0 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 -- 172.21.15.1:0/240559416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 msgr2=0x5632965e0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b403e000 comp rx=0 tx=0).stop 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 -- 172.21.15.1:0/240559416 shutdown_connections 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/240559416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965e0ec0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 -- 172.21.15.1:0/240559416 >> 172.21.15.1:0/240559416 conn(0x5632965e0010 msgr2=0x5632965e6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 -- 172.21.15.1:0/240559416 shutdown_connections 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.908+0000 7f19cd1c5740 1 -- 172.21.15.1:0/240559416 wait complete. 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 -- start start 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 Processor -- start 2024-09-12T02:31:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41ac770 con 0x5632965e49a0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41ac0a0 con 0x5632965fa5c0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41a92e0 con 0x5632965ea370 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19cd1c5740 10 client.0 _ll_register_callbacks cb 0x7f19b8013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35882/0 (socket says 172.21.15.1:35882) 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.909+0000 7f19c3fff640 1 -- 172.21.15.1:0/3269583345 learned_addr learned my addr 172.21.15.1:0/3269583345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c37fe640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c89c4640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 -- 172.21.15.1:0/3269583345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 msgr2=0x5632965f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 -- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 msgr2=0x5632965f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 -- 172.21.15.1:0/3269583345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632965f5800 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19c3fff640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f19b4004450 tx=0x7f19b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb678f0a0a56b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4061070 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f19b4051af0 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19b4057070 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19b406d050 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19cd1c5740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.910+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563296665500 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b4057070 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19b403c680 con 0x5632965e49a0 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 20 client.15510 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563296665e80 0x5632966682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 4 client.15510 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56329654fd70 con 0x563296665e80 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.911+0000 7f19c37fe640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563296665e80 0x5632966682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.912+0000 7f19c37fe640 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563296665e80 0x5632966682a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e823bf4165378db0 server_cookie=d8e0f4f14e61d143 in_seq=0 out_seq=0 2024-09-12T02:31:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.912+0000 7f19a37fe640 10 client.15510 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:35.917 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:35 smithi134 ceph-mon[35091]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.915+0000 7f19a37fe640 1 -- 172.21.15.1:0/3269583345 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56329654fd70 con 0x563296665e80 2024-09-12T02:31:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.915+0000 7f19a37fe640 10 client.15510 handle_command_reply: tid=0 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.915+0000 7f19cd1c5740 1 client.15510 shutdown 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 msgr2=0x5632965f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f19b4004450 tx=0x7f19b4009260 comp rx=0 tx=0).stop 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 shutdown_connections 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563296665e80 0x5632966682a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5632965fa5c0 0x5632965f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19a37fe640 0 client.15510 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5632965ea370 0x5632965f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 --2- 172.21.15.1:0/3269583345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5632965e49a0 0x5632965f3cf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 >> 172.21.15.1:0/3269583345 conn(0x5632965e0010 msgr2=0x5632965e0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 shutdown_connections 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 1 -- 172.21.15.1:0/3269583345 wait complete. 2024-09-12T02:31:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19cd1c5740 20 client.15510 trim_cache size 0 max 16384 2024-09-12T02:31:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:31:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:31:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:31:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 msgr2=0x7f19ac0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 0x7f19ac0a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19b4031440 tx=0x7f19b40315b0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 msgr2=0x7f19c4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.916+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19bc005fd0 tx=0x7f19bc00ef10 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 shutdown_connections 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f19ac0a2c30 0x7f19ac0a50f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19c4107830 0x7f19c4100ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c4104f00 0x7f19c4100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 --2- 172.21.15.1:0/1758066631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19c41025d0 0x7f19c4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 >> 172.21.15.1:0/1758066631 conn(0x7f19c40fc1b0 msgr2=0x7f19c4102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 shutdown_connections 2024-09-12T02:31:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:35.917+0000 7f19ca427640 1 -- 172.21.15.1:0/1758066631 wait complete. 2024-09-12T02:31:35.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:35 smithi173 ceph-mon[35036]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T02:31:37.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T02:31:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:37.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:37 smithi001 ceph-mon[31252]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T02:31:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:37 smithi134 ceph-mon[35091]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T02:31:37.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:37 smithi173 ceph-mon[35036]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 -- 172.21.15.1:0/3903814466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c1036e0 msgr2=0x7f019c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 --2- 172.21.15.1:0/3903814466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c1036e0 0x7f019c107b90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0190009930 tx=0x7f019002a420 comp rx=0 tx=0).stop 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 -- 172.21.15.1:0/3903814466 shutdown_connections 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 --2- 172.21.15.1:0/3903814466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c1036e0 0x7f019c107b90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 --2- 172.21.15.1:0/3903814466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 0x7f019c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 --2- 172.21.15.1:0/3903814466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c102d30 0x7f019c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 -- 172.21.15.1:0/3903814466 >> 172.21.15.1:0/3903814466 conn(0x7f019c0fc7d0 msgr2=0x7f019c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 -- 172.21.15.1:0/3903814466 shutdown_connections 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 -- 172.21.15.1:0/3903814466 wait complete. 2024-09-12T02:31:38.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.158+0000 7f01a2097640 1 Processor -- start 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 -- start start 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 0x7f019c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 0x7f019c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f019c1120a0 con 0x7f019c102d30 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f019c111f20 con 0x7f019c1082a0 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f01a2097640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f019c112220 con 0x7f019c1036e0 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f019b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f019b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35902/0 (socket says 172.21.15.1:35902) 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f019b7fe640 1 -- 172.21.15.1:0/2849107381 learned_addr learned my addr 172.21.15.1:0/2849107381 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f019bfff640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 0x7f019c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.159+0000 7f019affd640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 0x7f019c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:38.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 -- 172.21.15.1:0/2849107381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 msgr2=0x7f019c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 0x7f019c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 -- 172.21.15.1:0/2849107381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 msgr2=0x7f019c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 0x7f019c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 -- 172.21.15.1:0/2849107381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c1a6ac0 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019affd640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 0x7f019c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f019b7fe640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f018c00eb90 tx=0x7f018c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c004d20 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f018c00ee90 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c010830 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c1a6db0 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.160+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c1a7210 con 0x7f019c102d30 2024-09-12T02:31:38.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.161+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c103110 con 0x7f019c102d30 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.163+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f018c005000 con 0x7f019c102d30 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.163+0000 7f0198ff9640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 0x7f01840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.164+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f018c0cf960 con 0x7f019c102d30 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.164+0000 7f019affd640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 0x7f01840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.164+0000 7f019affd640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 0x7f01840a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0190009900 tx=0x7f0190005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:38.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.167+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f018c0541b0 con 0x7f019c102d30 2024-09-12T02:31:38.378 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:38.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.413+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f019c101ec0 con 0x7f019c102d30 2024-09-12T02:31:38.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.414+0000 7f0198ff9640 1 -- 172.21.15.1:0/2849107381 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f018c09c8a0 con 0x7f019c102d30 2024-09-12T02:31:38.415 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:38.415 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:38.415 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:38.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 msgr2=0x7f01840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 0x7f01840a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0190009900 tx=0x7f0190005a20 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 msgr2=0x7f019c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f018c00eb90 tx=0x7f018c00c6a0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 shutdown_connections 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f01840a2b80 0x7f01840a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f019c1082a0 0x7f019c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f019c1036e0 0x7f019c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 --2- 172.21.15.1:0/2849107381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f019c102d30 0x7f019c100990 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 >> 172.21.15.1:0/2849107381 conn(0x7f019c0fc7d0 msgr2=0x7f019c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 shutdown_connections 2024-09-12T02:31:38.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:38.417+0000 7f01a2097640 1 -- 172.21.15.1:0/2849107381 wait complete. 2024-09-12T02:31:38.669 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:38 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2849107381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:38.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:38 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2849107381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:38 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2849107381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 -- 172.21.15.1:0/1255273290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d81036e0 msgr2=0x7fe5d8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/1255273290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d81036e0 0x7fe5d8107b90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009930 tx=0x7fe5c802a420 comp rx=0 tx=0).stop 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 -- 172.21.15.1:0/1255273290 shutdown_connections 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/1255273290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d81036e0 0x7fe5d8107b90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/1255273290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81082a0 0x7fe5d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/1255273290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d8102d30 0x7fe5d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.098+0000 7fe5df4b2640 1 -- 172.21.15.1:0/1255273290 >> 172.21.15.1:0/1255273290 conn(0x7fe5d80fc7d0 msgr2=0x7fe5d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.099+0000 7fe5df4b2640 1 -- 172.21.15.1:0/1255273290 shutdown_connections 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.099+0000 7fe5df4b2640 1 -- 172.21.15.1:0/1255273290 wait complete. 2024-09-12T02:31:39.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.099+0000 7fe5df4b2640 1 Processor -- start 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.099+0000 7fe5df4b2640 1 -- start start 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81036e0 0x7fe5d8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 0x7fe5d819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81120a0 con 0x7fe5d8102d30 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8111f20 con 0x7fe5d81082a0 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5df4b2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d8112220 con 0x7fe5d81036e0 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35920/0 (socket says 172.21.15.1:35920) 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 -- 172.21.15.1:0/3004736676 learned_addr learned my addr 172.21.15.1:0/3004736676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 0x7fe5d819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81036e0 0x7fe5d8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 -- 172.21.15.1:0/3004736676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81036e0 msgr2=0x7fe5d8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81036e0 0x7fe5d8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 -- 172.21.15.1:0/3004736676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 msgr2=0x7fe5d819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 0x7fe5d819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dd24e640 1 -- 172.21.15.1:0/3004736676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d819d5f0 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.100+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 0x7fe5d819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d950 tx=0x7fe5d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5ce7fc640 1 -- 172.21.15.1:0/3004736676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4017070 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5ce7fc640 1 -- 172.21.15.1:0/3004736676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d4009c30 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d819d8e0 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5ce7fc640 1 -- 172.21.15.1:0/3004736676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400f6b0 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.101+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d81a51c0 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.103+0000 7fe5ce7fc640 1 -- 172.21.15.1:0/3004736676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe5d40109d0 con 0x7fe5d8102d30 2024-09-12T02:31:39.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.103+0000 7fe5e188b740 1 Processor -- start 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 -- start start 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c8666b40 0x55b3c8665090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8665a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b3c85cb2f0 con 0x55b3c8674780 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b3c8572cf0 con 0x55b3c8666b40 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5e188b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b3c85c72b0 con 0x55b3c86655d0 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35932/0 (socket says 172.21.15.1:35932) 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5dda4f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c8666b40 0x55b3c8665090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1720978554 learned_addr learned my addr 172.21.15.1:0/1720978554 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8665a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.104+0000 7fe5ce7fc640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 0x7fe5c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1720978554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 msgr2=0x55b3c8665a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8665a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1720978554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c8666b40 msgr2=0x55b3c8665090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c8666b40 0x55b3c8665090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1720978554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c85573a0 con 0x55b3c8674780 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 0x7fe5c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5ce7fc640 1 -- 172.21.15.1:0/3004736676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe5d40ced00 con 0x7fe5d8102d30 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80697d0 tx=0x7fe5c8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07b97db4271fa2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5c37fe640 1 -- 172.21.15.1:0/1720978554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c803f070 con 0x55b3c8674780 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5c37fe640 1 -- 172.21.15.1:0/1720978554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8004030 con 0x55b3c8674780 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.105+0000 7fe5c37fe640 1 -- 172.21.15.1:0/1720978554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8035070 con 0x55b3c8674780 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- 172.21.15.1:0/1720978554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 msgr2=0x55b3c8676b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80697d0 tx=0x7fe5c8005e70 comp rx=0 tx=0).stop 2024-09-12T02:31:39.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 0x7fe5c40a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005fd0 tx=0x7fe5d0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- 172.21.15.1:0/1720978554 shutdown_connections 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8676b70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8665a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1720978554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c8666b40 0x55b3c8665090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- 172.21.15.1:0/1720978554 >> 172.21.15.1:0/1720978554 conn(0x55b3c862e310 msgr2=0x55b3c8661c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- 172.21.15.1:0/1720978554 shutdown_connections 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- 172.21.15.1:0/1720978554 wait complete. 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.106+0000 7fe5e188b740 1 -- start start 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 Processor -- start 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86655d0 0x55b3c8674140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c8674780 0x55b3c86719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b3c8677420 con 0x55b3c8666b40 2024-09-12T02:31:39.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b3c8586060 con 0x55b3c86655d0 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b3c86775a0 con 0x55b3c8674780 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5e188b740 10 client.0 _ll_register_callbacks cb 0x55b3c82d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35946/0 (socket says 172.21.15.1:35946) 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dca4d640 1 -- 172.21.15.1:0/2709840851 learned_addr learned my addr 172.21.15.1:0/2709840851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86655d0 0x55b3c8674140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c8674780 0x55b3c86719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dca4d640 1 -- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c8674780 msgr2=0x55b3c86719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.107+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c8674780 0x55b3c86719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5dca4d640 1 -- 172.21.15.1:0/2709840851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86655d0 msgr2=0x55b3c8674140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86655d0 0x55b3c8674140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5dca4d640 1 -- 172.21.15.1:0/2709840851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c833c3c0 con 0x55b3c8666b40 2024-09-12T02:31:39.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4764647504bda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8035070 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe5c80317b0 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c8004030 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5c803f040 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5e188b740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3c8682e80 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.108+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8004030 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe5c80047e0 con 0x55b3c8666b40 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 10 client.15528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 20 client.15528 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c8684480 0x55b3c86868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 4 client.15528 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3c85d8860 con 0x55b3c8684480 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.109+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c8684480 0x55b3c86868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c8684480 0x55b3c86868e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a15469c1d487491b server_cookie=3b389e27974cef9c in_seq=0 out_seq=0 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5c0ff9640 10 client.15528 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2709840851 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3c85d8860 con 0x55b3c8684480 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5c0ff9640 10 client.15528 handle_command_reply: tid=0 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 client.15528 shutdown 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 msgr2=0x55b3c86713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8009580 comp rx=0 tx=0).stop 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 shutdown_connections 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c8684480 0x55b3c86868e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8666b40 0x55b3c86713f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c8674780 0x55b3c86719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2709840851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86655d0 0x55b3c8674140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5c0ff9640 0 client.15528 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.110+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 >> 172.21.15.1:0/2709840851 conn(0x55b3c862e310 msgr2=0x55b3c8667960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.111+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 shutdown_connections 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.111+0000 7fe5e188b740 1 -- 172.21.15.1:0/2709840851 wait complete. 2024-09-12T02:31:39.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.111+0000 7fe5e188b740 20 client.15528 trim_cache size 0 max 16384 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 Processor -- start 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 -- start start 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c86806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81ab3c0 con 0x55b3c8674780 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81acf00 con 0x55b3c86704e0 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5e188b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81aba90 con 0x55b3c86655d0 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5dca4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35952/0 (socket says 172.21.15.1:35952) 2024-09-12T02:31:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.124+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1473687694 learned_addr learned my addr 172.21.15.1:0/1473687694 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c86806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1473687694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 msgr2=0x55b3c86806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c86806c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1473687694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 msgr2=0x55b3c8675b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 -- 172.21.15.1:0/1473687694 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c8686f60 con 0x55b3c8674780 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c86806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8004b80 tx=0x7fe5c8032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8ed46f0dfe9301 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5c2ffd640 1 -- 172.21.15.1:0/1473687694 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8035070 con 0x55b3c8674780 2024-09-12T02:31:39.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5c2ffd640 1 -- 172.21.15.1:0/1473687694 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c805c020 con 0x55b3c8674780 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.125+0000 7fe5c2ffd640 1 -- 172.21.15.1:0/1473687694 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8031da0 con 0x55b3c8674780 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- 172.21.15.1:0/1473687694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 msgr2=0x55b3c8673360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8004b80 tx=0x7fe5c8032fc0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- 172.21.15.1:0/1473687694 shutdown_connections 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c8673360 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 --2- 172.21.15.1:0/1473687694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c86806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- 172.21.15.1:0/1473687694 >> 172.21.15.1:0/1473687694 conn(0x55b3c862e310 msgr2=0x55b3c8672c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- 172.21.15.1:0/1473687694 shutdown_connections 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- 172.21.15.1:0/1473687694 wait complete. 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 -- start start 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.126+0000 7fe5e188b740 1 Processor -- start 2024-09-12T02:31:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8675840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81ac830 con 0x55b3c8674780 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81ac160 con 0x55b3c86704e0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81a93a0 con 0x55b3c86655d0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5e188b740 10 client.0 _ll_register_callbacks cb 0x7fe5d0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35960/0 (socket says 172.21.15.1:35960) 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 -- 172.21.15.1:0/2604935926 learned_addr learned my addr 172.21.15.1:0/2604935926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8675840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dca4d640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 -- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 msgr2=0x55b3c8675840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8675840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 -- 172.21.15.1:0/2604935926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 msgr2=0x55b3c8675d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.127+0000 7fe5dda4f640 1 -- 172.21.15.1:0/2604935926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c867ad80 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5dda4f640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00108c0 tx=0x7fe5d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf189fe756f480a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d002c060 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe5d001bb00 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c805c020 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5d0010e40 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5e188b740 10 client.15534 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3c86ef490 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.128+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c805c020 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe5d0026070 con 0x55b3c8674780 2024-09-12T02:31:39.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 10 client.15534 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 10 client.15534 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 20 client.15534 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c86efc40 0x55b3c86f2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 4 client.15534 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3c85d2d70 con 0x55b3c86efc40 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c86efc40 0x55b3c86f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5dd24e640 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c86efc40 0x55b3c86f2060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=63f8ec2146cad354 server_cookie=99500e45c8745b0a in_seq=0 out_seq=0 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.129+0000 7fe5c0ff9640 10 client.15534 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5c0ff9640 1 -- 172.21.15.1:0/2604935926 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3c85d2d70 con 0x55b3c86efc40 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5c0ff9640 10 client.15534 handle_command_reply: tid=0 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 client.15534 shutdown 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 msgr2=0x55b3c86762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00108c0 tx=0x7fe5d0004ab0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 shutdown_connections 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55b3c86efc40 0x55b3c86f2060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b3c8674780 0x55b3c86762c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b3c86704e0 0x55b3c8675d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 --2- 172.21.15.1:0/2604935926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b3c86655d0 0x55b3c8675840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 >> 172.21.15.1:0/2604935926 conn(0x55b3c862e310 msgr2=0x55b3c8673470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5c0ff9640 0 client.15534 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 shutdown_connections 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 1 -- 172.21.15.1:0/2604935926 wait complete. 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.130+0000 7fe5e188b740 20 client.15534 trim_cache size 0 max 16384 2024-09-12T02:31:39.142 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:39.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 msgr2=0x7fe5c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 0x7fe5c40a50c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005fd0 tx=0x7fe5d0004a40 comp rx=0 tx=0).stop 2024-09-12T02:31:39.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 msgr2=0x7fe5d8198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:39.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d950 tx=0x7fe5d400de10 comp rx=0 tx=0).stop 2024-09-12T02:31:39.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 shutdown_connections 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fe5c40a2c00 0x7fe5c40a50c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d81082a0 0x7fe5d819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d81036e0 0x7fe5d8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 --2- 172.21.15.1:0/3004736676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d8102d30 0x7fe5d8198640 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 >> 172.21.15.1:0/3004736676 conn(0x7fe5d80fc7d0 msgr2=0x7fe5d8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 shutdown_connections 2024-09-12T02:31:39.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:39.131+0000 7fe5df4b2640 1 -- 172.21.15.1:0/3004736676 wait complete. 2024-09-12T02:31:39.896 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:39 smithi001 ceph-mon[31252]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:31:39.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:39 smithi134 ceph-mon[35091]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:31:39.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T02:31:39.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:39 smithi173 ceph-mon[35036]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:31:40.589 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T02:31:40.589 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T02:31:40.630 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 -- 172.21.15.1:0/4143564861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c102570 msgr2=0x7f708c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 --2- 172.21.15.1:0/4143564861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c102570 0x7f708c1029b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f707c009900 tx=0x7f707c02a480 comp rx=0 tx=0).stop 2024-09-12T02:31:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 -- 172.21.15.1:0/4143564861 shutdown_connections 2024-09-12T02:31:41.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 --2- 172.21.15.1:0/4143564861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c102570 0x7f708c1029b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 --2- 172.21.15.1:0/4143564861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102ef0 0x7f708c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 --2- 172.21.15.1:0/4143564861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c100e20 0x7f708c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 -- 172.21.15.1:0/4143564861 >> 172.21.15.1:0/4143564861 conn(0x7f708c0fc7d0 msgr2=0x7f708c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 -- 172.21.15.1:0/4143564861 shutdown_connections 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 -- 172.21.15.1:0/4143564861 wait complete. 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.167+0000 7f7093150640 1 Processor -- start 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 -- start start 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102570 0x7f708c108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c102ef0 0x7f708c108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f708c110fa0 con 0x7f708c100e20 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f708c110e20 con 0x7f708c102ef0 2024-09-12T02:31:41.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7093150640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f708c111120 con 0x7f708c102570 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51746/0 (socket says 172.21.15.1:51746) 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 -- 172.21.15.1:0/3216593862 learned_addr learned my addr 172.21.15.1:0/3216593862 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f70916ed640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c102ef0 0x7f708c108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7083fff640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102570 0x7f708c108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 -- 172.21.15.1:0/3216593862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102570 msgr2=0x7f708c108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102570 0x7f708c108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 -- 172.21.15.1:0/3216593862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c102ef0 msgr2=0x7f708c108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c102ef0 0x7f708c108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.168+0000 7f7090eec640 1 -- 172.21.15.1:0/3216593862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c1a6a10 con 0x7f708c100e20 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7090eec640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f708800cce0 tx=0x7f708800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7081ffb640 1 -- 172.21.15.1:0/3216593862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088004b20 con 0x7f708c100e20 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7081ffb640 1 -- 172.21.15.1:0/3216593862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7088004cc0 con 0x7f708c100e20 2024-09-12T02:31:41.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c1a6d00 con 0x7f708c100e20 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7081ffb640 1 -- 172.21.15.1:0/3216593862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800f7d0 con 0x7f708c100e20 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.169+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c1a7200 con 0x7f708c100e20 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.171+0000 7f7081ffb640 1 -- 172.21.15.1:0/3216593862 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f708800f970 con 0x7f708c100e20 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.172+0000 7f7081ffb640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 0x7f70740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.172+0000 7f7081ffb640 1 -- 172.21.15.1:0/3216593862 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f70880cf070 con 0x7f708c100e20 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.172+0000 7f7083fff640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 0x7f70740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7083fff640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 0x7f70740a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f707c000c00 tx=0x7f707c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 Processor -- start 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 -- start start 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 0x55e9cc6ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc6542f0 con 0x55e9cc6f9370 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc5fbcf0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.173+0000 7f7095529740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc6502b0 con 0x55e9cc6efb40 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51756/0 (socket says 172.21.15.1:51756) 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 -- 172.21.15.1:0/3636292076 learned_addr learned my addr 172.21.15.1:0/3636292076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7090eec640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 0x55e9cc6ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7083fff640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 -- 172.21.15.1:0/3636292076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 msgr2=0x55e9cc6ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 0x55e9cc6ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 -- 172.21.15.1:0/3636292076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6ee5d0 msgr2=0x55e9cc6eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 -- 172.21.15.1:0/3636292076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9cc5e03a0 con 0x55e9cc6f9370 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7090eec640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 0x55e9cc6ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f70916ed640 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f70840099e0 tx=0x7f7084009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d39199b2a9d5fac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7072ffd640 1 -- 172.21.15.1:0/3636292076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084017070 con 0x55e9cc6f9370 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7072ffd640 1 -- 172.21.15.1:0/3636292076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7084013470 con 0x55e9cc6f9370 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.174+0000 7f7072ffd640 1 -- 172.21.15.1:0/3636292076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084012630 con 0x55e9cc6f9370 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 -- 172.21.15.1:0/3636292076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 msgr2=0x55e9cc6fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f70840099e0 tx=0x7f7084009ea0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 -- 172.21.15.1:0/3636292076 shutdown_connections 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6fb760 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 --2- 172.21.15.1:0/3636292076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6efb40 0x55e9cc6ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 -- 172.21.15.1:0/3636292076 >> 172.21.15.1:0/3636292076 conn(0x55e9cc6b7310 msgr2=0x55e9cc6eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 -- 172.21.15.1:0/3636292076 shutdown_connections 2024-09-12T02:31:41.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.175+0000 7f7095529740 1 -- 172.21.15.1:0/3636292076 wait complete. 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 -- start start 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 Processor -- start 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc6fc070 con 0x55e9cc6f9370 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc60f060 con 0x55e9cc6efb40 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.176+0000 7f7095529740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e9cc6fc1f0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7095529740 10 client.0 _ll_register_callbacks cb 0x55e9cc3628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f70916ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f70916ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51766/0 (socket says 172.21.15.1:51766) 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f70916ed640 1 -- 172.21.15.1:0/1919511238 learned_addr learned my addr 172.21.15.1:0/1919511238 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:41.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7083fff640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 -- 172.21.15.1:0/1919511238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 msgr2=0x55e9cc6f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 -- 172.21.15.1:0/1919511238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 msgr2=0x55e9cc6f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 -- 172.21.15.1:0/1919511238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cc3c53c0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f70916ed640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7090eec640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f8d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f708800ab20 tx=0x7f708809b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a018076f12c2a47e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f706bfff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708801d040 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.177+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7084013470 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f70880860c0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f708800fe60 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 10 client.25081 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9cc707b50 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7084013470 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f708809ad50 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 10 client.25081 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 10 client.25081 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 20 client.25081 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc708f60 0x55e9cc70b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 4 client.25081 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9cc661860 con 0x55e9cc708f60 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.178+0000 7f7083fff640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc708f60 0x55e9cc70b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.179+0000 7f7083fff640 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc708f60 0x55e9cc70b3b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b23865c560643f97 server_cookie=855bbf01ff4590ea in_seq=0 out_seq=0 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.179+0000 7f706bfff640 10 client.25081 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.179+0000 7f706bfff640 1 -- 172.21.15.1:0/1919511238 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9cc661860 con 0x55e9cc708f60 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f706bfff640 10 client.25081 handle_command_reply: tid=0 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 client.25081 shutdown 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 msgr2=0x55e9cc6f8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f8d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f708800ab20 tx=0x7f708809b9c0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 shutdown_connections 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc708f60 0x55e9cc70b3b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 --2- 172.21.15.1:0/1919511238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f8d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f706bfff640 0 client.25081 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:41.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 >> 172.21.15.1:0/1919511238 conn(0x55e9cc6b7310 msgr2=0x55e9cc6f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 shutdown_connections 2024-09-12T02:31:41.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 1 -- 172.21.15.1:0/1919511238 wait complete. 2024-09-12T02:31:41.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.180+0000 7f7095529740 20 client.25081 trim_cache size 0 max 16384 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.196+0000 7f7095529740 1 Processor -- start 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.196+0000 7f7095529740 1 -- start start 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1af8b0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1b13f0 con 0x55e9cc6efb40 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7095529740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1aff80 con 0x55e9cc6f9370 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51768/0 (socket says 172.21.15.1:51768) 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 -- 172.21.15.1:0/336596274 learned_addr learned my addr 172.21.15.1:0/336596274 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f70916ed640 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 -- 172.21.15.1:0/336596274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6f9370 msgr2=0x55e9cc6f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 -- 172.21.15.1:0/336596274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 msgr2=0x55e9cc6e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.197+0000 7f7090eec640 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.198+0000 7f7090eec640 1 -- 172.21.15.1:0/336596274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9cc6f4550 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.198+0000 7f7090eec640 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f70880982d0 tx=0x7f70880a4640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdd943b5ae7fd05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.198+0000 7f70727fc640 1 -- 172.21.15.1:0/336596274 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088080070 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.198+0000 7f70727fc640 1 -- 172.21.15.1:0/336596274 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708809fc00 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.198+0000 7f70727fc640 1 -- 172.21.15.1:0/336596274 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708801d070 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- 172.21.15.1:0/336596274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 msgr2=0x55e9cc6f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f70880982d0 tx=0x7f70880a4640 comp rx=0 tx=0).stop 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- 172.21.15.1:0/336596274 shutdown_connections 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc6e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 --2- 172.21.15.1:0/336596274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc6f58a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- 172.21.15.1:0/336596274 >> 172.21.15.1:0/336596274 conn(0x55e9cc6b7310 msgr2=0x55e9cc6e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- 172.21.15.1:0/336596274 shutdown_connections 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- 172.21.15.1:0/336596274 wait complete. 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.199+0000 7f7095529740 1 -- start start 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 Processor -- start 2024-09-12T02:31:41.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc701bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1b0d20 con 0x55e9cc6f9370 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1b0650 con 0x55e9cc6efb40 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1ad890 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7095529740 10 client.0 _ll_register_callbacks cb 0x7f708809b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7090eec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f70916ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7090eec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:60824/0 (socket says 172.21.15.1:60824) 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7090eec640 1 -- 172.21.15.1:0/632075176 learned_addr learned my addr 172.21.15.1:0/632075176 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.200+0000 7f7083fff640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc701bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 -- 172.21.15.1:0/632075176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 msgr2=0x55e9cc701bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc701bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 -- 172.21.15.1:0/632075176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 msgr2=0x55e9cc6f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 -- 172.21.15.1:0/632075176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cc6f3020 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7083fff640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc701bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7090eec640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f708809b600 tx=0x7f7088004ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a2dc08bfad9825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f706bfff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088080070 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f70880862c0 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.201+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f708809fc00 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70880a9050 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 10 client.25087 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9cc773700 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708809fc00 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7088083020 con 0x55e9cc6ee5d0 2024-09-12T02:31:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 10 client.25087 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 10 client.25087 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 20 client.25087 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc773ae0 0x55e9cc775ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 4 client.25087 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9cc65bd70 con 0x55e9cc773ae0 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.202+0000 7f7083fff640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc773ae0 0x55e9cc775ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7083fff640 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc773ae0 0x55e9cc775ed0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d67bfdecf2cb1a01 server_cookie=f0cf4a27aee16f10 in_seq=0 out_seq=0 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f706bfff640 10 client.25087 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f706bfff640 1 -- 172.21.15.1:0/632075176 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9cc65bd70 con 0x55e9cc773ae0 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f706bfff640 10 client.25087 handle_command_reply: tid=0 2024-09-12T02:31:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 client.25087 shutdown 2024-09-12T02:31:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 msgr2=0x55e9cc701690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f708809b600 tx=0x7f7088004ef0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 shutdown_connections 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55e9cc773ae0 0x55e9cc775ed0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e9cc6f9370 0x55e9cc6f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9cc6efb40 0x55e9cc701bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 --2- 172.21.15.1:0/632075176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e9cc6ee5d0 0x55e9cc701690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.203+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 >> 172.21.15.1:0/632075176 conn(0x55e9cc6b7310 msgr2=0x55e9cc6e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.204+0000 7f706bfff640 0 client.25087 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.204+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 shutdown_connections 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.204+0000 7f7095529740 1 -- 172.21.15.1:0/632075176 wait complete. 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.204+0000 7f7095529740 20 client.25087 trim_cache size 0 max 16384 2024-09-12T02:31:41.210 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 msgr2=0x7f70740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 0x7f70740a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f707c000c00 tx=0x7f707c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 msgr2=0x7f708c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f708800cce0 tx=0x7f708800a620 comp rx=0 tx=0).stop 2024-09-12T02:31:41.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 shutdown_connections 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f70740a2c00 0x7f70740a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f708c102ef0 0x7f708c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f708c102570 0x7f708c108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 --2- 172.21.15.1:0/3216593862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c100e20 0x7f708c107ae0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 >> 172.21.15.1:0/3216593862 conn(0x7f708c0fc7d0 msgr2=0x7f708c103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 shutdown_connections 2024-09-12T02:31:41.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:41.205+0000 7f7093150640 1 -- 172.21.15.1:0/3216593862 wait complete. 2024-09-12T02:31:41.462 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:41.911 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:41 smithi001 ceph-mon[31252]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:31:41.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:41 smithi134 ceph-mon[35091]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:31:41.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:31:41.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:41 smithi173 ceph-mon[35036]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:31:42.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.474+0000 7f9401c31640 1 -- 172.21.15.1:0/4073104281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc1027a0 msgr2=0x7f93fc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.474+0000 7f9401c31640 1 --2- 172.21.15.1:0/4073104281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc1027a0 0x7f93fc1067f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009900 tx=0x7f93f002a410 comp rx=0 tx=0).stop 2024-09-12T02:31:42.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 -- 172.21.15.1:0/4073104281 shutdown_connections 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 --2- 172.21.15.1:0/4073104281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc1027a0 0x7f93fc1067f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 --2- 172.21.15.1:0/4073104281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc106f20 0x7f93fc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 --2- 172.21.15.1:0/4073104281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 -- 172.21.15.1:0/4073104281 >> 172.21.15.1:0/4073104281 conn(0x7f93fc0fd8f0 msgr2=0x7f93fc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 -- 172.21.15.1:0/4073104281 shutdown_connections 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.475+0000 7f9401c31640 1 -- 172.21.15.1:0/4073104281 wait complete. 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 Processor -- start 2024-09-12T02:31:42.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 -- start start 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc1027a0 0x7f93fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 0x7f93fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc111fd0 con 0x7f93fc106f20 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc111e50 con 0x7f93fc101df0 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.476+0000 7f9401c31640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc112150 con 0x7f93fc1027a0 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53408/0 (socket says 172.21.15.1:53408) 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 -- 172.21.15.1:0/1202787568 learned_addr learned my addr 172.21.15.1:0/1202787568 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 0x7f93fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93faffd640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc1027a0 0x7f93fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 -- 172.21.15.1:0/1202787568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc1027a0 msgr2=0x7f93fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc1027a0 0x7f93fc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 -- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 msgr2=0x7f93fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 0x7f93fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 -- 172.21.15.1:0/1202787568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc1a68f0 con 0x7f93fc101df0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fbfff640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 0x7f93fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.477+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00d950 tx=0x7f93ec00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.478+0000 7f93f8ff9640 1 -- 172.21.15.1:0/1202787568 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec017070 con 0x7f93fc101df0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.478+0000 7f93f8ff9640 1 -- 172.21.15.1:0/1202787568 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ec009c30 con 0x7f93fc101df0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.478+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc1a6be0 con 0x7f93fc101df0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.478+0000 7f93f8ff9640 1 -- 172.21.15.1:0/1202787568 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00f6b0 con 0x7f93fc101df0 2024-09-12T02:31:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.478+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1a70f0 con 0x7f93fc101df0 2024-09-12T02:31:42.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.481+0000 7f940400a740 1 Processor -- start 2024-09-12T02:31:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.481+0000 7f93f8ff9640 1 -- 172.21.15.1:0/1202787568 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f93ec0109d0 con 0x7f93fc101df0 2024-09-12T02:31:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.481+0000 7f940400a740 1 -- start start 2024-09-12T02:31:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f940400a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819984b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f940400a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f940400a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56181998f940 0x561819991d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f93f8ff9640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 0x7f93e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f940400a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5618198ea2a0 con 0x561819984760 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.482+0000 7f940400a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561819891b10 con 0x561819985080 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f940400a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5618198e6260 con 0x56181998f940 2024-09-12T02:31:42.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93f8ff9640 1 -- 172.21.15.1:0/1202787568 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f93ec0cec60 con 0x7f93fc101df0 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819984b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53422/0 (socket says 172.21.15.1:53422) 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819984b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51796/0 (socket says 172.21.15.1:51796) 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 -- 172.21.15.1:0/818033990 learned_addr learned my addr 172.21.15.1:0/818033990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93faffd640 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56181998f940 0x561819991d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 -- 172.21.15.1:0/818033990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56181998f940 msgr2=0x561819991d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56181998f940 0x561819991d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 -- 172.21.15.1:0/818033990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 msgr2=0x561819984b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819984b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.483+0000 7f93fb7fe640 1 -- 172.21.15.1:0/818033990 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181965bb90 con 0x561819985080 2024-09-12T02:31:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.484+0000 7f93fbfff640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 0x7f93e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.484+0000 7f93fbfff640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 0x7f93e40a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005fd0 tx=0x7f93f4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.485+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009610 tx=0x7f93ec010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22e25e5bebebc82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.485+0000 7f93e1ffb640 1 -- 172.21.15.1:0/818033990 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec020070 con 0x561819985080 2024-09-12T02:31:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.485+0000 7f93e1ffb640 1 -- 172.21.15.1:0/818033990 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ec0a40b0 con 0x561819985080 2024-09-12T02:31:42.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.485+0000 7f93e1ffb640 1 -- 172.21.15.1:0/818033990 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec010460 con 0x561819985080 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 -- 172.21.15.1:0/818033990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 msgr2=0x56181998f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009610 tx=0x7f93ec010d70 comp rx=0 tx=0).stop 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 -- 172.21.15.1:0/818033990 shutdown_connections 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56181998f940 0x561819991d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561819985080 0x56181998f400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 --2- 172.21.15.1:0/818033990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819984b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 -- 172.21.15.1:0/818033990 >> 172.21.15.1:0/818033990 conn(0x561819980cf0 msgr2=0x5618199810d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.486+0000 7f940400a740 1 -- 172.21.15.1:0/818033990 shutdown_connections 2024-09-12T02:31:42.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.487+0000 7f940400a740 1 -- 172.21.15.1:0/818033990 wait complete. 2024-09-12T02:31:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.487+0000 7f940400a740 1 -- start start 2024-09-12T02:31:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.487+0000 7f940400a740 1 Processor -- start 2024-09-12T02:31:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x56181998c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x56181998d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561819992510 con 0x561819984760 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5618198726e0 con 0x56181998f940 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561819992690 con 0x561819985080 2024-09-12T02:31:42.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f93faffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f93faffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:60866/0 (socket says 172.21.15.1:60866) 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f93faffd640 1 -- 172.21.15.1:0/3822500909 learned_addr learned my addr 172.21.15.1:0/3822500909 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f93fbfff640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x56181998d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x56181998c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.488+0000 7f940400a740 10 client.0 _ll_register_callbacks cb 0x561819896a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 -- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 msgr2=0x56181998d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x56181998d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 -- 172.21.15.1:0/3822500909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 msgr2=0x56181998c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x56181998c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 -- 172.21.15.1:0/3822500909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181999ba30 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ec0a40b0 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x56181998c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93faffd640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93f0033000 tx=0x7f93f00043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce6718b06b7b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93daffd640 10 client.25096 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.489+0000 7f93daffd640 1 -- 172.21.15.1:0/3822500909 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0035040 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f93daffd640 1 -- 172.21.15.1:0/3822500909 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f93f0005450 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f93daffd640 1 -- 172.21.15.1:0/3822500909 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f93f00046c0 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f940400a740 10 client.25096 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56181999e2f0 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f93daffd640 1 -- 172.21.15.1:0/3822500909 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f93f0004860 con 0x561819985080 2024-09-12T02:31:42.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f940400a740 10 client.25096 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f940400a740 10 client.25096 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.490+0000 7f940400a740 20 client.25096 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56181999f710 0x5618199a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f940400a740 4 client.25096 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618198f79d0 con 0x56181999f710 2024-09-12T02:31:42.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56181999f710 0x5618199a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56181999f710 0x5618199a1bb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4be052c5b9345204 server_cookie=eb5ab12170df1bbc in_seq=0 out_seq=0 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.491+0000 7f93daffd640 10 client.25096 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f93daffd640 1 -- 172.21.15.1:0/3822500909 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618198f79d0 con 0x56181999f710 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f93daffd640 10 client.25096 handle_command_reply: tid=0 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 client.25096 shutdown 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 msgr2=0x56181998cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93f0033000 tx=0x7f93f00043b0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 shutdown_connections 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56181999f710 0x5618199a1bb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x56181998d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x56181998cd90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 --2- 172.21.15.1:0/3822500909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x56181998c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 >> 172.21.15.1:0/3822500909 conn(0x561819980cf0 msgr2=0x561819986a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.492+0000 7f93daffd640 0 client.25096 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.493+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 shutdown_connections 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.493+0000 7f940400a740 1 -- 172.21.15.1:0/3822500909 wait complete. 2024-09-12T02:31:42.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.493+0000 7f940400a740 20 client.25096 trim_cache size 0 max 16384 2024-09-12T02:31:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 Processor -- start 2024-09-12T02:31:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 -- start start 2024-09-12T02:31:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 0x5618199a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 0x5618199a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819989ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f93faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 0x5618199a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 0x5618199a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f93faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 0x5618199a79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51810/0 (socket says 172.21.15.1:51810) 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f93faffd640 1 -- 172.21.15.1:0/4012548553 learned_addr learned my addr 172.21.15.1:0/4012548553 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1af960 con 0x561819985080 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1b14a0 con 0x56181998f940 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.512+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1b0030 con 0x561819984760 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fbfff640 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819989ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 -- 172.21.15.1:0/4012548553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 msgr2=0x561819989ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819989ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 -- 172.21.15.1:0/4012548553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 msgr2=0x5618199a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 0x5618199a79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 -- 172.21.15.1:0/4012548553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561819980b20 con 0x561819984760 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 0x5618199a7480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93ec09b1f0 tx=0x7f93ec086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3073224e6bd6cb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.513+0000 7f93e17fa640 1 -- 172.21.15.1:0/4012548553 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b4070 con 0x561819984760 2024-09-12T02:31:42.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f93e17fa640 1 -- 172.21.15.1:0/4012548553 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ec097b60 con 0x561819984760 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f93e17fa640 1 -- 172.21.15.1:0/4012548553 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec020040 con 0x561819984760 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 msgr2=0x5618199a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 0x5618199a7480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93ec09b1f0 tx=0x7f93ec086040 comp rx=0 tx=0).stop 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 shutdown_connections 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819985080 0x5618199a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819989ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 --2- 172.21.15.1:0/4012548553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819984760 0x5618199a7480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 >> 172.21.15.1:0/4012548553 conn(0x561819980cf0 msgr2=0x56181997fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 shutdown_connections 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.514+0000 7f940400a740 1 -- 172.21.15.1:0/4012548553 wait complete. 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.515+0000 7f940400a740 1 -- start start 2024-09-12T02:31:42.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.515+0000 7f940400a740 1 Processor -- start 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x561819993e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819994400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1b0dd0 con 0x561819984760 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1b0700 con 0x56181998f940 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1ad940 con 0x561819985080 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f940400a740 10 client.0 _ll_register_callbacks cb 0x7f93f0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51822/0 (socket says 172.21.15.1:51822) 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 -- 172.21.15.1:0/2459975796 learned_addr learned my addr 172.21.15.1:0/2459975796 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fbfff640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819994400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 -- 172.21.15.1:0/2459975796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 msgr2=0x561819993e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x561819993e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 -- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 msgr2=0x561819994400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819994400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.516+0000 7f93fb7fe640 1 -- 172.21.15.1:0/2459975796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181997c260 con 0x561819984760 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f93fb7fe640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0971d0 tx=0x7f93ec010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa348cb5376f545 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f93daffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b8070 con 0x561819984760 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ec097b60 con 0x561819984760 2024-09-12T02:31:42.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f93ec0b43e0 con 0x561819984760 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f93ec020040 con 0x561819984760 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f940400a740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.517+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561819a0a850 con 0x561819984760 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ec097b60 con 0x561819984760 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f93ec0ccc70 con 0x561819984760 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 10 client.15570 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 20 client.15570 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561819a0aa80 0x561819a0ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 4 client.15570 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5618198f1d20 con 0x561819a0aa80 2024-09-12T02:31:42.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.518+0000 7f93faffd640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561819a0aa80 0x561819a0ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.519+0000 7f93faffd640 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561819a0aa80 0x561819a0ce70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b29271f58ea855d3 server_cookie=239d1c66b0f350f5 in_seq=0 out_seq=0 2024-09-12T02:31:42.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.519+0000 7f93daffd640 10 client.15570 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:42.523 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.529+0000 7f93daffd640 1 -- 172.21.15.1:0/2459975796 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5618198f1d20 con 0x561819a0aa80 2024-09-12T02:31:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.529+0000 7f93daffd640 10 client.15570 handle_command_reply: tid=0 2024-09-12T02:31:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.529+0000 7f940400a740 1 client.15570 shutdown 2024-09-12T02:31:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 msgr2=0x561819993940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0971d0 tx=0x7f93ec010ce0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 shutdown_connections 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561819a0aa80 0x561819a0ce70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181998f940 0x561819994400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561819985080 0x561819993e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f93daffd640 0 client.15570 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 --2- 172.21.15.1:0/2459975796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561819984760 0x561819993940 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 >> 172.21.15.1:0/2459975796 conn(0x561819980cf0 msgr2=0x56181998e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 shutdown_connections 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 1 -- 172.21.15.1:0/2459975796 wait complete. 2024-09-12T02:31:42.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.530+0000 7f940400a740 20 client.15570 trim_cache size 0 max 16384 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24494, 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 2, 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "f5d4fa5": { 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 2, 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-12T02:31:42.532 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:42.533 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:42.534 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:42.534 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:31:42.534 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.531+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 msgr2=0x7f93e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.531+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 0x7f93e40a5040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005fd0 tx=0x7f93f4004a40 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 msgr2=0x7f93fc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00d950 tx=0x7f93ec00de10 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 shutdown_connections 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f93e40a2b80 0x7f93e40a5040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93fc106f20 0x7f93fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93fc1027a0 0x7f93fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 --2- 172.21.15.1:0/1202787568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93fc101df0 0x7f93fc0744f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:42.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 >> 172.21.15.1:0/1202787568 conn(0x7f93fc0fd8f0 msgr2=0x7f93fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:42.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 shutdown_connections 2024-09-12T02:31:42.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:42.532+0000 7f9401c31640 1 -- 172.21.15.1:0/1202787568 wait complete. 2024-09-12T02:31:43.409 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f5d4fa5', quiesce took 7.6 seconds. Will release after: 16.9 2024-09-12T02:31:43.890 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:43 smithi001 ceph-mon[31252]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:43.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:43 smithi134 ceph-mon[35091]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:43.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:43 smithi173 ceph-mon[35036]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:44.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.001+0000 7f952137b640 1 -- 172.21.15.1:0/1553057372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c106a80 msgr2=0x7f951c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.001+0000 7f952137b640 1 --2- 172.21.15.1:0/1553057372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c106a80 0x7f951c106e60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f950c009930 tx=0x7f950c02a420 comp rx=0 tx=0).stop 2024-09-12T02:31:44.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 -- 172.21.15.1:0/1553057372 shutdown_connections 2024-09-12T02:31:44.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 --2- 172.21.15.1:0/1553057372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c101420 0x7f951c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 --2- 172.21.15.1:0/1553057372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c100a80 0x7f951c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 --2- 172.21.15.1:0/1553057372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c106a80 0x7f951c106e60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 -- 172.21.15.1:0/1553057372 >> 172.21.15.1:0/1553057372 conn(0x7f951c0fc7a0 msgr2=0x7f951c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 -- 172.21.15.1:0/1553057372 shutdown_connections 2024-09-12T02:31:44.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.002+0000 7f952137b640 1 -- 172.21.15.1:0/1553057372 wait complete. 2024-09-12T02:31:44.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 Processor -- start 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 -- start start 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 0x7f951c196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 0x7f951c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f951c10fd70 con 0x7f951c100a80 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f951c10fbf0 con 0x7f951c101420 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.003+0000 7f952137b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f951c10fef0 con 0x7f951c106a80 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951a7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 0x7f951c196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51852/0 (socket says 172.21.15.1:51852) 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 -- 172.21.15.1:0/3582420038 learned_addr learned my addr 172.21.15.1:0/3582420038 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951b7fe640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 0x7f951c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 -- 172.21.15.1:0/3582420038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 msgr2=0x7f951c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 0x7f951c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 -- 172.21.15.1:0/3582420038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 msgr2=0x7f951c196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 0x7f951c196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 -- 172.21.15.1:0/3582420038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c19b180 con 0x7f951c100a80 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951b7fe640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 0x7f951c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951affd640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f950c009230 tx=0x7f950c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.004+0000 7f951a7fc640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 0x7f951c196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.005+0000 7f9503fff640 1 -- 172.21.15.1:0/3582420038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c03f030 con 0x7f951c100a80 2024-09-12T02:31:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.005+0000 7f9503fff640 1 -- 172.21.15.1:0/3582420038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c003ad0 con 0x7f951c100a80 2024-09-12T02:31:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.005+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c19b410 con 0x7f951c100a80 2024-09-12T02:31:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.005+0000 7f9503fff640 1 -- 172.21.15.1:0/3582420038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c035070 con 0x7f951c100a80 2024-09-12T02:31:44.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.005+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c1a2d50 con 0x7f951c100a80 2024-09-12T02:31:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.008+0000 7f9523754740 1 Processor -- start 2024-09-12T02:31:44.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.008+0000 7f9523754740 1 -- start start 2024-09-12T02:31:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.008+0000 7f9503fff640 1 -- 172.21.15.1:0/3582420038 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f950c042030 con 0x7f951c100a80 2024-09-12T02:31:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.008+0000 7f9523754740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 0x55b8864c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.008+0000 7f9523754740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f9523754740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f9523754740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b88642e2f0 con 0x55b8864c85d0 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f9523754740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b8863d5cf0 con 0x55b8864c9b40 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f9523754740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b88642a2b0 con 0x55b8864d3370 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51860/0 (socket says 172.21.15.1:51860) 2024-09-12T02:31:44.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 -- 172.21.15.1:0/3512535189 learned_addr learned my addr 172.21.15.1:0/3512535189 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951a7fc640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951b7fe640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 0x55b8864c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 -- 172.21.15.1:0/3512535189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 msgr2=0x55b8864d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f9503fff640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 0x7f95040a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 -- 172.21.15.1:0/3512535189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 msgr2=0x55b8864c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.009+0000 7f951affd640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 0x55b8864c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f951a7fc640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 0x7f95040a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f951affd640 1 -- 172.21.15.1:0/3512535189 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8863ba3a0 con 0x55b8864c85d0 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f951b7fe640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 0x55b8864c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:44.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f9503fff640 1 -- 172.21.15.1:0/3582420038 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f950c0ef580 con 0x7f951c100a80 2024-09-12T02:31:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f951a7fc640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 0x7f95040a5050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b8864c9070 tx=0x7f951000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f951affd640 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f950c0ab7f0 tx=0x7f950c086a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5dbe773792af57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.010+0000 7f95017fa640 1 -- 172.21.15.1:0/3512535189 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0bbb90 con 0x55b8864c85d0 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.011+0000 7f95017fa640 1 -- 172.21.15.1:0/3512535189 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c0bc4c0 con 0x55b8864c85d0 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.011+0000 7f95017fa640 1 -- 172.21.15.1:0/3512535189 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0a9180 con 0x55b8864c85d0 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.011+0000 7f9523754740 1 -- 172.21.15.1:0/3512535189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 msgr2=0x55b8864c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f950c0ab7f0 tx=0x7f950c086a40 comp rx=0 tx=0).stop 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 -- 172.21.15.1:0/3512535189 shutdown_connections 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864c8a10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 --2- 172.21.15.1:0/3512535189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c9b40 0x55b8864c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 -- 172.21.15.1:0/3512535189 >> 172.21.15.1:0/3512535189 conn(0x55b886491310 msgr2=0x55b8864c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 -- 172.21.15.1:0/3512535189 shutdown_connections 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 -- 172.21.15.1:0/3512535189 wait complete. 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 -- start start 2024-09-12T02:31:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.012+0000 7f9523754740 1 Processor -- start 2024-09-12T02:31:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864d3370 0x55b8864d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b8864da240 con 0x55b8864c85d0 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b8863e9060 con 0x55b8864d3370 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b8864da3c0 con 0x55b8864c9b40 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f9523754740 10 client.0 _ll_register_callbacks cb 0x55b88613c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51862/0 (socket says 172.21.15.1:51862) 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 -- 172.21.15.1:0/4067502371 learned_addr learned my addr 172.21.15.1:0/4067502371 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951b7fe640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864d3370 0x55b8864d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951a7fc640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 -- 172.21.15.1:0/4067502371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 msgr2=0x55b8864d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 -- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864d3370 msgr2=0x55b8864d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864d3370 0x55b8864d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 -- 172.21.15.1:0/4067502371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b88619f3c0 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f951affd640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f950c0bc670 tx=0x7f950c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da12f584bd2bb99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.013+0000 7f94feff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c049070 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f950c0cffa0 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950c0bc4c0 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f950c0bb720 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f9523754740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b8864da240 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.014+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f950c0bc4c0 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f950c08bce0 con 0x55b8864c85d0 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 10 client.15582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 20 client.15582 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:44.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8864e6fb0 0x55b8864e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 4 client.15582 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:44.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b88643b860 con 0x55b8864e6fb0 2024-09-12T02:31:44.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f951a7fc640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8864e6fb0 0x55b8864e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f951a7fc640 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8864e6fb0 0x55b8864e93d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31a86cc78a5e173 server_cookie=6841aa75bd3719a6 in_seq=0 out_seq=0 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.015+0000 7f94feff5640 10 client.15582 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f94feff5640 1 -- 172.21.15.1:0/4067502371 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b88643b860 con 0x55b8864e6fb0 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f94feff5640 10 client.15582 handle_command_reply: tid=0 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 client.15582 shutdown 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 msgr2=0x55b8864d2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f950c0bc670 tx=0x7f950c005e50 comp rx=0 tx=0).stop 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 shutdown_connections 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8864e6fb0 0x55b8864e93d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864d3370 0x55b8864d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 --2- 172.21.15.1:0/4067502371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c85d0 0x55b8864d2e10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.016+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 >> 172.21.15.1:0/4067502371 conn(0x55b886491310 msgr2=0x55b8864ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.017+0000 7f94feff5640 0 client.15582 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.017+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 shutdown_connections 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.017+0000 7f9523754740 1 -- 172.21.15.1:0/4067502371 wait complete. 2024-09-12T02:31:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.017+0000 7f9523754740 20 client.15582 trim_cache size 0 max 16384 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 Processor -- start 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 -- start start 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1ab400 con 0x55b8864d3370 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1acf40 con 0x55b8864c85d0 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f9523754740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1abad0 con 0x55b8864c9b40 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f951affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f951a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f951b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f951b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51872/0 (socket says 172.21.15.1:51872) 2024-09-12T02:31:44.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.043+0000 7f951b7fe640 1 -- 172.21.15.1:0/1124581359 learned_addr learned my addr 172.21.15.1:0/1124581359 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:44.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 -- 172.21.15.1:0/1124581359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 msgr2=0x55b8864cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 -- 172.21.15.1:0/1124581359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 msgr2=0x55b8864cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 -- 172.21.15.1:0/1124581359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8864c5960 con 0x55b8864d3370 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951a7fc640 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f951b7fe640 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9514007f00 tx=0x7f9514012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f0950775d03c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f9500ff9640 1 -- 172.21.15.1:0/1124581359 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514003b70 con 0x55b8864d3370 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.044+0000 7f9500ff9640 1 -- 172.21.15.1:0/1124581359 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9514003d10 con 0x55b8864d3370 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9500ff9640 1 -- 172.21.15.1:0/1124581359 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514010d00 con 0x55b8864d3370 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 -- 172.21.15.1:0/1124581359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 msgr2=0x55b8864eec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9514007f00 tx=0x7f9514012820 comp rx=0 tx=0).stop 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 -- 172.21.15.1:0/1124581359 shutdown_connections 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864d3370 0x55b8864eec80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864c9b40 0x55b8864cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 --2- 172.21.15.1:0/1124581359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.045+0000 7f9523754740 1 -- 172.21.15.1:0/1124581359 >> 172.21.15.1:0/1124581359 conn(0x55b886491310 msgr2=0x55b8864cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.046+0000 7f9523754740 1 -- 172.21.15.1:0/1124581359 shutdown_connections 2024-09-12T02:31:44.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.046+0000 7f9523754740 1 -- 172.21.15.1:0/1124581359 wait complete. 2024-09-12T02:31:44.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.046+0000 7f9523754740 1 -- start start 2024-09-12T02:31:44.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.046+0000 7f9523754740 1 Processor -- start 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f9523754740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864df680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f9523754740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f951a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f951a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51878/0 (socket says 172.21.15.1:51878) 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f9523754740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f951a7fc640 1 -- 172.21.15.1:0/1696651214 learned_addr learned my addr 172.21.15.1:0/1696651214 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.047+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1ac870 con 0x55b8864c9b40 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1ac1a0 con 0x55b8864c85d0 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1a93e0 con 0x55b8864d3370 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951b7fe640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f9523754740 10 client.0 _ll_register_callbacks cb 0x7f951000bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:44.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951affd640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 -- 172.21.15.1:0/1696651214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 msgr2=0x55b8864d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 -- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 msgr2=0x55b8864df680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864df680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8864d7300 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f951a7fc640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x55b8864d1700 tx=0x7f9510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ffda30269c3ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.048+0000 7f94feff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510029530 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9514003d10 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f95100296d0 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f95100298d0 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b8864d9e60 con 0x55b8864c9b40 2024-09-12T02:31:44.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9514003d10 con 0x55b8864c9b40 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9510034400 con 0x55b8864c9b40 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 10 client.15588 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 20 client.15588 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.049+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8865568d0 0x55b886558cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f9523754740 4 client.15588 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b886435d70 con 0x55b8865568d0 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f951affd640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8865568d0 0x55b886558cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f94feff5640 10 client.15588 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f951affd640 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8865568d0 0x55b886558cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e67d3344b1709ddc server_cookie=68c0fa3a07d5b676 in_seq=0 out_seq=0 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f94feff5640 1 -- 172.21.15.1:0/1696651214 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b886435d70 con 0x55b8865568d0 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f94feff5640 10 client.15588 handle_command_reply: tid=0 2024-09-12T02:31:44.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.050+0000 7f9523754740 1 client.15588 shutdown 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 msgr2=0x55b8864dfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x55b8864d1700 tx=0x7f9510004730 comp rx=0 tx=0).stop 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 shutdown_connections 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b8864c9b40 0x55b8864dfbc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55b8865568d0 0x55b886558cf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8864d3370 0x55b8864d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 --2- 172.21.15.1:0/1696651214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b8864c85d0 0x55b8864df680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f94feff5640 0 client.15588 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 >> 172.21.15.1:0/1696651214 conn(0x55b886491310 msgr2=0x55b8864c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 shutdown_connections 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 1 -- 172.21.15.1:0/1696651214 wait complete. 2024-09-12T02:31:44.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.051+0000 7f9523754740 20 client.15588 trim_cache size 0 max 16384 2024-09-12T02:31:44.056 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:44.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 msgr2=0x7f95040a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 0x7f95040a5050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b8864c9070 tx=0x7f951000b390 comp rx=0 tx=0).stop 2024-09-12T02:31:44.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 msgr2=0x7f951c1961d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:44.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f950c009230 tx=0x7f950c004270 comp rx=0 tx=0).stop 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 shutdown_connections 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f95040a2b90 0x7f95040a5050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f951c106a80 0x7f951c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f951c101420 0x7f951c196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 --2- 172.21.15.1:0/3582420038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f951c100a80 0x7f951c1961d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 >> 172.21.15.1:0/3582420038 conn(0x7f951c0fc7a0 msgr2=0x7f951c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 shutdown_connections 2024-09-12T02:31:44.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:44.052+0000 7f952137b640 1 -- 172.21.15.1:0/3582420038 wait complete. 2024-09-12T02:31:44.867 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:31:45.181 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 -- 172.21.15.1:0/1004201698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102ef0 msgr2=0x7faef410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 --2- 172.21.15.1:0/1004201698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102ef0 0x7faef410da40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faeec009ca0 tx=0x7faeec02a950 comp rx=0 tx=0).stop 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 -- 172.21.15.1:0/1004201698 shutdown_connections 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 --2- 172.21.15.1:0/1004201698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102ef0 0x7faef410da40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 --2- 172.21.15.1:0/1004201698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102570 0x7faef41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 --2- 172.21.15.1:0/1004201698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 -- 172.21.15.1:0/1004201698 >> 172.21.15.1:0/1004201698 conn(0x7faef40fc7d0 msgr2=0x7faef40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 -- 172.21.15.1:0/1004201698 shutdown_connections 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 -- 172.21.15.1:0/1004201698 wait complete. 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.708+0000 7faef9d24640 1 Processor -- start 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 -- start start 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102570 0x7faef419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 0x7faef419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faef4110f80 con 0x7faef4102570 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faef4110e00 con 0x7faef4100e20 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef9d24640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faef4111100 con 0x7faef4102ef0 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102570 0x7faef419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53532/0 (socket says 172.21.15.1:53532) 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef37fe640 1 -- 172.21.15.1:0/2217185649 learned_addr learned my addr 172.21.15.1:0/2217185649 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.709+0000 7faef3fff640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 0x7faef419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 -- 172.21.15.1:0/2217185649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 msgr2=0x7faef419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 0x7faef419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 -- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102570 msgr2=0x7faef419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102570 0x7faef419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 -- 172.21.15.1:0/2217185649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef419f590 con 0x7faef4100e20 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef37fe640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faee400d950 tx=0x7faee400dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef0ff9640 1 -- 172.21.15.1:0/2217185649 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4017030 con 0x7faef4100e20 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef419f880 con 0x7faef4100e20 2024-09-12T02:31:45.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.710+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41a7160 con 0x7faef4100e20 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.711+0000 7faef0ff9640 1 -- 172.21.15.1:0/2217185649 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee4004020 con 0x7faef4100e20 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.711+0000 7faef0ff9640 1 -- 172.21.15.1:0/2217185649 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4005650 con 0x7faef4100e20 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.713+0000 7faef0ff9640 1 -- 172.21.15.1:0/2217185649 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faee40041d0 con 0x7faef4100e20 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faef0ff9640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 0x7faedc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 Processor -- start 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 -- start start 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 0x7faedc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faef0ff9640 1 -- 172.21.15.1:0/2217185649 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faee40cea50 con 0x7faef4100e20 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d47f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d48a370 0x55ec0d48c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d3e52f0 con 0x55ec0d47f5d0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d38ccf0 con 0x55ec0d48a370 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faefc0fd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d3e12b0 con 0x55ec0d480b40 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.714+0000 7faef2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51896/0 (socket says 172.21.15.1:51896) 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 -- 172.21.15.1:0/2234196652 learned_addr learned my addr 172.21.15.1:0/2234196652 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef37fe640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d47f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef3fff640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d48a370 0x55ec0d48c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 0x7faedc0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faee8013940 tx=0x7faee80134e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 -- 172.21.15.1:0/2234196652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 msgr2=0x55ec0d47f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d47f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 -- 172.21.15.1:0/2234196652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d48a370 msgr2=0x55ec0d48c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d48a370 0x55ec0d48c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 -- 172.21.15.1:0/2234196652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec0d3713a0 con 0x55ec0d47f5d0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef37fe640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d47f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.715+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faee800fc00 tx=0x7faee801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a536ec0ce07253 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faed9ffb640 1 -- 172.21.15.1:0/2234196652 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee8013320 con 0x55ec0d47f5d0 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faed9ffb640 1 -- 172.21.15.1:0/2234196652 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee8010430 con 0x55ec0d47f5d0 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faed9ffb640 1 -- 172.21.15.1:0/2234196652 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee8020690 con 0x55ec0d47f5d0 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 -- 172.21.15.1:0/2234196652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 msgr2=0x55ec0d47fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faee800fc00 tx=0x7faee801d000 comp rx=0 tx=0).stop 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 -- 172.21.15.1:0/2234196652 shutdown_connections 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d47fa10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d48a370 0x55ec0d48c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2234196652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d47f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.716+0000 7faefc0fd740 1 -- 172.21.15.1:0/2234196652 >> 172.21.15.1:0/2234196652 conn(0x55ec0d448310 msgr2=0x55ec0d47bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.717+0000 7faefc0fd740 1 -- 172.21.15.1:0/2234196652 shutdown_connections 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.717+0000 7faefc0fd740 1 -- 172.21.15.1:0/2234196652 wait complete. 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.717+0000 7faefc0fd740 1 -- start start 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.717+0000 7faefc0fd740 1 Processor -- start 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d487070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 0x55ec0d487800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d495820 con 0x55ec0d48a370 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d3a0060 con 0x55ec0d47f5d0 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53546/0 (socket says 172.21.15.1:53546) 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef37fe640 1 -- 172.21.15.1:0/1653274612 learned_addr learned my addr 172.21.15.1:0/1653274612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d487070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef3fff640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 0x55ec0d487800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ec0d4959a0 con 0x55ec0d480b40 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faefc0fd740 10 client.0 _ll_register_callbacks cb 0x55ec0d0f38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 -- 172.21.15.1:0/1653274612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 msgr2=0x55ec0d489dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 -- 172.21.15.1:0/1653274612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 msgr2=0x55ec0d487800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 0x55ec0d487800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef2ffd640 1 -- 172.21.15.1:0/1653274612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0d1563c0 con 0x55ec0d480b40 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef37fe640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.718+0000 7faef3fff640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 0x55ec0d487800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faef2ffd640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d487070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faee801f760 tx=0x7faee801fc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34edf4cd110f6a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee802e060 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faee80105e0 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faee8010430 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faee80107e0 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faefc0fd740 10 client.25120 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.719+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec0d4a1320 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee8010430 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faee801f070 con 0x55ec0d480b40 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 10 client.25120 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 10 client.25120 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 20 client.25120 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d4a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 4 client.25120 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec0d3f2860 con 0x55ec0d4a2780 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.720+0000 7faef37fe640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d4a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.721+0000 7faef37fe640 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d4a4b70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c7b85cf712e3b59 server_cookie=dcb6a744c4681bd5 in_seq=0 out_seq=0 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.721+0000 7faed2ffd640 10 client.25120 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faed2ffd640 1 -- 172.21.15.1:0/1653274612 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec0d3f2860 con 0x55ec0d4a2780 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faed2ffd640 10 client.25120 handle_command_reply: tid=0 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 client.25120 shutdown 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 msgr2=0x55ec0d487070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d487070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faee801f760 tx=0x7faee801fc90 comp rx=0 tx=0).stop 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 shutdown_connections 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d4a4b70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faed2ffd640 0 client.25120 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d48a370 0x55ec0d487800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d480b40 0x55ec0d487070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 --2- 172.21.15.1:0/1653274612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d47f5d0 0x55ec0d489dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 >> 172.21.15.1:0/1653274612 conn(0x55ec0d448310 msgr2=0x55ec0d481930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 shutdown_connections 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 1 -- 172.21.15.1:0/1653274612 wait complete. 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.722+0000 7faefc0fd740 20 client.25120 trim_cache size 0 max 16384 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 Processor -- start 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 -- start start 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d4842d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51906/0 (socket says 172.21.15.1:51906) 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faef37fe640 1 -- 172.21.15.1:0/259017118 learned_addr learned my addr 172.21.15.1:0/259017118 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ab4c0 con 0x55ec0d47f5d0 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ad000 con 0x55ec0d480b40 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faef41abb90 con 0x55ec0d48a370 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.736+0000 7faef2ffd640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef3fff640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d4842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 -- 172.21.15.1:0/259017118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 msgr2=0x55ec0d4842d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d4842d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 -- 172.21.15.1:0/259017118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 msgr2=0x55ec0d4aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 -- 172.21.15.1:0/259017118 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec0d487b70 con 0x55ec0d47f5d0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef3fff640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d4842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faef37fe640 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faee4097c00 tx=0x7faee40050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9903637af71c3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faed97fa640 1 -- 172.21.15.1:0/259017118 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40b4070 con 0x55ec0d47f5d0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faed97fa640 1 -- 172.21.15.1:0/259017118 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee4014040 con 0x55ec0d47f5d0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.737+0000 7faed97fa640 1 -- 172.21.15.1:0/259017118 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4084030 con 0x55ec0d47f5d0 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 msgr2=0x55ec0d4aa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faee4097c00 tx=0x7faee40050b0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 shutdown_connections 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d4842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 --2- 172.21.15.1:0/259017118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d4aa110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 >> 172.21.15.1:0/259017118 conn(0x55ec0d448310 msgr2=0x55ec0d486160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.738+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 shutdown_connections 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.739+0000 7faefc0fd740 1 -- 172.21.15.1:0/259017118 wait complete. 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.739+0000 7faefc0fd740 1 -- start start 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.739+0000 7faefc0fd740 1 Processor -- start 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d49b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d49b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d49b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51916/0 (socket says 172.21.15.1:51916) 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faef37fe640 1 -- 172.21.15.1:0/2887003399 learned_addr learned my addr 172.21.15.1:0/2887003399 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d496db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faef2ffd640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ac930 con 0x55ec0d47f5d0 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ac260 con 0x55ec0d480b40 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.740+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faef41a9560 con 0x55ec0d48a370 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d496db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faefc0fd740 10 client.0 _ll_register_callbacks cb 0x7faee8013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 -- 172.21.15.1:0/2887003399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 msgr2=0x55ec0d4967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 -- 172.21.15.1:0/2887003399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 msgr2=0x55ec0d49b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d49b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0d4975e0 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faef3fff640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d496db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faeec005cc0 tx=0x7faeec02f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68ef2636b5eca4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.741+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec034040 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faeec003b70 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faee4014040 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faeec003d70 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faefc0fd740 10 client.25123 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec0d50d110 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.742+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee4014040 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faeec04d050 con 0x55ec0d48a370 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 10 client.25123 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 10 client.25123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 20 client.25123 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d50f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 4 client.25123 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec0d3ecd70 con 0x55ec0d4a2780 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.743+0000 7faef37fe640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d50f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faef37fe640 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d50f870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a7eb84208eb38c54 server_cookie=d5bc57b229551cd4 in_seq=0 out_seq=0 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faed2ffd640 10 client.25123 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faed2ffd640 1 -- 172.21.15.1:0/2887003399 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec0d3ecd70 con 0x55ec0d4a2780 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faed2ffd640 10 client.25123 handle_command_reply: tid=0 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 client.25123 shutdown 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 msgr2=0x55ec0d496db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d496db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faeec005cc0 tx=0x7faeec02f3a0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 shutdown_connections 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55ec0d4a2780 0x55ec0d50f870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec0d48a370 0x55ec0d496db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.744+0000 7faed2ffd640 0 client.25123 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec0d480b40 0x55ec0d4967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 1 --2- 172.21.15.1:0/2887003399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ec0d47f5d0 0x55ec0d49b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 >> 172.21.15.1:0/2887003399 conn(0x55ec0d448310 msgr2=0x55ec0d481110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 shutdown_connections 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 1 -- 172.21.15.1:0/2887003399 wait complete. 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.745+0000 7faefc0fd740 20 client.25123 trim_cache size 0 max 16384 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 msgr2=0x7faedc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 0x7faedc0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faee8013940 tx=0x7faee80134e0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 msgr2=0x7faef419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faee400d950 tx=0x7faee400dd50 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 shutdown_connections 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faedc0a2c00 0x7faedc0a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faef4102570 0x7faef419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef4102ef0 0x7faef419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 --2- 172.21.15.1:0/2217185649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef4100e20 0x7faef419a5e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 >> 172.21.15.1:0/2217185649 conn(0x7faef40fc7d0 msgr2=0x7faef406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 shutdown_connections 2024-09-12T02:31:45.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:45.746+0000 7faef9d24640 1 -- 172.21.15.1:0/2217185649 wait complete. 2024-09-12T02:31:45.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:45 smithi001 ceph-mon[31252]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:45.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:45 smithi134 ceph-mon[35091]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:45.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:45 smithi173 ceph-mon[35036]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:31:46.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:31:46.891 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 -- 172.21.15.1:0/3066441738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 msgr2=0x7fbe90103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 --2- 172.21.15.1:0/3066441738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe90103110 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009930 tx=0x7fbe8c02a420 comp rx=0 tx=0).stop 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 -- 172.21.15.1:0/3066441738 shutdown_connections 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 --2- 172.21.15.1:0/3066441738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901082a0 0x7fbe9010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 --2- 172.21.15.1:0/3066441738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901036e0 0x7fbe90107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 --2- 172.21.15.1:0/3066441738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe90103110 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 -- 172.21.15.1:0/3066441738 >> 172.21.15.1:0/3066441738 conn(0x7fbe900fc7d0 msgr2=0x7fbe900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 -- 172.21.15.1:0/3066441738 shutdown_connections 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.427+0000 7fbe98530640 1 -- 172.21.15.1:0/3066441738 wait complete. 2024-09-12T02:31:47.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 Processor -- start 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 -- start start 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901036e0 0x7fbe90198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 0x7fbe9019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901120a0 con 0x7fbe90102d30 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90111f20 con 0x7fbe901036e0 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.428+0000 7fbe98530640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90112220 con 0x7fbe901082a0 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51938/0 (socket says 172.21.15.1:51938) 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 -- 172.21.15.1:0/2409753938 learned_addr learned my addr 172.21.15.1:0/2409753938 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe95acb640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901036e0 0x7fbe90198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe96acd640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 0x7fbe9019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 -- 172.21.15.1:0/2409753938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 msgr2=0x7fbe9019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 0x7fbe9019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 -- 172.21.15.1:0/2409753938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901036e0 msgr2=0x7fbe90198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901036e0 0x7fbe90198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 -- 172.21.15.1:0/2409753938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9019d550 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe96acd640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 0x7fbe9019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe962cc640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009230 tx=0x7fbe8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.429+0000 7fbe877fe640 1 -- 172.21.15.1:0/2409753938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c03f030 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.430+0000 7fbe877fe640 1 -- 172.21.15.1:0/2409753938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe8c003ad0 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.430+0000 7fbe877fe640 1 -- 172.21.15.1:0/2409753938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c035070 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.430+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9019d7e0 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.430+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9019dc70 con 0x7fbe90102d30 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.432+0000 7fbe9a909740 1 Processor -- start 2024-09-12T02:31:47.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 -- start start 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646081470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646081ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557645fd82f0 con 0x55764607c440 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557645f7fcf0 con 0x55764607cdf0 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe9a909740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557645fd42b0 con 0x557646081a40 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51950/0 (socket says 172.21.15.1:51950) 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.433+0000 7fbe96acd640 1 -- 172.21.15.1:0/980604594 learned_addr learned my addr 172.21.15.1:0/980604594 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe95acb640 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646081ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 -- 172.21.15.1:0/980604594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 msgr2=0x557646081ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646081ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 -- 172.21.15.1:0/980604594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 msgr2=0x557646081470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646081470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 -- 172.21.15.1:0/980604594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557645f643a0 con 0x55764607c440 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe877fe640 1 -- 172.21.15.1:0/2409753938 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbe8c042030 con 0x7fbe90102d30 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe96acd640 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800f360 tx=0x7fbe8800f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dc8c08c183564 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.434+0000 7fbe84ff9640 1 -- 172.21.15.1:0/980604594 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88015070 con 0x55764607c440 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.435+0000 7fbe84ff9640 1 -- 172.21.15.1:0/980604594 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe88011be0 con 0x55764607c440 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.435+0000 7fbe877fe640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 0x7fbe7c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.435+0000 7fbe877fe640 1 -- 172.21.15.1:0/2409753938 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fbe8c0ef4f0 con 0x7fbe90102d30 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.435+0000 7fbe84ff9640 1 -- 172.21.15.1:0/980604594 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88010d30 con 0x55764607c440 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.435+0000 7fbe962cc640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 0x7fbe7c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- 172.21.15.1:0/980604594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 msgr2=0x55764607c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800f360 tx=0x7fbe8800f820 comp rx=0 tx=0).stop 2024-09-12T02:31:47.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- 172.21.15.1:0/980604594 shutdown_connections 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646081ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646081470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 --2- 172.21.15.1:0/980604594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764607c820 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- 172.21.15.1:0/980604594 >> 172.21.15.1:0/980604594 conn(0x55764603b310 msgr2=0x55764606e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- 172.21.15.1:0/980604594 shutdown_connections 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe962cc640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 0x7fbe7c0a5140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0c4410 tx=0x7fbe8c0045f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- 172.21.15.1:0/980604594 wait complete. 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 -- start start 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.436+0000 7fbe9a909740 1 Processor -- start 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646085050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646085590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557646088970 con 0x55764607c440 2024-09-12T02:31:47.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557645f93060 con 0x55764607cdf0 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557646088af0 con 0x557646081a40 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe9a909740 10 client.0 _ll_register_callbacks cb 0x557645ce68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51964/0 (socket says 172.21.15.1:51964) 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 -- 172.21.15.1:0/1372771464 learned_addr learned my addr 172.21.15.1:0/1372771464 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe95acb640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646085050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 -- 172.21.15.1:0/1372771464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 msgr2=0x557646085590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646085590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 -- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 msgr2=0x557646085050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646085050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.437+0000 7fbe96acd640 1 -- 172.21.15.1:0/1372771464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557645d493c0 con 0x55764607c440 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f80 tx=0x7fbe880106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a525a2c57f2ed42e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88029060 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fbe88010cc0 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe88011be0 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe88015050 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe9a909740 10 client.15615 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.438+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557646094310 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe88011be0 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe88005040 con 0x55764607c440 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 10 client.15615 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 20 client.15615 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646095770 0x557646097b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 4 client.15615 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557645fe5860 con 0x557646095770 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.439+0000 7fbe95acb640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646095770 0x557646097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.440+0000 7fbe95acb640 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646095770 0x557646097b60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fcb753bcdcdf99c server_cookie=b8280db9ba9cefdb in_seq=0 out_seq=0 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.440+0000 7fbe79ffb640 10 client.15615 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe79ffb640 1 -- 172.21.15.1:0/1372771464 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557645fe5860 con 0x557646095770 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe79ffb640 10 client.15615 handle_command_reply: tid=0 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 client.15615 shutdown 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 msgr2=0x557646087da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f80 tx=0x7fbe880106d0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 shutdown_connections 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646095770 0x557646097b60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe79ffb640 0 client.15615 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:47.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x557646085590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x557646085050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1372771464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646087da0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 >> 172.21.15.1:0/1372771464 conn(0x55764603b310 msgr2=0x55764607ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 shutdown_connections 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 1 -- 172.21.15.1:0/1372771464 wait complete. 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.441+0000 7fbe9a909740 20 client.15615 trim_cache size 0 max 16384 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 Processor -- start 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 -- start start 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764607b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901ab4b0 con 0x55764607c440 2024-09-12T02:31:47.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901acff0 con 0x55764607cdf0 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe9a909740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901abb80 con 0x557646081a40 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51968/0 (socket says 172.21.15.1:51968) 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.454+0000 7fbe96acd640 1 -- 172.21.15.1:0/1765737348 learned_addr learned my addr 172.21.15.1:0/1765737348 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe95acb640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764607b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 -- 172.21.15.1:0/1765737348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 msgr2=0x55764609d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 -- 172.21.15.1:0/1765737348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 msgr2=0x55764607b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764607b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 -- 172.21.15.1:0/1765737348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576460887b0 con 0x55764607c440 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe95acb640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764607b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:47.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe96acd640 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbe88010010 tx=0x7fbe8800f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e8d81189dfbc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe7bfff640 1 -- 172.21.15.1:0/1765737348 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88029070 con 0x55764607c440 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe7bfff640 1 -- 172.21.15.1:0/1765737348 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe880057b0 con 0x55764607c440 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.455+0000 7fbe7bfff640 1 -- 172.21.15.1:0/1765737348 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88033040 con 0x55764607c440 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 -- 172.21.15.1:0/1765737348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 msgr2=0x557646091c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbe88010010 tx=0x7fbe8800f820 comp rx=0 tx=0).stop 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 -- 172.21.15.1:0/1765737348 shutdown_connections 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764607b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 --2- 172.21.15.1:0/1765737348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x557646091c60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 -- 172.21.15.1:0/1765737348 >> 172.21.15.1:0/1765737348 conn(0x55764603b310 msgr2=0x55764607b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 -- 172.21.15.1:0/1765737348 shutdown_connections 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.456+0000 7fbe9a909740 1 -- 172.21.15.1:0/1765737348 wait complete. 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 -- start start 2024-09-12T02:31:47.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 Processor -- start 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764609c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe96acd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51980/0 (socket says 172.21.15.1:51980) 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe96acd640 1 -- 172.21.15.1:0/983775699 learned_addr learned my addr 172.21.15.1:0/983775699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901ac920 con 0x55764607c440 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901ac250 con 0x55764607cdf0 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.457+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901a9490 con 0x557646081a40 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe9a909740 10 client.0 _ll_register_callbacks cb 0x7fbe88009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe95acb640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764609c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 -- 172.21.15.1:0/983775699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 msgr2=0x55764609cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 -- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 msgr2=0x55764609c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764609c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.458+0000 7fbe96acd640 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55764609d3b0 con 0x55764607c440 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe96acd640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005d70 tx=0x7fbe88004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5633b6e9e18dfca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:47.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88033040 con 0x55764607c440 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fbe88010cc0 con 0x55764607c440 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe880057b0 con 0x55764607c440 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe88029040 con 0x55764607c440 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe9a909740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576460ffe50 con 0x55764607c440 2024-09-12T02:31:47.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.459+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe880057b0 con 0x55764607c440 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe88011570 con 0x55764607c440 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 20 client.15621 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646100480 0x5576461028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 4 client.15621 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557645fdfd70 con 0x557646100480 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.460+0000 7fbe95acb640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646100480 0x5576461028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe95acb640 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646100480 0x5576461028a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd2a51c3561682d5 server_cookie=a1279a4a596929e2 in_seq=0 out_seq=0 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe79ffb640 10 client.15621 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:47.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe79ffb640 1 -- 172.21.15.1:0/983775699 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557645fdfd70 con 0x557646100480 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe79ffb640 10 client.15621 handle_command_reply: tid=0 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 client.15621 shutdown 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 msgr2=0x55764608e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005d70 tx=0x7fbe88004f60 comp rx=0 tx=0).stop 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 shutdown_connections 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x557646100480 0x5576461028a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557646081a40 0x55764609cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe79ffb640 0 client.15621 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55764607cdf0 0x55764609c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 --2- 172.21.15.1:0/983775699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55764607c440 0x55764608e2c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 >> 172.21.15.1:0/983775699 conn(0x55764603b310 msgr2=0x55764607ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 shutdown_connections 2024-09-12T02:31:47.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.461+0000 7fbe9a909740 1 -- 172.21.15.1:0/983775699 wait complete. 2024-09-12T02:31:47.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe9a909740 20 client.15621 trim_cache size 0 max 16384 2024-09-12T02:31:47.477 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 msgr2=0x7fbe7c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 0x7fbe7c0a5140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0c4410 tx=0x7fbe8c0045f0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 msgr2=0x7fbe901985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009230 tx=0x7fbe8c004270 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 shutdown_connections 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fbe7c0a2c80 0x7fbe7c0a5140 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe901082a0 0x7fbe9019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe901036e0 0x7fbe90198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 --2- 172.21.15.1:0/2409753938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe90102d30 0x7fbe901985a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 >> 172.21.15.1:0/2409753938 conn(0x7fbe900fc7d0 msgr2=0x7fbe90105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:47.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 shutdown_connections 2024-09-12T02:31:47.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:47.462+0000 7fbe98530640 1 -- 172.21.15.1:0/2409753938 wait complete. 2024-09-12T02:31:47.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:47 smithi134 ceph-mon[35091]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T02:31:47.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:47 smithi173 ceph-mon[35036]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T02:31:48.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:47 smithi001 ceph-mon[31252]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T02:31:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.044+0000 7f218e5e4640 1 -- 172.21.15.1:0/31596812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2188107820 msgr2=0x7f2188109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.044+0000 7f218e5e4640 1 --2- 172.21.15.1:0/31596812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2188107820 0x7f2188109c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2180009ca0 tx=0x7f218002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 -- 172.21.15.1:0/31596812 shutdown_connections 2024-09-12T02:31:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 --2- 172.21.15.1:0/31596812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2188107820 0x7f2188109c90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 --2- 172.21.15.1:0/31596812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f21881072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 --2- 172.21.15.1:0/31596812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21881025c0 0x7f21881049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 -- 172.21.15.1:0/31596812 >> 172.21.15.1:0/31596812 conn(0x7f21880fc1e0 msgr2=0x7f21880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 -- 172.21.15.1:0/31596812 shutdown_connections 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.045+0000 7f218e5e4640 1 -- 172.21.15.1:0/31596812 wait complete. 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.046+0000 7f218e5e4640 1 Processor -- start 2024-09-12T02:31:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.046+0000 7f218e5e4640 1 -- start start 2024-09-12T02:31:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.046+0000 7f218e5e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 0x7f2188197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.046+0000 7f218e5e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218e5e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 0x7f218819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218e5e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f218810d7e0 con 0x7f21881025c0 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218e5e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f218810d660 con 0x7f2188107820 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218e5e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f218810d960 con 0x7f2188104ef0 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f2187fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 0x7f2188197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:32806/0 (socket says 172.21.15.1:32806) 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 -- 172.21.15.1:0/3293314956 learned_addr learned my addr 172.21.15.1:0/3293314956 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218cb81640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 0x7f218819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 -- 172.21.15.1:0/3293314956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 msgr2=0x7f218819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 0x7f218819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 -- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 msgr2=0x7f2188197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 0x7f2188197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f21877fe640 1 -- 172.21.15.1:0/3293314956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218819fa50 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f218cb81640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 0x7f218819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.047+0000 7f2187fff640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 0x7f2188197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f21877fe640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f217c00e9c0 tx=0x7f217c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f21857fa640 1 -- 172.21.15.1:0/3293314956 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00cd80 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f21857fa640 1 -- 172.21.15.1:0/3293314956 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c005500 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218819fd40 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f21857fa640 1 -- 172.21.15.1:0/3293314956 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c010690 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.048+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21881a0230 con 0x7f2188104ef0 2024-09-12T02:31:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.050+0000 7f21857fa640 1 -- 172.21.15.1:0/3293314956 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f217c0046c0 con 0x7f2188104ef0 2024-09-12T02:31:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.051+0000 7f2191456740 1 Processor -- start 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.051+0000 7f21857fa640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 0x7f21700a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.051+0000 7f2191456740 1 -- start start 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f21857fa640 1 -- 172.21.15.1:0/3293314956 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f217c0cf3c0 con 0x7f2188104ef0 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f218cb81640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 0x7f21700a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f2191456740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f7837901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f2191456740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f21877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f21877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52006/0 (socket says 172.21.15.1:52006) 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f2187fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f7837901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f2187fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f7837901b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53632/0 (socket says 172.21.15.1:53632) 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.052+0000 7f2191456740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f783797c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f2191456740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f7836ef2f0 con 0x55f7837906f0 2024-09-12T02:31:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f2191456740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f783697270 con 0x55f78378fdb0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f2191456740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7836eb2b0 con 0x55f783795780 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 -- 172.21.15.1:0/4073403063 learned_addr learned my addr 172.21.15.1:0/4073403063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 -- 172.21.15.1:0/4073403063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 msgr2=0x55f783797c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f783797c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 -- 172.21.15.1:0/4073403063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 msgr2=0x55f7837901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f7837901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 -- 172.21.15.1:0/4073403063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f783696340 con 0x55f7837906f0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f218cb81640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 0x7f21700a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2180004af0 tx=0x7f2180031990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f21877fe640 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f217c004ae0 tx=0x7f217c097f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac5922836e91173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.053+0000 7f216e7fc640 1 -- 172.21.15.1:0/4073403063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c09ff50 con 0x55f7837906f0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.054+0000 7f216e7fc640 1 -- 172.21.15.1:0/4073403063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c0a4810 con 0x55f7837906f0 2024-09-12T02:31:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.054+0000 7f216e7fc640 1 -- 172.21.15.1:0/4073403063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c09b250 con 0x55f7837906f0 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.054+0000 7f2191456740 1 -- 172.21.15.1:0/4073403063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 msgr2=0x55f7837951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.054+0000 7f2191456740 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f217c004ae0 tx=0x7f217c097f70 comp rx=0 tx=0).stop 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 -- 172.21.15.1:0/4073403063 shutdown_connections 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837951b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f783797c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 --2- 172.21.15.1:0/4073403063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f7837901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 -- 172.21.15.1:0/4073403063 >> 172.21.15.1:0/4073403063 conn(0x55f783787010 msgr2=0x55f783787410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 -- 172.21.15.1:0/4073403063 shutdown_connections 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 -- 172.21.15.1:0/4073403063 wait complete. 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.055+0000 7f2191456740 1 -- start start 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 Processor -- start 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f783799f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f78379a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f7837a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f783798690 con 0x55f7837906f0 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f783678290 con 0x55f78378fdb0 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f21877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f78379a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f21877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f78379a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52010/0 (socket says 172.21.15.1:52010) 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f21877fe640 1 -- 172.21.15.1:0/980186578 learned_addr learned my addr 172.21.15.1:0/980186578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2191456740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f783798810 con 0x55f783795780 2024-09-12T02:31:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.056+0000 7f2187fff640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f783799f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f218cb81640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f7837a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2191456740 10 client.0 _ll_register_callbacks cb 0x55f7836a9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 -- 172.21.15.1:0/980186578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 msgr2=0x55f7837a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f7837a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 -- 172.21.15.1:0/980186578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 msgr2=0x55f78379a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f78379a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 -- 172.21.15.1:0/980186578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f783402210 con 0x55f78378fdb0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c0a4810 con 0x55f78378fdb0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f2187fff640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f783799f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2178012cd0 tx=0x7f217800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b567cf7c8f3176c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f21677fe640 10 client.25178 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f21677fe640 1 -- 172.21.15.1:0/980186578 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178012110 con 0x55f78378fdb0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f21677fe640 1 -- 172.21.15.1:0/980186578 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2178004050 con 0x55f78378fdb0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.057+0000 7f21677fe640 1 -- 172.21.15.1:0/980186578 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21780122b0 con 0x55f78378fdb0 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 10 client.25178 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f7834ce620 con 0x55f78378fdb0 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f21677fe640 1 -- 172.21.15.1:0/980186578 <== mon.2 v2:172.21.15.134:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2178004250 con 0x55f78378fdb0 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 10 client.25178 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 10 client.25178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 20 client.25178 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f7837a5a90 0x55f7837a7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 4 client.25178 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7836fca20 con 0x55f7837a5a90 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.058+0000 7f21877fe640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f7837a5a90 0x55f7837a7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.059+0000 7f21677fe640 10 client.25178 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.059+0000 7f21877fe640 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f7837a5a90 0x55f7837a7f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363ae3684f64f0a2 server_cookie=bdc52810be8117c3 in_seq=0 out_seq=0 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.059+0000 7f21677fe640 1 -- 172.21.15.1:0/980186578 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7836fca20 con 0x55f7837a5a90 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.059+0000 7f21677fe640 10 client.25178 handle_command_reply: tid=0 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.059+0000 7f2191456740 1 client.25178 shutdown 2024-09-12T02:31:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 msgr2=0x55f783799f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f783799f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2178012cd0 tx=0x7f217800f790 comp rx=0 tx=0).stop 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 shutdown_connections 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f78379a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f7837a5a90 0x55f7837a7f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783795780 0x55f7837a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f21677fe640 0 client.25178 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 --2- 172.21.15.1:0/980186578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f783799f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 >> 172.21.15.1:0/980186578 conn(0x55f783787010 msgr2=0x55f783788820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 shutdown_connections 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 1 -- 172.21.15.1:0/980186578 wait complete. 2024-09-12T02:31:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.060+0000 7f2191456740 20 client.25178 trim_cache size 0 max 16384 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.074+0000 7f2191456740 1 Processor -- start 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.074+0000 7f2191456740 1 -- start start 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.074+0000 7f2191456740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 0x55f783790190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.074+0000 7f2191456740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f78379a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.074+0000 7f2191456740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f2191456740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a6ee0 con 0x55f7837906f0 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f2191456740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a8a20 con 0x55f78378fdb0 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f2191456740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a75b0 con 0x55f783787010 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52018/0 (socket says 172.21.15.1:52018) 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 -- 172.21.15.1:0/3751347348 learned_addr learned my addr 172.21.15.1:0/3751347348 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f2187fff640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 0x55f783790190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f21877fe640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f78379a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 -- 172.21.15.1:0/3751347348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 msgr2=0x55f783790190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 0x55f783790190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 -- 172.21.15.1:0/3751347348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 msgr2=0x55f78379a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f78379a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 -- 172.21.15.1:0/3751347348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f783786e30 con 0x55f7837906f0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f2187fff640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 0x55f783790190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f21877fe640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f78379a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f218cb81640 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2180009ca0 tx=0x7f218003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae26589bf818db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.075+0000 7f216dffb640 1 -- 172.21.15.1:0/3751347348 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180003e00 con 0x55f7837906f0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f216dffb640 1 -- 172.21.15.1:0/3751347348 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21800305e0 con 0x55f7837906f0 2024-09-12T02:31:49.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f216dffb640 1 -- 172.21.15.1:0/3751347348 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218004f640 con 0x55f7837906f0 2024-09-12T02:31:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 -- 172.21.15.1:0/3751347348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 msgr2=0x55f7837a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2180009ca0 tx=0x7f218003e000 comp rx=0 tx=0).stop 2024-09-12T02:31:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 -- 172.21.15.1:0/3751347348 shutdown_connections 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f7837906f0 0x55f7837a14b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f78378fdb0 0x55f78379a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 --2- 172.21.15.1:0/3751347348 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f783787010 0x55f783790190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 -- 172.21.15.1:0/3751347348 >> 172.21.15.1:0/3751347348 conn(0x55f783795310 msgr2=0x55f7837861c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 -- 172.21.15.1:0/3751347348 shutdown_connections 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.076+0000 7f2191456740 1 -- 172.21.15.1:0/3751347348 wait complete. 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 -- start start 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 Processor -- start 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f78378fdb0 0x55f78379f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7837906f0 0x55f7837a0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a8350 con 0x55f783787010 2024-09-12T02:31:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a7c80 con 0x55f7837906f0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21881a4ec0 con 0x55f78378fdb0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2191456740 10 client.0 _ll_register_callbacks cb 0x7f2178009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2187fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2187fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52028/0 (socket says 172.21.15.1:52028) 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.077+0000 7f2187fff640 1 -- 172.21.15.1:0/2757814546 learned_addr learned my addr 172.21.15.1:0/2757814546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f218cb81640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7837906f0 0x55f7837a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f21877fe640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f78378fdb0 0x55f78379f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 -- 172.21.15.1:0/2757814546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f78378fdb0 msgr2=0x55f78379f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f78378fdb0 0x55f78379f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 -- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7837906f0 msgr2=0x55f7837a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7837906f0 0x55f7837a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 -- 172.21.15.1:0/2757814546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7837a0e20 con 0x55f783787010 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2187fff640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2178000c00 tx=0x7f21780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7288f5b331535c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f21677fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178037060 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f217802e040 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21800305e0 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2178012110 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2191456740 10 client.15639 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.078+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f783810de0 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21800305e0 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2178004830 con 0x55f783787010 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 10 client.15639 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 20 client.15639 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f783795780 0x55f783813770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 4 client.15639 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:31:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.079+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7836f6d70 con 0x55f783795780 2024-09-12T02:31:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.080+0000 7f21877fe640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f783795780 0x55f783813770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.080+0000 7f21877fe640 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f783795780 0x55f783813770 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921a22649b29bff5 server_cookie=72e4d07c4cd5b796 in_seq=0 out_seq=0 2024-09-12T02:31:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.080+0000 7f21677fe640 10 client.15639 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f21677fe640 1 -- 172.21.15.1:0/2757814546 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7836f6d70 con 0x55f783795780 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f21677fe640 10 client.15639 handle_command_reply: tid=0 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 client.15639 shutdown 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 msgr2=0x55f78379f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2178000c00 tx=0x7f21780046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 shutdown_connections 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55f783795780 0x55f783813770 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7837906f0 0x55f7837a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f78378fdb0 0x55f78379f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 --2- 172.21.15.1:0/2757814546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f783787010 0x55f78379f2c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 >> 172.21.15.1:0/2757814546 conn(0x55f783795310 msgr2=0x55f7837873f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f21677fe640 0 client.15639 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 shutdown_connections 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 1 -- 172.21.15.1:0/2757814546 wait complete. 2024-09-12T02:31:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.088+0000 7f2191456740 20 client.15639 trim_cache size 0 max 16384 2024-09-12T02:31:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:31:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:31:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:31:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 msgr2=0x7f21700a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 0x7f21700a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2180004af0 tx=0x7f2180031990 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 msgr2=0x7f2188198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f217c00e9c0 tx=0x7f217c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 shutdown_connections 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f21700a2cb0 0x7f21700a5170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2188107820 0x7f218819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2188104ef0 0x7f2188198370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 --2- 172.21.15.1:0/3293314956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21881025c0 0x7f2188197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 >> 172.21.15.1:0/3293314956 conn(0x7f21880fc1e0 msgr2=0x7f2188102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 shutdown_connections 2024-09-12T02:31:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:31:49.089+0000 7f218e5e4640 1 -- 172.21.15.1:0/3293314956 wait complete. 2024-09-12T02:31:49.222 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:31:49.222 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:31:49.527 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:49 smithi134 ceph-mon[35091]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:31:49.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:49 smithi173 ceph-mon[35036]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:31:50.009 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:49 smithi001 ceph-mon[31252]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:31:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/1760484338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 msgr2=0x7fd8f810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/1760484338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f810ea80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009ca0 tx=0x7fd8f002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/1760484338 shutdown_connections 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/1760484338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f810ea80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/1760484338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/1760484338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f8100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.102+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/1760484338 >> 172.21.15.1:0/1760484338 conn(0x7fd8f8075f70 msgr2=0x7fd8f8076380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.103+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/1760484338 shutdown_connections 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.103+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/1760484338 wait complete. 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.104+0000 7fd8ffe4b640 1 Processor -- start 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.104+0000 7fd8ffe4b640 1 -- start start 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8111f60 con 0x7fd8f8108150 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8111de0 con 0x7fd8f81012d0 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8ffe4b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81120e0 con 0x7fd8f8100920 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53684/0 (socket says 172.21.15.1:53684) 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/262296312 learned_addr learned my addr 172.21.15.1:0/262296312 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/262296312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 msgr2=0x7fd8f81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 msgr2=0x7fd8f819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.105+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/262296312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f819d350 con 0x7fd8f8100920 2024-09-12T02:31:50.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f81983a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d720 tx=0x7fd8f400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8eeffd640 1 -- 172.21.15.1:0/262296312 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4017070 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f819d640 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8eeffd640 1 -- 172.21.15.1:0/262296312 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8f400de30 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8eeffd640 1 -- 172.21.15.1:0/262296312 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40047a0 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.106+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f81a4f20 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.109+0000 7fd8eeffd640 1 -- 172.21.15.1:0/262296312 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd8f40099d0 con 0x7fd8f8100920 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 Processor -- start 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 -- start start 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b284f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56094b1ea280 con 0x56094b28fd40 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56094b191b10 con 0x56094b285480 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.110+0000 7fd902224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56094b1e6240 con 0x56094b284b60 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52056/0 (socket says 172.21.15.1:52056) 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/717253238 learned_addr learned my addr 172.21.15.1:0/717253238 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8eeffd640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 0x7fd8e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8eeffd640 1 -- 172.21.15.1:0/262296312 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd8f40cecc0 con 0x7fd8f8100920 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b284f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/717253238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 msgr2=0x56094b284f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b284f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/717253238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 msgr2=0x56094b28f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/717253238 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094b19e1f0 con 0x56094b28fd40 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 0x7fd8e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.111+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8005fa0 tx=0x7fd8e80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e904c6a6cd90b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.112+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 0x7fd8e40a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009430 tx=0x7fd8f00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.112+0000 7fd8e3fff640 1 -- 172.21.15.1:0/717253238 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8023630 con 0x56094b28fd40 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.112+0000 7fd8e3fff640 1 -- 172.21.15.1:0/717253238 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e8023cb0 con 0x56094b28fd40 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.112+0000 7fd8e3fff640 1 -- 172.21.15.1:0/717253238 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800dc00 con 0x56094b28fd40 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 -- 172.21.15.1:0/717253238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 msgr2=0x56094b292130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8005fa0 tx=0x7fd8e80107a0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 -- 172.21.15.1:0/717253238 shutdown_connections 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b292130 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 --2- 172.21.15.1:0/717253238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b284f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 -- 172.21.15.1:0/717253238 >> 172.21.15.1:0/717253238 conn(0x56094b2810f0 msgr2=0x56094b2814d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 -- 172.21.15.1:0/717253238 shutdown_connections 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.113+0000 7fd902224740 1 -- 172.21.15.1:0/717253238 wait complete. 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 -- start start 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 Processor -- start 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b288f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b289490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56094b2928b0 con 0x56094b28fd40 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56094b1a4f10 con 0x56094b285480 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.114+0000 7fd902224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56094b292a30 con 0x56094b284b60 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fe3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fe3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52070/0 (socket says 172.21.15.1:52070) 2024-09-12T02:31:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b288f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fe3e8640 1 -- 172.21.15.1:0/2515888036 learned_addr learned my addr 172.21.15.1:0/2515888036 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b289490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 msgr2=0x56094b289490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b289490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/2515888036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 msgr2=0x56094b28d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/2515888036 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094af5b6a0 con 0x56094b284b60 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b289490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd902224740 10 client.0 _ll_register_callbacks cb 0x56094b16da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e8023cb0 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b288f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56094b281f50 tx=0x7fd8f406b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701fc447aaa10e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.115+0000 7fd8e17fa640 10 client.25162 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd8e17fa640 1 -- 172.21.15.1:0/2515888036 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40d0040 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd8e17fa640 1 -- 172.21.15.1:0/2515888036 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd8f406a150 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd8e17fa640 1 -- 172.21.15.1:0/2515888036 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8f409ae60 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 10 client.25162 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56094b29e4d0 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd8e17fa640 1 -- 172.21.15.1:0/2515888036 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8f4009cc0 con 0x56094b284b60 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 10 client.25162 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 10 client.25162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 20 client.25162 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b29fe10 0x56094b2a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 4 client.25162 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.116+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56094b1f77f0 con 0x56094b29fe10 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.117+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b29fe10 0x56094b2a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.117+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b29fe10 0x56094b2a22a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2068aa1eed4f6cdb server_cookie=21a38a4e690c8a59 in_seq=0 out_seq=0 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.117+0000 7fd8e17fa640 10 client.25162 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd8e17fa640 1 -- 172.21.15.1:0/2515888036 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56094b1f77f0 con 0x56094b29fe10 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd8e17fa640 10 client.25162 handle_command_reply: tid=0 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 client.25162 shutdown 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 msgr2=0x56094b288f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b288f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56094b281f50 tx=0x7fd8f406b3b0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 shutdown_connections 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b28d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b29fe10 0x56094b2a22a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b289490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 --2- 172.21.15.1:0/2515888036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b288f50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 >> 172.21.15.1:0/2515888036 conn(0x56094b2810f0 msgr2=0x56094b280270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.118+0000 7fd8e17fa640 0 client.25162 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.119+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 shutdown_connections 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.119+0000 7fd902224740 1 -- 172.21.15.1:0/2515888036 wait complete. 2024-09-12T02:31:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.119+0000 7fd902224740 20 client.25162 trim_cache size 0 max 16384 2024-09-12T02:31:50.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.153+0000 7fd902224740 1 Processor -- start 2024-09-12T02:31:50.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.153+0000 7fd902224740 1 -- start start 2024-09-12T02:31:50.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.153+0000 7fd902224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.153+0000 7fd902224740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd902224740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b2a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd902224740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ab2c0 con 0x56094b28fd40 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd902224740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ace00 con 0x56094b285480 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd902224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ab990 con 0x56094b284b60 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fe3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b2a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fe3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b2a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52074/0 (socket says 172.21.15.1:52074) 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:32870/0 (socket says 172.21.15.1:32870) 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fe3e8640 1 -- 172.21.15.1:0/3301109096 learned_addr learned my addr 172.21.15.1:0/3301109096 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/3301109096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 msgr2=0x56094b28db20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:31:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28db20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/3301109096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 msgr2=0x56094b2a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b2a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.154+0000 7fd8fdbe7640 1 -- 172.21.15.1:0/3301109096 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094b27b610 con 0x56094b284b60 2024-09-12T02:31:50.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.155+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009610 tx=0x7fd8f40c6090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b04151dd5fc8c483 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.155+0000 7fd8e37fe640 1 -- 172.21.15.1:0/3301109096 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f409bc00 con 0x56094b284b60 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.155+0000 7fd8e37fe640 1 -- 172.21.15.1:0/3301109096 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e8023cb0 con 0x56094b284b60 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.155+0000 7fd8e37fe640 1 -- 172.21.15.1:0/3301109096 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40a4170 con 0x56094b284b60 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- 172.21.15.1:0/3301109096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 msgr2=0x56094b28d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009610 tx=0x7fd8f40c6090 comp rx=0 tx=0).stop 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- 172.21.15.1:0/3301109096 shutdown_connections 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b28fd40 0x56094b2a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b285480 0x56094b28db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 --2- 172.21.15.1:0/3301109096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b28d5e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- 172.21.15.1:0/3301109096 >> 172.21.15.1:0/3301109096 conn(0x56094b2810f0 msgr2=0x56094b280270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- 172.21.15.1:0/3301109096 shutdown_connections 2024-09-12T02:31:50.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- 172.21.15.1:0/3301109096 wait complete. 2024-09-12T02:31:50.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.156+0000 7fd902224740 1 -- start start 2024-09-12T02:31:50.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 Processor -- start 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b29c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 0x56094b295460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ac730 con 0x56094b285480 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ac060 con 0x56094b28fd40 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81a92a0 con 0x56094b284b60 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd902224740 10 client.0 _ll_register_callbacks cb 0x7fd8f4095f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.157+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fd3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52076/0 (socket says 172.21.15.1:52076) 2024-09-12T02:31:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 0x56094b295460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fd3e6640 1 -- 172.21.15.1:0/1754964239 learned_addr learned my addr 172.21.15.1:0/1754964239 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b29c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 -- 172.21.15.1:0/1754964239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 msgr2=0x56094b29c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b29c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 -- 172.21.15.1:0/1754964239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 msgr2=0x56094b294f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 -- 172.21.15.1:0/1754964239 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094b295a50 con 0x56094b28fd40 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fd3e6640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8fe3e8640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 0x56094b295460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56094b285a30 tx=0x7fd8f0003f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd3eabf80621111e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.158+0000 7fd8e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004250 con 0x56094b28fd40 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd8f0040030 con 0x56094b28fd40 2024-09-12T02:31:50.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e8023cb0 con 0x56094b28fd40 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8f00043f0 con 0x56094b28fd40 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd902224740 10 client.25193 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56094b30a9c0 con 0x56094b28fd40 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.159+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e8023cb0 con 0x56094b28fd40 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd8f00305c0 con 0x56094b28fd40 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 10 client.25193 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 10 client.25193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 20 client.25193 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:50.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b30b0e0 0x56094b30d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 4 client.25193 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:31:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56094b1f1d00 con 0x56094b30b0e0 2024-09-12T02:31:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.160+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b30b0e0 0x56094b30d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.161+0000 7fd8fdbe7640 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b30b0e0 0x56094b30d4d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea2b9637fe9df1d server_cookie=3c713ded6b6d3073 in_seq=0 out_seq=0 2024-09-12T02:31:50.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.161+0000 7fd8e17fa640 10 client.25193 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.162+0000 7fd8e17fa640 1 -- 172.21.15.1:0/1754964239 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56094b1f1d00 con 0x56094b30b0e0 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.162+0000 7fd8e17fa640 10 client.25193 handle_command_reply: tid=0 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.162+0000 7fd902224740 1 client.25193 shutdown 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 msgr2=0x56094b295460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 0x56094b295460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56094b285a30 tx=0x7fd8f0003f40 comp rx=0 tx=0).stop 2024-09-12T02:31:50.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 shutdown_connections 2024-09-12T02:31:50.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56094b285480 0x56094b294f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56094b30b0e0 0x56094b30d4d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.165 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:50.166 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-12T02:31:50.166 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "12c2f092-e867-4000-8fdd-7db2641c80be", 2024-09-12T02:31:50.166 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-12T02:31:50.166 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56094b28fd40 0x56094b295460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 --2- 172.21.15.1:0/1754964239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56094b284b60 0x56094b29c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd8e17fa640 0 client.25193 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 >> 172.21.15.1:0/1754964239 conn(0x56094b2810f0 msgr2=0x56094b27fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 shutdown_connections 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 1 -- 172.21.15.1:0/1754964239 wait complete. 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.163+0000 7fd902224740 20 client.25193 trim_cache size 0 max 16384 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 msgr2=0x7fd8e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 0x7fd8e40a5040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009430 tx=0x7fd8f00095c0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 msgr2=0x7fd8f81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f81983a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d720 tx=0x7fd8f400dbe0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 shutdown_connections 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd8e40a2b80 0x7fd8e40a5040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd8f8108150 0x7fd8f819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8f81012d0 0x7fd8f81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 --2- 172.21.15.1:0/262296312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8f8100920 0x7fd8f81983a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 >> 172.21.15.1:0/262296312 conn(0x7fd8f8075f70 msgr2=0x7fd8f80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.164+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 shutdown_connections 2024-09-12T02:31:50.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:50.165+0000 7fd8ffe4b640 1 -- 172.21.15.1:0/262296312 wait complete. 2024-09-12T02:31:51.027 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:31:51.347 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:51.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:51 smithi001 ceph-mon[31252]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T02:31:52.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:51 smithi001 ceph-mon[31252]: scrub queued for path: / 2024-09-12T02:31:52.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:51 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:51 smithi001 ceph-mon[31252]: scrub summary: active paths [/] 2024-09-12T02:31:52.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:51 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:51 smithi173 ceph-mon[35036]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:51 smithi173 ceph-mon[35036]: scrub queued for path: / 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:51 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:51 smithi173 ceph-mon[35036]: scrub summary: active paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:51 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:51 smithi134 ceph-mon[35091]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:51 smithi134 ceph-mon[35091]: scrub queued for path: / 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:51 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:51 smithi134 ceph-mon[35091]: scrub summary: active paths [/] 2024-09-12T02:31:52.103 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:51 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:31:52.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 -- 172.21.15.1:0/3628470963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c2010c160 msgr2=0x7f1c2010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 --2- 172.21.15.1:0/3628470963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c2010c160 0x7f1c2010e600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009ca0 tx=0x7f1c1802a950 comp rx=0 tx=0).stop 2024-09-12T02:31:52.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 -- 172.21.15.1:0/3628470963 shutdown_connections 2024-09-12T02:31:52.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 --2- 172.21.15.1:0/3628470963 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c2010c160 0x7f1c2010e600 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 --2- 172.21.15.1:0/3628470963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20103650 0x7f1c2010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 --2- 172.21.15.1:0/3628470963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c20102d30 0x7f1c20103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.964+0000 7f1c258fe640 1 -- 172.21.15.1:0/3628470963 >> 172.21.15.1:0/3628470963 conn(0x7f1c200fc7d0 msgr2=0x7f1c200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.965+0000 7f1c258fe640 1 -- 172.21.15.1:0/3628470963 shutdown_connections 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.965+0000 7f1c258fe640 1 -- 172.21.15.1:0/3628470963 wait complete. 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.965+0000 7f1c258fe640 1 Processor -- start 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 -- start start 2024-09-12T02:31:52.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20102d30 0x7f1c2019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2010c160 0x7f1c2019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36076/0 (socket says 172.21.15.1:36076) 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/108482712 learned_addr learned my addr 172.21.15.1:0/108482712 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20111fb0 con 0x7f1c20103650 2024-09-12T02:31:52.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20111e30 con 0x7f1c20102d30 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.966+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c20112130 con 0x7f1c2010c160 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1effd640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20102d30 0x7f1c2019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2010c160 0x7f1c2019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/108482712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2010c160 msgr2=0x7f1c2019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2010c160 0x7f1c2019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/108482712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20102d30 msgr2=0x7f1c2019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20102d30 0x7f1c2019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2019f610 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.967+0000 7f1c248fc640 1 -- 172.21.15.1:0/108482712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400ccc0 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.968+0000 7f1c248fc640 1 -- 172.21.15.1:0/108482712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c14010910 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.968+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2019f900 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.968+0000 7f1c248fc640 1 -- 172.21.15.1:0/108482712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14018920 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.968+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c201a71e0 con 0x7f1c20103650 2024-09-12T02:31:52.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.971+0000 7f1c248fc640 1 -- 172.21.15.1:0/108482712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1c14010430 con 0x7f1c20103650 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.971+0000 7f1c27cd7740 1 Processor -- start 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.971+0000 7f1c27cd7740 1 -- start start 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adbca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55696ad152e0 con 0x55696adba680 2024-09-12T02:31:52.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55696acbcce0 con 0x55696adafdc0 2024-09-12T02:31:52.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c27cd7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55696ad112a0 con 0x55696adaf4a0 2024-09-12T02:31:52.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c1f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c1f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:52878/0 (socket says 172.21.15.1:52878) 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c1f7fe640 1 -- 172.21.15.1:0/2895528428 learned_addr learned my addr 172.21.15.1:0/2895528428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.972+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adbca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 -- 172.21.15.1:0/2895528428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 msgr2=0x55696adba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 -- 172.21.15.1:0/2895528428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 msgr2=0x55696adbca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adbca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 -- 172.21.15.1:0/2895528428 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696aca1440 con 0x55696adaf4a0 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c248fc640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 0x7f1c080a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009ca0 tx=0x7f1c18005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2454baa9dc3768c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c248fc640 1 -- 172.21.15.1:0/108482712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1c140cf1b0 con 0x7f1c20103650 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c05ffb640 1 -- 172.21.15.1:0/2895528428 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18048070 con 0x55696adaf4a0 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c05ffb640 1 -- 172.21.15.1:0/2895528428 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c18003e50 con 0x55696adaf4a0 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.973+0000 7f1c05ffb640 1 -- 172.21.15.1:0/2895528428 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18034040 con 0x55696adaf4a0 2024-09-12T02:31:52.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.974+0000 7f1c1effd640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 0x7f1c080a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.974+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2895528428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 msgr2=0x55696adaf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.974+0000 7f1c1effd640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 0x7f1c080a5190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55696adac890 tx=0x7f1c10009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.974+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009ca0 tx=0x7f1c18005f80 comp rx=0 tx=0).stop 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2895528428 shutdown_connections 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adbca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2895528428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adaf880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2895528428 >> 172.21.15.1:0/2895528428 conn(0x55696adaba30 msgr2=0x55696adabe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2895528428 shutdown_connections 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.976+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2895528428 wait complete. 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.977+0000 7f1c27cd7740 1 -- start start 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.977+0000 7f1c27cd7740 1 Processor -- start 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adb72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adb7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:52888/0 (socket says 172.21.15.1:52888) 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c1effd640 1 -- 172.21.15.1:0/494320970 learned_addr learned my addr 172.21.15.1:0/494320970 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adb72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.978+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55696adbd2a0 con 0x55696adba680 2024-09-12T02:31:52.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55696acd0050 con 0x55696adafdc0 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55696adbd420 con 0x55696adaf4a0 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c27cd7740 10 client.0 _ll_register_callbacks cb 0x55696ad10160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adb7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 -- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 msgr2=0x55696adb72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adb72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 -- 172.21.15.1:0/494320970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 msgr2=0x55696adb7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adb7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696aa863c0 con 0x55696adaf4a0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1c1effd640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001caf0 tx=0x7f1c10005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c464b8564f8eccf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.979+0000 7f1bfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1001d820 con 0x55696adaf4a0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1c1001d9c0 con 0x55696adaf4a0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c18003e50 con 0x55696adaf4a0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c1001dbc0 con 0x55696adaf4a0 2024-09-12T02:31:52.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1c27cd7740 10 client.25180 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55696adc8cf0 con 0x55696adaf4a0 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.980+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c18003e50 con 0x55696adaf4a0 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c1001a390 con 0x55696adaf4a0 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 10 client.25180 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 10 client.25180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 20 client.25180 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:52.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696adca1b0 0x55696adcc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 4 client.25180 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55696ad22850 con 0x55696adca1b0 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.981+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696adca1b0 0x55696adcc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.982+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696adca1b0 0x55696adcc600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a82a354c35874e3 server_cookie=34c2e7217c9dad9a in_seq=0 out_seq=0 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.982+0000 7f1bfeffd640 10 client.25180 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.982+0000 7f1bfeffd640 1 -- 172.21.15.1:0/494320970 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55696ad22850 con 0x55696adca1b0 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.982+0000 7f1bfeffd640 10 client.25180 handle_command_reply: tid=0 2024-09-12T02:31:52.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.982+0000 7f1c27cd7740 1 client.25180 shutdown 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 msgr2=0x55696adba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001caf0 tx=0x7f1c10005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 shutdown_connections 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adb7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696adca1b0 0x55696adcc600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1bfeffd640 0 client.25180 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:52.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adafdc0 0x55696adb72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/494320970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696adba020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 >> 172.21.15.1:0/494320970 conn(0x55696adaba30 msgr2=0x55696adb1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 shutdown_connections 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 1 -- 172.21.15.1:0/494320970 wait complete. 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:51.983+0000 7f1c27cd7740 20 client.25180 trim_cache size 0 max 16384 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 Processor -- start 2024-09-12T02:31:52.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 -- start start 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696add1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adba680 0x55696adb4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36112/0 (socket says 172.21.15.1:36112) 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/2974695112 learned_addr learned my addr 172.21.15.1:0/2974695112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.018+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201af7c0 con 0x55696adafdc0 2024-09-12T02:31:52.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201b1300 con 0x55696adba680 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201afe90 con 0x55696adaf4a0 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1effd640 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696add1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adba680 0x55696adb4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/2974695112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 msgr2=0x55696add1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696add1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/2974695112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adba680 msgr2=0x55696adb4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adba680 0x55696adb4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 -- 172.21.15.1:0/2974695112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696adba390 con 0x55696adafdc0 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400cf10 tx=0x7f1c1400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfa8d08a09a2912 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.019+0000 7f1c057fa640 1 -- 172.21.15.1:0/2974695112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14099d40 con 0x55696adafdc0 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.020+0000 7f1c057fa640 1 -- 172.21.15.1:0/2974695112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c140ccd40 con 0x55696adafdc0 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.020+0000 7f1c057fa640 1 -- 172.21.15.1:0/2974695112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1409b180 con 0x55696adafdc0 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 msgr2=0x55696add2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400cf10 tx=0x7f1c1400cf60 comp rx=0 tx=0).stop 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 shutdown_connections 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adafdc0 0x55696add2410 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adba680 0x55696adb4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/2974695112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adaf4a0 0x55696add1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 >> 172.21.15.1:0/2974695112 conn(0x55696adaba30 msgr2=0x55696adaab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 shutdown_connections 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- 172.21.15.1:0/2974695112 wait complete. 2024-09-12T02:31:52.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 -- start start 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.021+0000 7f1c27cd7740 1 Processor -- start 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 0x55696adc0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40666/0 (socket says 172.21.15.1:40666) 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36122/0 (socket says 172.21.15.1:36122) 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201b0c30 con 0x55696adba680 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1effd640 1 -- 172.21.15.1:0/575384927 learned_addr learned my addr 172.21.15.1:0/575384927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201b0560 con 0x55696adaf4a0 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c201ad7a0 con 0x55696adafdc0 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 0x55696adc0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.022+0000 7f1c1effd640 1 -- 172.21.15.1:0/575384927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 msgr2=0x55696adc0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1effd640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 0x55696adc0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c27cd7740 10 client.0 _ll_register_callbacks cb 0x7f1c10009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1effd640 1 -- 172.21.15.1:0/575384927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 msgr2=0x55696adc10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1effd640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1effd640 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696ae3c910 con 0x55696adaf4a0 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 0x55696adc0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1f7fe640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:52.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c140ccd40 con 0x55696adaf4a0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c1effd640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c10016040 tx=0x7f1c1001a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c712a9001a9610 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1bfeffd640 10 client.25208 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1bfeffd640 1 -- 172.21.15.1:0/575384927 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10009ca0 con 0x55696adaf4a0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1bfeffd640 1 -- 172.21.15.1:0/575384927 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1c10005040 con 0x55696adaf4a0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1bfeffd640 1 -- 172.21.15.1:0/575384927 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c100052c0 con 0x55696adaf4a0 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c27cd7740 10 client.25208 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:52.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.023+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55696ae3dae0 con 0x55696adaf4a0 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1bfeffd640 1 -- 172.21.15.1:0/575384927 <== mon.2 v2:172.21.15.134:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1c10045030 con 0x55696adaf4a0 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 10 client.25208 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 10 client.25208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 20 client.25208 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696ae3e040 0x55696ae40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 4 client.25208 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:31:52.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55696ad1cd60 con 0x55696ae3e040 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.024+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696ae3e040 0x55696ae40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c1e7fc640 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696ae3e040 0x55696ae40450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628e78d9e507e8b5 server_cookie=a1e9920b53428b73 in_seq=0 out_seq=0 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1bfeffd640 10 client.25208 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1bfeffd640 1 -- 172.21.15.1:0/575384927 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55696ad1cd60 con 0x55696ae3e040 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1bfeffd640 10 client.25208 handle_command_reply: tid=0 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 client.25208 shutdown 2024-09-12T02:31:52.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 msgr2=0x55696adc0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c10016040 tx=0x7f1c1001a640 comp rx=0 tx=0).stop 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 shutdown_connections 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55696adba680 0x55696adc10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55696ae3e040 0x55696ae40450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55696adafdc0 0x55696adc0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 --2- 172.21.15.1:0/575384927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55696adaf4a0 0x55696adc0660 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1bfeffd640 0 client.25208 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:31:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 >> 172.21.15.1:0/575384927 conn(0x55696adaba30 msgr2=0x55696adb8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 shutdown_connections 2024-09-12T02:31:52.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 1 -- 172.21.15.1:0/575384927 wait complete. 2024-09-12T02:31:52.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.025+0000 7f1c27cd7740 20 client.25208 trim_cache size 0 max 16384 2024-09-12T02:31:52.146 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:31:52.146 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-12T02:31:52.146 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-12T02:31:52.146 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 msgr2=0x7f1c080a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 0x7f1c080a5190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55696adac890 tx=0x7f1c10009840 comp rx=0 tx=0).stop 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 msgr2=0x7f1c2019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e9f0 tx=0x7f1c1400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 shutdown_connections 2024-09-12T02:31:52.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f1c080a2cd0 0x7f1c080a5190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c20103650 0x7f1c2019aba0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c2010c160 0x7f1c2019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 --2- 172.21.15.1:0/108482712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c20102d30 0x7f1c2019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.026+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 >> 172.21.15.1:0/108482712 conn(0x7f1c200fc7d0 msgr2=0x7f1c2010d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.027+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 shutdown_connections 2024-09-12T02:31:52.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:52.027+0000 7f1c258fe640 1 -- 172.21.15.1:0/108482712 wait complete. 2024-09-12T02:31:52.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:52 smithi001 ceph-mon[31252]: scrub summary: idle 2024-09-12T02:31:52.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:52 smithi134 ceph-mon[35091]: scrub summary: idle 2024-09-12T02:31:52.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:52 smithi173 ceph-mon[35036]: scrub summary: idle 2024-09-12T02:31:52.969 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:31:52.969 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:53.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 -- 172.21.15.1:0/546393556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0103780 msgr2=0x7f7bb0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:53.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/546393556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0103780 0x7f7bb0107bc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009930 tx=0x7f7ba402a420 comp rx=0 tx=0).stop 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 -- 172.21.15.1:0/546393556 shutdown_connections 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/546393556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0103780 0x7f7bb0107bc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/546393556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0108300 0x7f7bb010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/546393556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0102dd0 0x7f7bb01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 -- 172.21.15.1:0/546393556 >> 172.21.15.1:0/546393556 conn(0x7f7bb00fc7d0 msgr2=0x7f7bb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 -- 172.21.15.1:0/546393556 shutdown_connections 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.796+0000 7f7bb63f5640 1 -- 172.21.15.1:0/546393556 wait complete. 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 Processor -- start 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 -- start start 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0102dd0 0x7f7bb0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:53.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb0112070 con 0x7f7bb0108300 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb0111ef0 con 0x7f7bb0102dd0 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.797+0000 7f7bb63f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb01121f0 con 0x7f7bb0103780 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7bb4992640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:52928/0 (socket says 172.21.15.1:52928) 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 -- 172.21.15.1:0/3663811531 learned_addr learned my addr 172.21.15.1:0/3663811531 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7bb4992640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36140/0 (socket says 172.21.15.1:36140) 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baffff640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0102dd0 0x7f7bb0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 -- 172.21.15.1:0/3663811531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0102dd0 msgr2=0x7f7bb0198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0102dd0 0x7f7bb0198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 -- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 msgr2=0x7f7bb019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:53.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7baf7fe640 1 -- 172.21.15.1:0/3663811531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb019d620 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.798+0000 7f7bb4992640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.799+0000 7f7baf7fe640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4005940 tx=0x7f7ba4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.799+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4048070 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.799+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb019d8b0 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.799+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba403ab50 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.800+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4035050 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.800+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb0100960 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.801+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb006a7b0 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.803+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7ba404b070 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.804+0000 7f7bad7fa640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 0x7f7b980a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.804+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7ba40f3000 con 0x7f7bb0103780 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.804+0000 7f7baffff640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 0x7f7b980a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:53.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.805+0000 7f7baffff640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 0x7f7b980a4f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0005fd0 tx=0x7f7ba000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:53.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:53.806+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ba40801b0 con 0x7f7bb0103780 2024-09-12T02:31:53.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:53 smithi134 ceph-mon[35091]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:31:53.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:53 smithi173 ceph-mon[35036]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:31:54.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.030+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bb01031b0 con 0x7f7bb0103780 2024-09-12T02:31:54.030 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:53 smithi001 ceph-mon[31252]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-12T02:31:54.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.031+0000 7f7bad7fa640 1 -- 172.21.15.1:0/3663811531 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f7ba40bf890 con 0x7f7bb0103780 2024-09-12T02:31:54.032 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:31:54.032 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:31:54.032 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.034+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 msgr2=0x7f7b980a4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.034+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 0x7f7b980a4f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0005fd0 tx=0x7f7ba000b390 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.034+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 msgr2=0x7f7bb0198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.034+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4005940 tx=0x7f7ba4004270 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 shutdown_connections 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7b980a2ad0 0x7f7b980a4f90 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0005fd0 tx=0x7f7ba000b390 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7bb0108300 0x7f7bb019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7bb0103780 0x7f7bb0198bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 --2- 172.21.15.1:0/3663811531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bb0102dd0 0x7f7bb0198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.035+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 >> 172.21.15.1:0/3663811531 conn(0x7f7bb00fc7d0 msgr2=0x7f7bb0105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.036+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 shutdown_connections 2024-09-12T02:31:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:54.036+0000 7f7bb63f5640 1 -- 172.21.15.1:0/3663811531 wait complete. 2024-09-12T02:31:54.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:54 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3663811531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:54.886 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T02:31:54.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:54 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3663811531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:54.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:54 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3663811531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:55.189 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:55.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 -- 172.21.15.1:0/1084651099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100de0 msgr2=0x7f353c104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 --2- 172.21.15.1:0/1084651099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100de0 0x7f353c104e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f353000aa10 tx=0x7f353002b720 comp rx=0 tx=0).stop 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 -- 172.21.15.1:0/1084651099 shutdown_connections 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 --2- 172.21.15.1:0/1084651099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100de0 0x7f353c104e30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 --2- 172.21.15.1:0/1084651099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c105560 0x7f353c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 --2- 172.21.15.1:0/1084651099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c100430 0x7f353c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 -- 172.21.15.1:0/1084651099 >> 172.21.15.1:0/1084651099 conn(0x7f353c077230 msgr2=0x7f353c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 -- 172.21.15.1:0/1084651099 shutdown_connections 2024-09-12T02:31:55.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.755+0000 7f3541471640 1 -- 172.21.15.1:0/1084651099 wait complete. 2024-09-12T02:31:55.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.756+0000 7f3541471640 1 Processor -- start 2024-09-12T02:31:55.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.756+0000 7f3541471640 1 -- start start 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 0x7f353c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c105560 0x7f353c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36162/0 (socket says 172.21.15.1:36162) 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 0x7f353c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f353affd640 1 -- 172.21.15.1:0/1946623228 learned_addr learned my addr 172.21.15.1:0/1946623228 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10fd60 con 0x7f353c100430 2024-09-12T02:31:55.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10fbe0 con 0x7f353c100de0 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10fee0 con 0x7f353c105560 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.757+0000 7f353b7fe640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c105560 0x7f353c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 -- 172.21.15.1:0/1946623228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c105560 msgr2=0x7f353c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c105560 0x7f353c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 -- 172.21.15.1:0/1946623228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 msgr2=0x7f353c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 0x7f353c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c19d440 con 0x7f353c100430 2024-09-12T02:31:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 0x7f353c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f353affd640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f352c00d950 tx=0x7f352c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f3523fff640 1 -- 172.21.15.1:0/1946623228 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c017030 con 0x7f353c100430 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f3523fff640 1 -- 172.21.15.1:0/1946623228 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f352c004020 con 0x7f353c100430 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.758+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c19d730 con 0x7f353c100430 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.759+0000 7f3523fff640 1 -- 172.21.15.1:0/1946623228 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c017030 con 0x7f353c100430 2024-09-12T02:31:55.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.759+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c195fe0 con 0x7f353c100430 2024-09-12T02:31:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.762+0000 7f3523fff640 1 -- 172.21.15.1:0/1946623228 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f352c0054e0 con 0x7f353c100430 2024-09-12T02:31:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.762+0000 7f354384a740 1 Processor -- start 2024-09-12T02:31:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.762+0000 7f354384a740 1 -- start start 2024-09-12T02:31:55.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f3523fff640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 0x7f35240a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5574228312f0 con 0x5574228cb5d0 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5574227d8cf0 con 0x5574228d6370 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f354384a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55742282d2b0 con 0x5574228ccb40 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f3523fff640 1 -- 172.21.15.1:0/1946623228 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f352c0ce5f0 con 0x7f353c100430 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353b7fe640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 0x7f35240a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40706/0 (socket says 172.21.15.1:40706) 2024-09-12T02:31:55.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.763+0000 7f353b7fe640 1 -- 172.21.15.1:0/4135612522 learned_addr learned my addr 172.21.15.1:0/4135612522 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 0x7f35240a96d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f3534009b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 -- 172.21.15.1:0/4135612522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 msgr2=0x5574228cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 -- 172.21.15.1:0/4135612522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 msgr2=0x5574228cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 -- 172.21.15.1:0/4135612522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574227bd3a0 con 0x5574228d6370 2024-09-12T02:31:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.764+0000 7f353b7fe640 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f353400fce0 tx=0x7f3534020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0097d4b1def36e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.765+0000 7f35217fa640 1 -- 172.21.15.1:0/4135612522 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534020d40 con 0x5574228d6370 2024-09-12T02:31:55.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.765+0000 7f35217fa640 1 -- 172.21.15.1:0/4135612522 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3534024070 con 0x5574228d6370 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 -- 172.21.15.1:0/4135612522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 msgr2=0x5574228d8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f353400fce0 tx=0x7f3534020000 comp rx=0 tx=0).stop 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f35217fa640 1 -- 172.21.15.1:0/4135612522 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534004290 con 0x5574228d6370 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 -- 172.21.15.1:0/4135612522 shutdown_connections 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d8760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 --2- 172.21.15.1:0/4135612522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 -- 172.21.15.1:0/4135612522 >> 172.21.15.1:0/4135612522 conn(0x557422894310 msgr2=0x5574228c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 -- 172.21.15.1:0/4135612522 shutdown_connections 2024-09-12T02:31:55.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.766+0000 7f354384a740 1 -- 172.21.15.1:0/4135612522 wait complete. 2024-09-12T02:31:55.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 -- start start 2024-09-12T02:31:55.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 Processor -- start 2024-09-12T02:31:55.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228cb5d0 0x5574228d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228ccb40 0x5574228d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5574228d9060 con 0x5574228ccb40 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5574227ec060 con 0x5574228cb5d0 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f354384a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5574228d91e0 con 0x5574228d6370 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f353b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:52972/0 (socket says 172.21.15.1:52972) 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f353b7fe640 1 -- 172.21.15.1:0/3395492559 learned_addr learned my addr 172.21.15.1:0/3395492559 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f353a7fc640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228ccb40 0x5574228d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.767+0000 7f353affd640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228cb5d0 0x5574228d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f354384a740 10 client.0 _ll_register_callbacks cb 0x55742253f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:55.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 -- 172.21.15.1:0/3395492559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228cb5d0 msgr2=0x5574228d5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228cb5d0 0x5574228d5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 -- 172.21.15.1:0/3395492559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228ccb40 msgr2=0x5574228d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228ccb40 0x5574228d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 -- 172.21.15.1:0/3395492559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574225a23c0 con 0x5574228d6370 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f353b7fe640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3534013240 tx=0x7f353400ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6fe604770d02a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f351eff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400fa40 con 0x5574228d6370 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3534024070 con 0x5574228d6370 2024-09-12T02:31:55.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.768+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3534005250 con 0x5574228d6370 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.769+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3534005450 con 0x5574228d6370 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.769+0000 7f354384a740 10 client.25204 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.769+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574228ed270 con 0x5574228d6370 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.769+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3534024070 con 0x5574228d6370 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f353401f070 con 0x5574228d6370 2024-09-12T02:31:55.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 10 client.25204 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 10 client.25204 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 20 client.25204 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228ee620 0x5574228f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 4 client.25204 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.770+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55742283e860 con 0x5574228ee620 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.771+0000 7f353affd640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228ee620 0x5574228f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.771+0000 7f353affd640 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228ee620 0x5574228f0a10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aac063784e85e506 server_cookie=78d8087dfaccb29f in_seq=0 out_seq=0 2024-09-12T02:31:55.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.771+0000 7f351eff5640 10 client.25204 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:55.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f351eff5640 1 -- 172.21.15.1:0/3395492559 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55742283e860 con 0x5574228ee620 2024-09-12T02:31:55.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f351eff5640 10 client.25204 handle_command_reply: tid=0 2024-09-12T02:31:55.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 client.25204 shutdown 2024-09-12T02:31:55.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 msgr2=0x5574228d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3534013240 tx=0x7f353400ff70 comp rx=0 tx=0).stop 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 shutdown_connections 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228ee620 0x5574228f0a10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228ccb40 0x5574228d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228d3440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 --2- 172.21.15.1:0/3395492559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228cb5d0 0x5574228d5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f351eff5640 0 client.25204 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 >> 172.21.15.1:0/3395492559 conn(0x557422894310 msgr2=0x5574228cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 shutdown_connections 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 1 -- 172.21.15.1:0/3395492559 wait complete. 2024-09-12T02:31:55.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.774+0000 7f354384a740 20 client.25204 trim_cache size 0 max 16384 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 Processor -- start 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 -- start start 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228f6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f352800e5a0 con 0x5574228cb5d0 2024-09-12T02:31:55.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f35280100e0 con 0x5574228d6370 2024-09-12T02:31:55.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f354384a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f352800ec70 con 0x5574228ccb40 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36194/0 (socket says 172.21.15.1:36194) 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f353affd640 1 -- 172.21.15.1:0/3693571023 learned_addr learned my addr 172.21.15.1:0/3693571023 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f353b7fe640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.788+0000 7f353a7fc640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 -- 172.21.15.1:0/3693571023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 msgr2=0x5574228f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 -- 172.21.15.1:0/3693571023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 msgr2=0x5574228d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 -- 172.21.15.1:0/3693571023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574228d4370 con 0x5574228cb5d0 2024-09-12T02:31:55.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353b7fe640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:55.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f353affd640 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f352c009610 tx=0x7f352c097120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45508b8040ac20b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f3520ff9640 1 -- 172.21.15.1:0/3693571023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c09f180 con 0x5574228cb5d0 2024-09-12T02:31:55.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f3520ff9640 1 -- 172.21.15.1:0/3693571023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f352c0a3a40 con 0x5574228cb5d0 2024-09-12T02:31:55.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.789+0000 7f3520ff9640 1 -- 172.21.15.1:0/3693571023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c0a35b0 con 0x5574228cb5d0 2024-09-12T02:31:55.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 -- 172.21.15.1:0/3693571023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 msgr2=0x5574228f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f352c009610 tx=0x7f352c097120 comp rx=0 tx=0).stop 2024-09-12T02:31:55.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 -- 172.21.15.1:0/3693571023 shutdown_connections 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228d6370 0x5574228d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228ccb40 0x5574228f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 --2- 172.21.15.1:0/3693571023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228f6040 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 -- 172.21.15.1:0/3693571023 >> 172.21.15.1:0/3693571023 conn(0x557422894310 msgr2=0x5574228d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 -- 172.21.15.1:0/3693571023 shutdown_connections 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.790+0000 7f354384a740 1 -- 172.21.15.1:0/3693571023 wait complete. 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 -- start start 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 Processor -- start 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 0x5574228e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228e3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f352800fa10 con 0x5574228cb5d0 2024-09-12T02:31:55.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f352800f340 con 0x5574228ccb40 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f352800c580 con 0x5574228d6370 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f354384a740 10 client.0 _ll_register_callbacks cb 0x7f353000a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f353affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36210/0 (socket says 172.21.15.1:36210) 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.791+0000 7f353affd640 1 -- 172.21.15.1:0/1325722235 learned_addr learned my addr 172.21.15.1:0/1325722235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:55.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353b7fe640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 0x5574228e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 -- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 msgr2=0x5574228e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228e3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 -- 172.21.15.1:0/1325722235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 msgr2=0x5574228e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 0x5574228e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 -- 172.21.15.1:0/1325722235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574229691c0 con 0x5574228cb5d0 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 0x5574228e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f353affd640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f352c0a3510 tx=0x7f352c0b3fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f3064e3c7d1c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f351eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:55.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c097440 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f352c0a35b0 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f352c0a3a40 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f352c0975e0 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f354384a740 10 client.15699 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.792+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574228d9560 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f352c07e070 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f352c0b0070 con 0x5574228cb5d0 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 10 client.15699 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 10 client.15699 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 20 client.15699 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228d9a20 0x5574228dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:55.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 4 client.15699 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f352c0a3a40 con 0x5574228d9a20 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.793+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228d9a20 0x5574228dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f353a7fc640 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228d9a20 0x5574228dbe40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=866df623a0bfa632 server_cookie=f4007951463b927b in_seq=0 out_seq=0 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f351eff5640 10 client.15699 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f351eff5640 1 -- 172.21.15.1:0/1325722235 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f352c0a3a40 con 0x5574228d9a20 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f351eff5640 10 client.15699 handle_command_reply: tid=0 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 client.15699 shutdown 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 msgr2=0x5574228e2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f352c0a3510 tx=0x7f352c0b3fd0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 shutdown_connections 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5574228d9a20 0x5574228dbe40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5574228d6370 0x5574228e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574228ccb40 0x5574228e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 --2- 172.21.15.1:0/1325722235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5574228cb5d0 0x5574228e2c90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 >> 172.21.15.1:0/1325722235 conn(0x557422894310 msgr2=0x5574228c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f351eff5640 0 client.15699 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 shutdown_connections 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 1 -- 172.21.15.1:0/1325722235 wait complete. 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.794+0000 7f354384a740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 msgr2=0x7f35240a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 0x7f35240a96d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f3534009b00 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 msgr2=0x7f353c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f352c00d950 tx=0x7f352c00de10 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 shutdown_connections 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35240a7210 0x7f35240a96d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f353c105560 0x7f353c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f353c100de0 0x7f353c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 --2- 172.21.15.1:0/1946623228 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f353c100430 0x7f353c198490 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:55.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 >> 172.21.15.1:0/1946623228 conn(0x7f353c077230 msgr2=0x7f353c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:55.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 shutdown_connections 2024-09-12T02:31:55.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:55.795+0000 7f3541471640 1 -- 172.21.15.1:0/1946623228 wait complete. 2024-09-12T02:31:55.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:55 smithi134 ceph-mon[35091]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-12T02:31:55.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:55 smithi173 ceph-mon[35036]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-12T02:31:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:55 smithi001 ceph-mon[31252]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-12T02:31:56.691 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T02:31:57.008 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:57.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.597+0000 7f7eeed16640 1 -- 172.21.15.1:0/1283164427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8106a60 msgr2=0x7f7ee8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.597+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1283164427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8106a60 0x7f7ee8106e40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009930 tx=0x7f7edc02a420 comp rx=0 tx=0).stop 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.597+0000 7f7eeed16640 1 -- 172.21.15.1:0/1283164427 shutdown_connections 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.597+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1283164427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8101400 0x7f7ee810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.598+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1283164427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8100a60 0x7f7ee8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.598+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1283164427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8106a60 0x7f7ee8106e40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.598+0000 7f7eeed16640 1 -- 172.21.15.1:0/1283164427 >> 172.21.15.1:0/1283164427 conn(0x7f7ee80fc780 msgr2=0x7f7ee80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.598+0000 7f7eeed16640 1 -- 172.21.15.1:0/1283164427 shutdown_connections 2024-09-12T02:31:57.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.598+0000 7f7eeed16640 1 -- 172.21.15.1:0/1283164427 wait complete. 2024-09-12T02:31:57.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.599+0000 7f7eeed16640 1 Processor -- start 2024-09-12T02:31:57.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.599+0000 7f7eeed16640 1 -- start start 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7eeed16640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 0x7f7ee8196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7eeed16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36232/0 (socket says 172.21.15.1:36232) 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7eecab2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 0x7f7ee8196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7eecab2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 0x7f7ee8196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:53014/0 (socket says 172.21.15.1:53014) 2024-09-12T02:31:57.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7eeed16640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 0x7f7ee819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.600+0000 7f7ee7fff640 1 -- 172.21.15.1:0/1533444389 learned_addr learned my addr 172.21.15.1:0/1533444389 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:57.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee810fdb0 con 0x7f7ee8101400 2024-09-12T02:31:57.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee810fc30 con 0x7f7ee8106a60 2024-09-12T02:31:57.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee810ff30 con 0x7f7ee8100a60 2024-09-12T02:31:57.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 0x7f7ee819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 -- 172.21.15.1:0/1533444389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 msgr2=0x7f7ee8196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 0x7f7ee8196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 -- 172.21.15.1:0/1533444389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 msgr2=0x7f7ee819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 0x7f7ee819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee819b210 con 0x7f7ee8101400 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 0x7f7ee819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.601+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009be0 tx=0x7f7ed40071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.602+0000 7f7ee5ffb640 1 -- 172.21.15.1:0/1533444389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007e00 con 0x7f7ee8101400 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.602+0000 7f7ee5ffb640 1 -- 172.21.15.1:0/1533444389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed401e070 con 0x7f7ee8101400 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.602+0000 7f7ee5ffb640 1 -- 172.21.15.1:0/1533444389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4018890 con 0x7f7ee8101400 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.602+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee819b500 con 0x7f7ee8101400 2024-09-12T02:31:57.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.602+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee81a2de0 con 0x7f7ee8101400 2024-09-12T02:31:57.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 Processor -- start 2024-09-12T02:31:57.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 -- start start 2024-09-12T02:31:57.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd0492a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560fd03f82f0 con 0x560fd04a5b80 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fd039fcf0 con 0x560fd04925d0 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560fd03f42b0 con 0x560fd0493b40 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.606+0000 7f7ee5ffb640 1 -- 172.21.15.1:0/1533444389 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7ed4019b60 con 0x7f7ee8101400 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.607+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.607+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:53018/0 (socket says 172.21.15.1:53018) 2024-09-12T02:31:57.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.607+0000 7f7eed2b3640 1 -- 172.21.15.1:0/566224105 learned_addr learned my addr 172.21.15.1:0/566224105 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:57.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.607+0000 7f7eecab2640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd0492a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.607+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7ee5ffb640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 0x7f7ed80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 -- 172.21.15.1:0/566224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 msgr2=0x560fd0492a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd0492a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 -- 172.21.15.1:0/566224105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 msgr2=0x560fd04a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 -- 172.21.15.1:0/566224105 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd03843a0 con 0x560fd0493b40 2024-09-12T02:31:57.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eecab2640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd0492a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 0x7f7ed80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.608+0000 7f7ee5ffb640 1 -- 172.21.15.1:0/1533444389 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7ed40ce190 con 0x7f7ee8101400 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.609+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a380 tx=0x7f7ee000a840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960ce5ef79666b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.609+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 0x7f7ed80a5250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0020000 tx=0x7f7ee001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.609+0000 7f7ed2ffd640 1 -- 172.21.15.1:0/566224105 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00174f0 con 0x560fd0493b40 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.609+0000 7f7ed2ffd640 1 -- 172.21.15.1:0/566224105 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ee0017b70 con 0x560fd0493b40 2024-09-12T02:31:57.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.609+0000 7f7ed2ffd640 1 -- 172.21.15.1:0/566224105 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0023bb0 con 0x560fd0493b40 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 -- 172.21.15.1:0/566224105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 msgr2=0x560fd0492090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a380 tx=0x7f7ee000a840 comp rx=0 tx=0).stop 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 -- 172.21.15.1:0/566224105 shutdown_connections 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd0492a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/566224105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd0492090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 -- 172.21.15.1:0/566224105 >> 172.21.15.1:0/566224105 conn(0x560fd045b310 msgr2=0x560fd048ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 -- 172.21.15.1:0/566224105 shutdown_connections 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.610+0000 7f7ef10ef740 1 -- 172.21.15.1:0/566224105 wait complete. 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.611+0000 7f7ef10ef740 1 -- start start 2024-09-12T02:31:57.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.611+0000 7f7ef10ef740 1 Processor -- start 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.611+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.611+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd0493b40 0x560fd04a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.611+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 0x560fd04a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560fd04a8880 con 0x560fd04925d0 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560fd03b3060 con 0x560fd0493b40 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560fd04a8a00 con 0x560fd04a5b80 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7ef10ef740 10 client.0 _ll_register_callbacks cb 0x560fd01068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:57.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eecab2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eecab2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36244/0 (socket says 172.21.15.1:36244) 2024-09-12T02:31:57.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eecab2640 1 -- 172.21.15.1:0/1582837408 learned_addr learned my addr 172.21.15.1:0/1582837408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:57.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 0x560fd04a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd0493b40 0x560fd04a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 -- 172.21.15.1:0/1582837408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd0493b40 msgr2=0x560fd04a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd0493b40 0x560fd04a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 -- 172.21.15.1:0/1582837408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 msgr2=0x560fd04a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.612+0000 7f7eed2b3640 1 -- 172.21.15.1:0/1582837408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd01693c0 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 0x560fd04a2ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000afd0 tx=0x7f7ee0017f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e716f3838b41ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ec7fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000bc00 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7ee0017700 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee0017b70 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ee0017900 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ef10ef740 10 client.25222 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560fd04b4360 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.613+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ee0017b70 con 0x560fd04a5b80 2024-09-12T02:31:57.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ee002b4e0 con 0x560fd04a5b80 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 10 client.25222 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 10 client.25222 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 20 client.25222 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd04b57c0 0x560fd04b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 4 client.25222 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fd0405860 con 0x560fd04b57c0 2024-09-12T02:31:57.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.614+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd04b57c0 0x560fd04b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.615+0000 7f7ec7fff640 10 client.25222 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:57.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.615+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd04b57c0 0x560fd04b7bb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=10e1a2de579142c9 server_cookie=81ac214e90cf1cbf in_seq=0 out_seq=0 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.615+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1582837408 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fd0405860 con 0x560fd04b57c0 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.615+0000 7f7ec7fff640 10 client.25222 handle_command_reply: tid=0 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 client.25222 shutdown 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 msgr2=0x560fd04a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 0x560fd04a2ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000afd0 tx=0x7f7ee0017f50 comp rx=0 tx=0).stop 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 shutdown_connections 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd04b57c0 0x560fd04b7bb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd04a5b80 0x560fd04a2ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd0493b40 0x560fd04a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1582837408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04925d0 0x560fd04a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 >> 172.21.15.1:0/1582837408 conn(0x560fd045b310 msgr2=0x560fd0494960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ec7fff640 0 client.25222 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 shutdown_connections 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1582837408 wait complete. 2024-09-12T02:31:57.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.616+0000 7f7ef10ef740 20 client.25222 trim_cache size 0 max 16384 2024-09-12T02:31:57.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 Processor -- start 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 -- start start 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04bd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81ab4b0 con 0x560fd04a5b80 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81acff0 con 0x560fd04925d0 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81abb80 con 0x560fd0493b40 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04bd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36256/0 (socket says 172.21.15.1:36256) 2024-09-12T02:31:57.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.642+0000 7f7eed2b3640 1 -- 172.21.15.1:0/2406382845 learned_addr learned my addr 172.21.15.1:0/2406382845 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7eecab2640 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 -- 172.21.15.1:0/2406382845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 msgr2=0x560fd04a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 -- 172.21.15.1:0/2406382845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 msgr2=0x560fd04bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04bd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 -- 172.21.15.1:0/2406382845 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd0495120 con 0x560fd0493b40 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7eecab2640 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04b1b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40cbbe0 tx=0x7f7ed409b150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33966438deecea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ed27fc640 1 -- 172.21.15.1:0/2406382845 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed409f480 con 0x560fd0493b40 2024-09-12T02:31:57.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ed27fc640 1 -- 172.21.15.1:0/2406382845 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed409ed80 con 0x560fd0493b40 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.643+0000 7f7ed27fc640 1 -- 172.21.15.1:0/2406382845 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40a77c0 con 0x560fd0493b40 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 -- 172.21.15.1:0/2406382845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 msgr2=0x560fd04b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04b1b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40cbbe0 tx=0x7f7ed409b150 comp rx=0 tx=0).stop 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 -- 172.21.15.1:0/2406382845 shutdown_connections 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd04bd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04b1b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/2406382845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 -- 172.21.15.1:0/2406382845 >> 172.21.15.1:0/2406382845 conn(0x560fd045b310 msgr2=0x560fd04a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 -- 172.21.15.1:0/2406382845 shutdown_connections 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.644+0000 7f7ef10ef740 1 -- 172.21.15.1:0/2406382845 wait complete. 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 -- start start 2024-09-12T02:31:57.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 Processor -- start 2024-09-12T02:31:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81ac920 con 0x560fd04a5b80 2024-09-12T02:31:57.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81ac250 con 0x560fd04925d0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81a9490 con 0x560fd0493b40 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.645+0000 7f7ef10ef740 10 client.0 _ll_register_callbacks cb 0x7f7ed409b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eed2b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36266/0 (socket says 172.21.15.1:36266) 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eed2b3640 1 -- 172.21.15.1:0/1356325867 learned_addr learned my addr 172.21.15.1:0/1356325867 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 -- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 msgr2=0x560fd04ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 -- 172.21.15.1:0/1356325867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 msgr2=0x560fd049eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 -- 172.21.15.1:0/1356325867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd04ae8c0 con 0x560fd04925d0 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eed2b3640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:57.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.646+0000 7f7eecab2640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04adc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7edc005ab0 tx=0x7f7edc004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de5674468293dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ec7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc04a070 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed409ed80 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7edc005450 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7edc035040 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ef10ef740 10 client.25244 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.647+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560fd051f8d0 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc004ba0 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7edc04d030 con 0x560fd04925d0 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 10 client.25244 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 10 client.25244 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:31:57.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 20 client.25244 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd051fff0 0x560fd0522410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 4 client.25244 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7ed409ed80 con 0x560fd051fff0 2024-09-12T02:31:57.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd051fff0 0x560fd0522410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ec7fff640 10 client.25244 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.648+0000 7f7ee7fff640 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd051fff0 0x560fd0522410 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2950209771d79ff8 server_cookie=84e482aed8ef65cc in_seq=0 out_seq=0 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ec7fff640 1 -- 172.21.15.1:0/1356325867 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7ed409ed80 con 0x560fd051fff0 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ec7fff640 10 client.25244 handle_command_reply: tid=0 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 client.25244 shutdown 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 msgr2=0x560fd04adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04adc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7edc005ab0 tx=0x7f7edc004300 comp rx=0 tx=0).stop 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 shutdown_connections 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x560fd051fff0 0x560fd0522410 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ec7fff640 0 client.25244 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:31:57.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560fd04a5b80 0x560fd049eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560fd0493b40 0x560fd04ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 --2- 172.21.15.1:0/1356325867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560fd04925d0 0x560fd04adc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 >> 172.21.15.1:0/1356325867 conn(0x560fd045b310 msgr2=0x560fd04a40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 shutdown_connections 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 1 -- 172.21.15.1:0/1356325867 wait complete. 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.649+0000 7f7ef10ef740 20 client.25244 trim_cache size 0 max 16384 2024-09-12T02:31:57.653 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 msgr2=0x7f7ed80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 0x7f7ed80a5250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0020000 tx=0x7f7ee001d000 comp rx=0 tx=0).stop 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 msgr2=0x7f7ee81967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009be0 tx=0x7f7ed40071c0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 shutdown_connections 2024-09-12T02:31:57.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.650+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ed80a2d90 0x7f7ed80a5250 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ee8101400 0x7f7ee81967a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ee8106a60 0x7f7ee819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 --2- 172.21.15.1:0/1533444389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ee8100a60 0x7f7ee8196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 >> 172.21.15.1:0/1533444389 conn(0x7f7ee80fc780 msgr2=0x7f7ee80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 shutdown_connections 2024-09-12T02:31:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:57.651+0000 7f7eeed16640 1 -- 172.21.15.1:0/1533444389 wait complete. 2024-09-12T02:31:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:57 smithi001 ceph-mon[31252]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T02:31:57.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:57 smithi173 ceph-mon[35036]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T02:31:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:57 smithi134 ceph-mon[35091]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T02:31:58.473 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:31:58.793 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 -- 172.21.15.1:0/1001972656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20102d30 msgr2=0x7f2a20103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 --2- 172.21.15.1:0/1001972656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20102d30 0x7f2a20103110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009930 tx=0x7f2a1002a420 comp rx=0 tx=0).stop 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 -- 172.21.15.1:0/1001972656 shutdown_connections 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 --2- 172.21.15.1:0/1001972656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 --2- 172.21.15.1:0/1001972656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a201036e0 0x7f2a20107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 --2- 172.21.15.1:0/1001972656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a20102d30 0x7f2a20103110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 -- 172.21.15.1:0/1001972656 >> 172.21.15.1:0/1001972656 conn(0x7f2a200fc7d0 msgr2=0x7f2a200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 -- 172.21.15.1:0/1001972656 shutdown_connections 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.342+0000 7f2a25e16640 1 -- 172.21.15.1:0/1001972656 wait complete. 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.343+0000 7f2a25e16640 1 Processor -- start 2024-09-12T02:31:59.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.343+0000 7f2a25e16640 1 -- start start 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.343+0000 7f2a25e16640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 0x7f2a201985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.343+0000 7f2a25e16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a201036e0 0x7f2a20198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.343+0000 7f2a25e16640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a25e16640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201120a0 con 0x7f2a201036e0 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a25e16640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20111f20 con 0x7f2a201082a0 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a25e16640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20112220 con 0x7f2a20102d30 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40798/0 (socket says 172.21.15.1:40798) 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 0x7f2a201985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1ffff640 1 -- 172.21.15.1:0/3842850237 learned_addr learned my addr 172.21.15.1:0/3842850237 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1effd640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a201036e0 0x7f2a20198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/3842850237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 msgr2=0x7f2a2019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a201036e0 msgr2=0x7f2a20198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a201036e0 0x7f2a20198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1f7fe640 1 -- 172.21.15.1:0/3842850237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2019d590 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.344+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 0x7f2a201985e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a10005940 tx=0x7f2a100042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a1cff9640 1 -- 172.21.15.1:0/3842850237 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1003f070 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2019d820 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a1cff9640 1 -- 172.21.15.1:0/3842850237 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a1003b460 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a1cff9640 1 -- 172.21.15.1:0/3842850237 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10035070 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.345+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201008c0 con 0x7f2a20102d30 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 Processor -- start 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 -- start start 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 0x55c1a7467a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 0x55c1a747cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c1a73cd2f0 con 0x55c1a7468b40 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1a7374cf0 con 0x55c1a747ab80 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a281ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c1a73c92b0 con 0x55c1a74675d0 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a1cff9640 1 -- 172.21.15.1:0/3842850237 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2a1003b610 con 0x7f2a20102d30 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.348+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36306/0 (socket says 172.21.15.1:36306) 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1350496091 learned_addr learned my addr 172.21.15.1:0/1350496091 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1effd640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 0x55c1a747cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1350496091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 msgr2=0x55c1a7467a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 0x55c1a7467a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 0x55c1a7467a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1350496091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 msgr2=0x55c1a747cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 0x55c1a747cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 -- 172.21.15.1:0/1350496091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a73593a0 con 0x55c1a7468b40 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1effd640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 0x55c1a747cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 0x55c1a7467a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.349+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2a18011780 tx=0x7f2a18011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea19aa86cdb1e0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/1350496091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800fb40 con 0x55c1a7468b40 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/1350496091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a18011e90 con 0x55c1a7468b40 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a05ffb640 1 -- 172.21.15.1:0/1350496091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1801a650 con 0x55c1a7468b40 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a1cff9640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 0x7f2a080a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a1cff9640 1 -- 172.21.15.1:0/3842850237 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a100ef4e0 con 0x7f2a20102d30 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.350+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 0x7f2a080a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 -- 172.21.15.1:0/1350496091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 msgr2=0x55c1a7467090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2a18011780 tx=0x7f2a18011c40 comp rx=0 tx=0).stop 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 -- 172.21.15.1:0/1350496091 shutdown_connections 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a747ab80 0x55c1a747cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a74675d0 0x55c1a7467a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 --2- 172.21.15.1:0/1350496091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a7467090 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 -- 172.21.15.1:0/1350496091 >> 172.21.15.1:0/1350496091 conn(0x55c1a7430310 msgr2=0x55c1a7463c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 -- 172.21.15.1:0/1350496091 shutdown_connections 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a281ef740 1 -- 172.21.15.1:0/1350496091 wait complete. 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.351+0000 7f2a1f7fe640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 0x7f2a080a5140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c4400 tx=0x7f2a1002a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.352+0000 7f2a281ef740 1 -- start start 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.352+0000 7f2a281ef740 1 Processor -- start 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a74675d0 0x55c1a747a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a7477e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c1a747d880 con 0x55c1a7468b40 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1a7388060 con 0x55c1a74675d0 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c1a747da00 con 0x55c1a747ab80 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36308/0 (socket says 172.21.15.1:36308) 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 -- 172.21.15.1:0/3069948103 learned_addr learned my addr 172.21.15.1:0/3069948103 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a281ef740 10 client.0 _ll_register_callbacks cb 0x55c1a70db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 -- 172.21.15.1:0/3069948103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 msgr2=0x55c1a7477e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a7477e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 -- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a74675d0 msgr2=0x55c1a747a4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a74675d0 0x55c1a747a4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 -- 172.21.15.1:0/3069948103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a713e3c0 con 0x55c1a7468b40 2024-09-12T02:31:59.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f2a1effd640 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400feb0 tx=0x7f2a1400d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da038f8dd780992a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.353+0000 7f29feffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1401e060 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a14004460 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a18011e90 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a140035f0 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f2a281ef740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1a74892b0 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a18011e90 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.354+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a140249a0 con 0x55c1a7468b40 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 10 client.15729 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 20 client.15729 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:59.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a748cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 4 client.15729 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1a73da860 con 0x55c1a748a770 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a748cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a748cc00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=894ecd6303e36001 server_cookie=941b504c49febf14 in_seq=0 out_seq=0 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.355+0000 7f29feffd640 10 client.15729 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.356+0000 7f29feffd640 1 -- 172.21.15.1:0/3069948103 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1a73da860 con 0x55c1a748a770 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.356+0000 7f29feffd640 10 client.15729 handle_command_reply: tid=0 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.356+0000 7f2a281ef740 1 client.15729 shutdown 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.356+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 msgr2=0x55c1a74777f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.356+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400feb0 tx=0x7f2a1400d6b0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 shutdown_connections 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a7468b40 0x55c1a74777f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a748cc00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a7477e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f29feffd640 0 client.15729 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 --2- 172.21.15.1:0/3069948103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a74675d0 0x55c1a747a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 >> 172.21.15.1:0/3069948103 conn(0x55c1a7430310 msgr2=0x55c1a7469930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 shutdown_connections 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 1 -- 172.21.15.1:0/3069948103 wait complete. 2024-09-12T02:31:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.357+0000 7f2a281ef740 20 client.15729 trim_cache size 0 max 16384 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.370+0000 7f2a281ef740 1 Processor -- start 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.370+0000 7f2a281ef740 1 -- start start 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.370+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.370+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7486b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a74924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a281ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ab470 con 0x55c1a74675d0 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a281ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201acfb0 con 0x55c1a7468b40 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a281ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201abb40 con 0x55c1a747ab80 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36314/0 (socket says 172.21.15.1:36314) 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7486b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1ffff640 1 -- 172.21.15.1:0/805946765 learned_addr learned my addr 172.21.15.1:0/805946765 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 -- 172.21.15.1:0/805946765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 msgr2=0x55c1a74924d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a74924d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 -- 172.21.15.1:0/805946765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 msgr2=0x55c1a7463e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1effd640 1 -- 172.21.15.1:0/805946765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a74634f0 con 0x55c1a7468b40 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.371+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.372+0000 7f2a1effd640 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7486b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55c1a7478da0 tx=0x7f2a1400dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b4690087e1c66c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.372+0000 7f2a057fa640 1 -- 172.21.15.1:0/805946765 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14031070 con 0x55c1a7468b40 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.372+0000 7f2a057fa640 1 -- 172.21.15.1:0/805946765 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a14018d90 con 0x55c1a7468b40 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.372+0000 7f2a057fa640 1 -- 172.21.15.1:0/805946765 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14003d00 con 0x55c1a7468b40 2024-09-12T02:31:59.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- 172.21.15.1:0/805946765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 msgr2=0x55c1a7486b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7486b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55c1a7478da0 tx=0x7f2a1400dee0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- 172.21.15.1:0/805946765 shutdown_connections 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a74924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7486b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 --2- 172.21.15.1:0/805946765 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7463e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- 172.21.15.1:0/805946765 >> 172.21.15.1:0/805946765 conn(0x55c1a7430310 msgr2=0x55c1a7463700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- 172.21.15.1:0/805946765 shutdown_connections 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- 172.21.15.1:0/805946765 wait complete. 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 -- start start 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.373+0000 7f2a281ef740 1 Processor -- start 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a747fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ac8e0 con 0x55c1a74675d0 2024-09-12T02:31:59.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201ac210 con 0x55c1a7468b40 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201a9450 con 0x55c1a747ab80 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a281ef740 10 client.0 _ll_register_callbacks cb 0x7f2a1400fb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36324/0 (socket says 172.21.15.1:36324) 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40828/0 (socket says 172.21.15.1:40828) 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1ffff640 1 -- 172.21.15.1:0/514154475 learned_addr learned my addr 172.21.15.1:0/514154475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 -- 172.21.15.1:0/514154475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 msgr2=0x55c1a747fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a747fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 -- 172.21.15.1:0/514154475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 msgr2=0x55c1a7482cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.374+0000 7f2a1effd640 1 -- 172.21.15.1:0/514154475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a74801d0 con 0x55c1a7468b40 2024-09-12T02:31:59.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f2a1effd640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c1a747d2b0 tx=0x7f2a14018f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8128192adaa777f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f29feffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1401e070 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2a14003c40 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a14018d90 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a14031040 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f2a281ef740 10 client.25259 fetch_fsmap learned FSMap version 28 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1a74f5c90 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.375+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a14018d90 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.376+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a14024400 con 0x55c1a7468b40 2024-09-12T02:31:59.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 10 client.25259 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 10 client.25259 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 20 client.25259 populate_metadata read hostname 'smithi001' 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a74f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 4 client.25259 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1a73d4d70 con 0x55c1a748a770 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a74f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f2a1ffff640 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a74f8300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2be6e3a057399e3a server_cookie=7e35d71588a23811 in_seq=0 out_seq=0 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.377+0000 7f29feffd640 10 client.25259 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f29feffd640 1 -- 172.21.15.1:0/514154475 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1a73d4d70 con 0x55c1a748a770 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f29feffd640 10 client.25259 handle_command_reply: tid=0 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 client.25259 shutdown 2024-09-12T02:31:59.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 msgr2=0x55c1a7483200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c1a747d2b0 tx=0x7f2a14018f40 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 shutdown_connections 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x55c1a748a770 0x55c1a74f8300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f29feffd640 0 client.25259 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1a747ab80 0x55c1a747fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1a7468b40 0x55c1a7483200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 --2- 172.21.15.1:0/514154475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1a74675d0 0x55c1a7482cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 >> 172.21.15.1:0/514154475 conn(0x55c1a7430310 msgr2=0x55c1a7479050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 shutdown_connections 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 1 -- 172.21.15.1:0/514154475 wait complete. 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.378+0000 7f2a281ef740 20 client.25259 trim_cache size 0 max 16384 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 msgr2=0x7f2a080a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 0x7f2a080a5140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c4400 tx=0x7f2a1002a420 comp rx=0 tx=0).stop 2024-09-12T02:31:59.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 msgr2=0x7f2a201985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 0x7f2a201985e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a10005940 tx=0x7f2a100042f0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 shutdown_connections 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2a080a2c80 0x7f2a080a5140 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a201036e0 0x7f2a20198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a201082a0 0x7f2a2019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 --2- 172.21.15.1:0/3842850237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a20102d30 0x7f2a201985e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 >> 172.21.15.1:0/3842850237 conn(0x7f2a200fc7d0 msgr2=0x7f2a20105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 shutdown_connections 2024-09-12T02:31:59.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:31:59.379+0000 7f2a25e16640 1 -- 172.21.15.1:0/3842850237 wait complete. 2024-09-12T02:31:59.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:31:59 smithi173 ceph-mon[35036]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:31:59.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:31:59 smithi001 ceph-mon[31252]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:32:00.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:32:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:31:59 smithi134 ceph-mon[35091]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:32:00.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:32:00.419 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/3930821693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 msgr2=0x7f2f88100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/3930821693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88100810 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800aa10 tx=0x7f2f7802b720 comp rx=0 tx=0).stop 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/3930821693 shutdown_connections 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/3930821693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88105560 0x7f2f8810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/3930821693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88100de0 0x7f2f88104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/3930821693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88100810 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.987+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/3930821693 >> 172.21.15.1:0/3930821693 conn(0x7f2f88077230 msgr2=0x7f2f880fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.988+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/3930821693 shutdown_connections 2024-09-12T02:32:00.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.988+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/3930821693 wait complete. 2024-09-12T02:32:00.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.988+0000 7f2f8ea2d640 1 Processor -- start 2024-09-12T02:32:00.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.988+0000 7f2f8ea2d640 1 -- start start 2024-09-12T02:32:00.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 0x7f2f88196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88105560 0x7f2f8819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8810fd60 con 0x7f2f88100430 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8810fbe0 con 0x7f2f88105560 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f8ea2d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8810fee0 con 0x7f2f88100de0 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36352/0 (socket says 172.21.15.1:36352) 2024-09-12T02:32:00.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f87fff640 1 -- 172.21.15.1:0/1114184188 learned_addr learned my addr 172.21.15.1:0/1114184188 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.989+0000 7f2f877fe640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 0x7f2f88196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88105560 0x7f2f8819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 -- 172.21.15.1:0/1114184188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 msgr2=0x7f2f88196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 0x7f2f88196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 -- 172.21.15.1:0/1114184188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88105560 msgr2=0x7f2f8819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88105560 0x7f2f8819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 -- 172.21.15.1:0/1114184188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8819aff0 con 0x7f2f88100430 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f87fff640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800a960 tx=0x7f2f78033a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f877fe640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 0x7f2f88196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:00.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.990+0000 7f2f857fa640 1 -- 172.21.15.1:0/1114184188 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7803f070 con 0x7f2f88100430 2024-09-12T02:32:00.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.991+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8819b280 con 0x7f2f88100430 2024-09-12T02:32:00.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.991+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a2bc0 con 0x7f2f88100430 2024-09-12T02:32:00.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.991+0000 7f2f857fa640 1 -- 172.21.15.1:0/1114184188 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f78004250 con 0x7f2f88100430 2024-09-12T02:32:00.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.991+0000 7f2f857fa640 1 -- 172.21.15.1:0/1114184188 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78036040 con 0x7f2f88100430 2024-09-12T02:32:00.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.994+0000 7f2f90e06740 1 Processor -- start 2024-09-12T02:32:00.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 -- start start 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b4446232f0 con 0x55b4446bd5d0 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b4445cacf0 con 0x55b4446beb40 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f90e06740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b44461f2b0 con 0x55b4446d0b80 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40848/0 (socket says 172.21.15.1:40848) 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f8cfca640 1 -- 172.21.15.1:0/2606905083 learned_addr learned my addr 172.21.15.1:0/2606905083 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.995+0000 7f2f877fe640 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f857fa640 1 -- 172.21.15.1:0/1114184188 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2f78042070 con 0x7f2f88100430 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f87fff640 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f8cfca640 1 -- 172.21.15.1:0/2606905083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 msgr2=0x55b4446d2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f8cfca640 1 -- 172.21.15.1:0/2606905083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 msgr2=0x55b4446bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446bda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.996+0000 7f2f8cfca640 1 -- 172.21.15.1:0/2606905083 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4445af3a0 con 0x55b4446beb40 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.997+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009d70 tx=0x7f2f8000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30ae7707598d093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.997+0000 7f2f6e7fc640 1 -- 172.21.15.1:0/2606905083 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003970 con 0x55b4446beb40 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.997+0000 7f2f6e7fc640 1 -- 172.21.15.1:0/2606905083 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f80004030 con 0x55b4446beb40 2024-09-12T02:32:00.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.997+0000 7f2f6e7fc640 1 -- 172.21.15.1:0/2606905083 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011840 con 0x55b4446beb40 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f857fa640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 0x7f2f700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 -- 172.21.15.1:0/2606905083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 msgr2=0x55b4446bd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009d70 tx=0x7f2f8000f730 comp rx=0 tx=0).stop 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f87fff640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 0x7f2f700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 -- 172.21.15.1:0/2606905083 shutdown_connections 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:00.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 --2- 172.21.15.1:0/2606905083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446bd090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.998+0000 7f2f90e06740 1 -- 172.21.15.1:0/2606905083 >> 172.21.15.1:0/2606905083 conn(0x55b444686310 msgr2=0x55b4446b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:01.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.999+0000 7f2f90e06740 1 -- 172.21.15.1:0/2606905083 shutdown_connections 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.999+0000 7f2f90e06740 1 -- 172.21.15.1:0/2606905083 wait complete. 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.999+0000 7f2f90e06740 1 -- start start 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.999+0000 7f2f857fa640 1 -- 172.21.15.1:0/1114184188 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2f780efb10 con 0x7f2f88100430 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:00.999+0000 7f2f90e06740 1 Processor -- start 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446beb40 0x55b4446cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446d0b80 0x55b4446cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b4446d3880 con 0x55b4446bd5d0 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b4445de060 con 0x55b4446d0b80 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4446d3a00 con 0x55b4446beb40 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f90e06740 10 client.0 _ll_register_callbacks cb 0x55b4443318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:01.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36378/0 (socket says 172.21.15.1:36378) 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.000+0000 7f2f8cfca640 1 -- 172.21.15.1:0/1322917822 learned_addr learned my addr 172.21.15.1:0/1322917822 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.001+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446d0b80 0x55b4446cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.001+0000 7f2f87fff640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 0x7f2f700a5150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f780bc280 tx=0x7f2f780f3010 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f877fe640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446beb40 0x55b4446cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 -- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446beb40 msgr2=0x55b4446cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446beb40 0x55b4446cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 -- 172.21.15.1:0/1322917822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446d0b80 msgr2=0x55b4446cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:01.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446d0b80 0x55b4446cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 -- 172.21.15.1:0/1322917822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4443943c0 con 0x55b4446bd5d0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b00 tx=0x7f2f80005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5f88746a74e63c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f677fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003b80 con 0x55b4446bd5d0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.002+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2f80003d20 con 0x55b4446bd5d0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.003+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f80004030 con 0x55b4446bd5d0 2024-09-12T02:32:01.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.003+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f80031050 con 0x55b4446bd5d0 2024-09-12T02:32:01.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.003+0000 7f2f90e06740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:01.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.003+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4446df350 con 0x55b4446bd5d0 2024-09-12T02:32:01.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f80004030 con 0x55b4446bd5d0 2024-09-12T02:32:01.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f80005540 con 0x55b4446bd5d0 2024-09-12T02:32:01.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:01.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 10 client.15747 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:32:01.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 20 client.15747 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:01.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b4446e07b0 0x55b4446e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 4 client.15747 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b444630860 con 0x55b4446e07b0 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.004+0000 7f2f877fe640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b4446e07b0 0x55b4446e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.005+0000 7f2f677fe640 10 client.15747 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.005+0000 7f2f877fe640 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b4446e07b0 0x55b4446e2ba0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd96ff9a92760a10 server_cookie=1d421a3a4887e413 in_seq=0 out_seq=0 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f677fe640 1 -- 172.21.15.1:0/1322917822 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b444630860 con 0x55b4446e07b0 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f677fe640 10 client.15747 handle_command_reply: tid=0 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 client.15747 shutdown 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 msgr2=0x55b4446d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b00 tx=0x7f2f80005a50 comp rx=0 tx=0).stop 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 shutdown_connections 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b4446e07b0 0x55b4446e2ba0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446d0b80 0x55b4446cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446beb40 0x55b4446cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 --2- 172.21.15.1:0/1322917822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d0480 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 >> 172.21.15.1:0/1322917822 conn(0x55b444686310 msgr2=0x55b4446bf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f677fe640 0 client.15747 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 shutdown_connections 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 1 -- 172.21.15.1:0/1322917822 wait complete. 2024-09-12T02:32:01.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.006+0000 7f2f90e06740 20 client.15747 trim_cache size 0 max 16384 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 Processor -- start 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 -- start start 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446bd5d0 0x55b4446b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446dcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400e5c0 con 0x55b4446d0b80 2024-09-12T02:32:01.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74010100 con 0x55b4446beb40 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.024+0000 7f2f90e06740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400ec90 con 0x55b4446bd5d0 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36384/0 (socket says 172.21.15.1:36384) 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3476026504 learned_addr learned my addr 172.21.15.1:0/3476026504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3476026504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446bd5d0 msgr2=0x55b4446b4c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446bd5d0 0x55b4446b4c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3476026504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 msgr2=0x55b4446dcbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446dcbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.025+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3476026504 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4446cbcd0 con 0x55b4446d0b80 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.026+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009c90 tx=0x7f2f80009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc670d7d31b4f3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.026+0000 7f2f6dffb640 1 -- 172.21.15.1:0/3476026504 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000fc30 con 0x55b4446d0b80 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.026+0000 7f2f6dffb640 1 -- 172.21.15.1:0/3476026504 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f80005b70 con 0x55b4446d0b80 2024-09-12T02:32:01.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.026+0000 7f2f6dffb640 1 -- 172.21.15.1:0/3476026504 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003b80 con 0x55b4446d0b80 2024-09-12T02:32:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 -- 172.21.15.1:0/3476026504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 msgr2=0x55b4446e83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009c90 tx=0x7f2f80009400 comp rx=0 tx=0).stop 2024-09-12T02:32:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 -- 172.21.15.1:0/3476026504 shutdown_connections 2024-09-12T02:32:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446d0b80 0x55b4446e83d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446dcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3476026504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446bd5d0 0x55b4446b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 -- 172.21.15.1:0/3476026504 >> 172.21.15.1:0/3476026504 conn(0x55b444686310 msgr2=0x55b4446c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 -- 172.21.15.1:0/3476026504 shutdown_connections 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.027+0000 7f2f90e06740 1 -- 172.21.15.1:0/3476026504 wait complete. 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.028+0000 7f2f90e06740 1 -- start start 2024-09-12T02:32:01.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.028+0000 7f2f90e06740 1 Processor -- start 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.028+0000 7f2f90e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36396/0 (socket says 172.21.15.1:36396) 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3105542875 learned_addr learned my addr 172.21.15.1:0/3105542875 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446d4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400fa30 con 0x55b4446bd5d0 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400f360 con 0x55b4446beb40 2024-09-12T02:32:01.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7400c5a0 con 0x55b4446d0b80 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f877fe640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446d4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 msgr2=0x55b4446d54d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d54d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3105542875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 msgr2=0x55b4446d4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446d4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.029+0000 7f2f8cfca640 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44474a3a0 con 0x55b4446bd5d0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f90e06740 10 client.0 _ll_register_callbacks cb 0x7f2f7c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f80005b70 con 0x55b4446bd5d0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f677fe640 10 client.15753 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f8cfca640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f80002230 tx=0x7f2f80009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1140e421317f27e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f677fe640 1 -- 172.21.15.1:0/3105542875 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011e60 con 0x55b4446bd5d0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f677fe640 1 -- 172.21.15.1:0/3105542875 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2f80003b80 con 0x55b4446bd5d0 2024-09-12T02:32:01.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.030+0000 7f2f677fe640 1 -- 172.21.15.1:0/3105542875 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f80003de0 con 0x55b4446bd5d0 2024-09-12T02:32:01.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 10 client.15753 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:01.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b44474b340 con 0x55b4446bd5d0 2024-09-12T02:32:01.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f677fe640 1 -- 172.21.15.1:0/3105542875 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2f80036440 con 0x55b4446bd5d0 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 10 client.15753 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 10 client.15753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 20 client.15753 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b44474b960 0x55b44474de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 4 client.15753 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b44462ad70 con 0x55b44474b960 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.031+0000 7f2f877fe640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b44474b960 0x55b44474de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f677fe640 10 client.15753 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f877fe640 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b44474b960 0x55b44474de00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1417291828b97f32 server_cookie=acf06fae06a910e1 in_seq=0 out_seq=0 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f677fe640 1 -- 172.21.15.1:0/3105542875 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b44462ad70 con 0x55b44474b960 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f677fe640 10 client.15753 handle_command_reply: tid=0 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f90e06740 1 client.15753 shutdown 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 msgr2=0x55b4446d4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:01.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.032+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f80002230 tx=0x7f2f80009520 comp rx=0 tx=0).stop 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 shutdown_connections 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55b44474b960 0x55b44474de00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f677fe640 0 client.15753 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4446d0b80 0x55b4446d54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b4446beb40 0x55b4446d4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 --2- 172.21.15.1:0/3105542875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4446bd5d0 0x55b4446d4a50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 >> 172.21.15.1:0/3105542875 conn(0x55b444686310 msgr2=0x55b4446b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 shutdown_connections 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 1 -- 172.21.15.1:0/3105542875 wait complete. 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.033+0000 7f2f90e06740 20 client.15753 trim_cache size 0 max 16384 2024-09-12T02:32:01.036 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:01.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 msgr2=0x7f2f700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:01.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 0x7f2f700a5150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f780bc280 tx=0x7f2f780f3010 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 msgr2=0x7f2f88196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800a960 tx=0x7f2f78033a30 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 shutdown_connections 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f2f700a2c90 0x7f2f700a5150 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f88105560 0x7f2f8819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f88100de0 0x7f2f88196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 --2- 172.21.15.1:0/1114184188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f88100430 0x7f2f88196040 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 >> 172.21.15.1:0/1114184188 conn(0x7f2f88077230 msgr2=0x7f2f88103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 shutdown_connections 2024-09-12T02:32:01.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:01.034+0000 7f2f8ea2d640 1 -- 172.21.15.1:0/1114184188 wait complete. 2024-09-12T02:32:01.045 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:01.931 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:01 smithi001 ceph-mon[31252]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-12T02:32:01.933 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:32:01.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:01 smithi173 ceph-mon[35036]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-12T02:32:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:01 smithi134 ceph-mon[35091]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-12T02:32:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 -- 172.21.15.1:0/361012486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a81078c0 msgr2=0x7fb9a8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/361012486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a81078c0 0x7fb9a8109cb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009ca0 tx=0x7fb9a002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 -- 172.21.15.1:0/361012486 shutdown_connections 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/361012486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a81078c0 0x7fb9a8109cb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/361012486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8104f90 0x7fb9a8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/361012486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a8102660 0x7fb9a8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 -- 172.21.15.1:0/361012486 >> 172.21.15.1:0/361012486 conn(0x7fb9a80fc1e0 msgr2=0x7fb9a80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 -- 172.21.15.1:0/361012486 shutdown_connections 2024-09-12T02:32:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.219+0000 7fb9afcf8640 1 -- 172.21.15.1:0/361012486 wait complete. 2024-09-12T02:32:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.220+0000 7fb9afcf8640 1 Processor -- start 2024-09-12T02:32:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.220+0000 7fb9afcf8640 1 -- start start 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 0x7fb9a8197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 0x7fb9a819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49866/0 (socket says 172.21.15.1:49866) 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9ad293640 1 -- 172.21.15.1:0/2768641747 learned_addr learned my addr 172.21.15.1:0/2768641747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9ada94640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 0x7fb9a8197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810d7e0 con 0x7fb9a8104f90 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810d660 con 0x7fb9a8102660 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a810d960 con 0x7fb9a81078c0 2024-09-12T02:32:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.221+0000 7fb9ae295640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 0x7fb9a819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 -- 172.21.15.1:0/2768641747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 msgr2=0x7fb9a819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 0x7fb9a819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 -- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 msgr2=0x7fb9a81980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a819f7d0 con 0x7fb9a8102660 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ae295640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 0x7fb9a819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ad293640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.222+0000 7fb9ada94640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 0x7fb9a8197bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9f0 tx=0x7fb9a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.223+0000 7fb99effd640 1 -- 172.21.15.1:0/2768641747 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400ccc0 con 0x7fb9a8102660 2024-09-12T02:32:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.223+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a81004b0 con 0x7fb9a8102660 2024-09-12T02:32:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.223+0000 7fb99effd640 1 -- 172.21.15.1:0/2768641747 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a4010910 con 0x7fb9a8102660 2024-09-12T02:32:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.223+0000 7fb99effd640 1 -- 172.21.15.1:0/2768641747 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4018960 con 0x7fb9a8102660 2024-09-12T02:32:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.223+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a8100a50 con 0x7fb9a8102660 2024-09-12T02:32:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.226+0000 7fb99effd640 1 -- 172.21.15.1:0/2768641747 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb9a4010ac0 con 0x7fb9a8102660 2024-09-12T02:32:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.227+0000 7fb9b2a96740 1 Processor -- start 2024-09-12T02:32:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.227+0000 7fb9b2a96740 1 -- start start 2024-09-12T02:32:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.227+0000 7fb99effd640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 0x7fb9940a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.227+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 0x56533bc11da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc19830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56533bb752f0 con 0x56533bc122e0 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56533bb1d270 con 0x56533bc17370 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb99effd640 1 -- 172.21.15.1:0/2768641747 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9a40cf3b0 con 0x7fb9a8102660 2024-09-12T02:32:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ae295640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 0x7fb9940a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49872/0 (socket says 172.21.15.1:49872) 2024-09-12T02:32:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 -- 172.21.15.1:0/3029954954 learned_addr learned my addr 172.21.15.1:0/3029954954 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56533bb712b0 con 0x56533bc119a0 2024-09-12T02:32:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ada94640 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 0x56533bc11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 -- 172.21.15.1:0/3029954954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 msgr2=0x56533bc11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 0x56533bc11da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 -- 172.21.15.1:0/3029954954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 msgr2=0x56533bc19830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:32:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc19830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ad293640 1 -- 172.21.15.1:0/3029954954 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533bb1c340 con 0x56533bc122e0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.228+0000 7fb9ada94640 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 0x56533bc11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.229+0000 7fb9ae295640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 0x7fb9940a51f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0005fa0 tx=0x7fb9a003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.229+0000 7fb9ad293640 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb9980115c0 tx=0x7fb998009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fb28962a64394 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.229+0000 7fb993fff640 1 -- 172.21.15.1:0/3029954954 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99801e070 con 0x56533bc122e0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.229+0000 7fb993fff640 1 -- 172.21.15.1:0/3029954954 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb99800fb20 con 0x56533bc122e0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.229+0000 7fb993fff640 1 -- 172.21.15.1:0/3029954954 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998019c90 con 0x56533bc122e0 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- 172.21.15.1:0/3029954954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 msgr2=0x56533bc16da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb9980115c0 tx=0x7fb998009f90 comp rx=0 tx=0).stop 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- 172.21.15.1:0/3029954954 shutdown_connections 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc122e0 0x56533bc16da0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc19830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/3029954954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc119a0 0x56533bc11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- 172.21.15.1:0/3029954954 >> 172.21.15.1:0/3029954954 conn(0x56533bc0d010 msgr2=0x56533bc0d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- 172.21.15.1:0/3029954954 shutdown_connections 2024-09-12T02:32:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- 172.21.15.1:0/3029954954 wait complete. 2024-09-12T02:32:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 -- start start 2024-09-12T02:32:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.230+0000 7fb9b2a96740 1 Processor -- start 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc122e0 0x56533bc1c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc231d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56533bc1a340 con 0x56533bc119a0 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56533bafe290 con 0x56533bc17370 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56533bc1a4c0 con 0x56533bc122e0 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9b2a96740 10 client.0 _ll_register_callbacks cb 0x56533bb2f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49886/0 (socket says 172.21.15.1:49886) 2024-09-12T02:32:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 -- 172.21.15.1:0/496467714 learned_addr learned my addr 172.21.15.1:0/496467714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 -- 172.21.15.1:0/496467714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc122e0 msgr2=0x56533bc1c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc122e0 0x56533bc1c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 -- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 msgr2=0x56533bc231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.231+0000 7fb9ada94640 1 -- 172.21.15.1:0/496467714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533b888210 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9ada94640 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9c0 tx=0x7fb9a40a0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1fd7cd8aa6a361 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40cd000 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb99800fb20 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9a409b090 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9a409b290 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9b2a96740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56533b954620 con 0x56533bc119a0 2024-09-12T02:32:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb99800fb20 con 0x56533bc119a0 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9a40ce040 con 0x56533bc119a0 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9b2a96740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.232+0000 7fb9b2a96740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9b2a96740 20 client.15765 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc278e0 0x56533bc29d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9b2a96740 4 client.15765 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533bb82a20 con 0x56533bc278e0 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9ad293640 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc278e0 0x56533bc29d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9917fa640 10 client.15765 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.233+0000 7fb9ad293640 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc278e0 0x56533bc29d30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736a5f4d4b85f389 server_cookie=6800894dd66c0bd3 in_seq=0 out_seq=0 2024-09-12T02:32:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.234+0000 7fb9917fa640 1 -- 172.21.15.1:0/496467714 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56533bb82a20 con 0x56533bc278e0 2024-09-12T02:32:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.234+0000 7fb9917fa640 10 client.15765 handle_command_reply: tid=0 2024-09-12T02:32:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.234+0000 7fb9b2a96740 1 client.15765 shutdown 2024-09-12T02:32:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.234+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 msgr2=0x56533bc1bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.234+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9c0 tx=0x7fb9a40a0000 comp rx=0 tx=0).stop 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 shutdown_connections 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc278e0 0x56533bc29d30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc17370 0x56533bc231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9917fa640 0 client.15765 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc122e0 0x56533bc1c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/496467714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc1bc50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 >> 172.21.15.1:0/496467714 conn(0x56533bc0d010 msgr2=0x56533bc0e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 shutdown_connections 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 1 -- 172.21.15.1:0/496467714 wait complete. 2024-09-12T02:32:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.235+0000 7fb9b2a96740 20 client.15765 trim_cache size 0 max 16384 2024-09-12T02:32:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 Processor -- start 2024-09-12T02:32:02.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 -- start start 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc0c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc23190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc2e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a6e60 con 0x56533bc119a0 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a89a0 con 0x56533bc122e0 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.255+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a7530 con 0x56533bc17370 2024-09-12T02:32:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ae295640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc2e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc0c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ae295640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc2e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40378/0 (socket says 172.21.15.1:40378) 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ae295640 1 -- 172.21.15.1:0/993790312 learned_addr learned my addr 172.21.15.1:0/993790312 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ad293640 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc23190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 -- 172.21.15.1:0/993790312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 msgr2=0x56533bc2e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc2e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 -- 172.21.15.1:0/993790312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 msgr2=0x56533bc23190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc23190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.256+0000 7fb9ada94640 1 -- 172.21.15.1:0/993790312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533bc127c0 con 0x56533bc119a0 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.257+0000 7fb9ada94640 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc0c0b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40980a0 tx=0x7fb9a4097b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577c58feeb7d970c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.257+0000 7fb9937fe640 1 -- 172.21.15.1:0/993790312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4097cc0 con 0x56533bc119a0 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.257+0000 7fb9937fe640 1 -- 172.21.15.1:0/993790312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a40a4800 con 0x56533bc119a0 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.257+0000 7fb9937fe640 1 -- 172.21.15.1:0/993790312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40a10d0 con 0x56533bc119a0 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- 172.21.15.1:0/993790312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 msgr2=0x56533bc0c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc0c0b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40980a0 tx=0x7fb9a4097b70 comp rx=0 tx=0).stop 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- 172.21.15.1:0/993790312 shutdown_connections 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc2e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc23190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/993790312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc0c0b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- 172.21.15.1:0/993790312 >> 172.21.15.1:0/993790312 conn(0x56533bc0d010 msgr2=0x56533bc0b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- 172.21.15.1:0/993790312 shutdown_connections 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- 172.21.15.1:0/993790312 wait complete. 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.258+0000 7fb9b2a96740 1 -- start start 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 Processor -- start 2024-09-12T02:32:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc20e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a82d0 con 0x56533bc119a0 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.259+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a7c00 con 0x56533bc122e0 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9b2a96740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81a4e40 con 0x56533bc17370 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9b2a96740 10 client.0 _ll_register_callbacks cb 0x7fb9a4097f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9ad293640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:52824/0 (socket says 172.21.15.1:52824) 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9ad293640 1 -- 172.21.15.1:0/55154356 learned_addr learned my addr 172.21.15.1:0/55154356 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9ae295640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.260+0000 7fb9ada94640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc20e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 -- 172.21.15.1:0/55154356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 msgr2=0x56533bc223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 -- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 msgr2=0x56533bc21390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 -- 172.21.15.1:0/55154356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533bc229b0 con 0x56533bc119a0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ad293640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9ada94640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc20e50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4099ef0 tx=0x7fb9a4097ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e459c9a5f7890 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9917fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a407f060 con 0x56533bc119a0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.261+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9a409b090 con 0x56533bc119a0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.262+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9a40a4800 con 0x56533bc119a0 2024-09-12T02:32:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.262+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9a409ae10 con 0x56533bc119a0 2024-09-12T02:32:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.264+0000 7fb9b2a96740 10 client.15771 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.264+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56533bc9b3a0 con 0x56533bc119a0 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a4097be0 con 0x56533bc119a0 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9a40ce020 con 0x56533bc119a0 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 10 client.15771 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 20 client.15771 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc9bab0 0x56533bc9dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 4 client.15771 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:32:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.265+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb9a40a4800 con 0x56533bc9bab0 2024-09-12T02:32:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.298+0000 7fb9ad293640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc9bab0 0x56533bc9dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.317+0000 7fb9ad293640 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc9bab0 0x56533bc9dea0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce32fdb9b29c8e1 server_cookie=bb7bc8fc89a41bfd in_seq=0 out_seq=0 2024-09-12T02:32:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.317+0000 7fb9917fa640 10 client.15771 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.321+0000 7fb9917fa640 1 -- 172.21.15.1:0/55154356 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb9a40a4800 con 0x56533bc9bab0 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.321+0000 7fb9917fa640 10 client.15771 handle_command_reply: tid=0 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.321+0000 7fb9b2a96740 1 client.15771 shutdown 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.321+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 msgr2=0x56533bc20e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.321+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc20e50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4099ef0 tx=0x7fb9a4097ee0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 shutdown_connections 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56533bc9bab0 0x56533bc9dea0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56533bc17370 0x56533bc223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9917fa640 0 client.15771 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56533bc122e0 0x56533bc21390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 --2- 172.21.15.1:0/55154356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56533bc119a0 0x56533bc20e50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 >> 172.21.15.1:0/55154356 conn(0x56533bc0d010 msgr2=0x56533bc0c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 shutdown_connections 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 1 -- 172.21.15.1:0/55154356 wait complete. 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.322+0000 7fb9b2a96740 20 client.15771 trim_cache size 0 max 16384 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:32:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:32:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:32:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:32:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 msgr2=0x7fb9940a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 0x7fb9940a51f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0005fa0 tx=0x7fb9a003e040 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 msgr2=0x7fb9a8197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 0x7fb9a8197bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9f0 tx=0x7fb9a400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 shutdown_connections 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9940a2d30 0x7fb9940a51f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9a8104f90 0x7fb9a81980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a81078c0 0x7fb9a819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 --2- 172.21.15.1:0/2768641747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a8102660 0x7fb9a8197bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 >> 172.21.15.1:0/2768641747 conn(0x7fb9a80fc1e0 msgr2=0x7fb9a8105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 shutdown_connections 2024-09-12T02:32:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:02.323+0000 7fb9afcf8640 1 -- 172.21.15.1:0/2768641747 wait complete. 2024-09-12T02:32:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 -- 172.21.15.1:0/1521321286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 msgr2=0x7f2520106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 --2- 172.21.15.1:0/1521321286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f2520106cb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2510009930 tx=0x7f251002a420 comp rx=0 tx=0).stop 2024-09-12T02:32:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 -- 172.21.15.1:0/1521321286 shutdown_connections 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 --2- 172.21.15.1:0/1521321286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2520101270 0x7f252010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 --2- 172.21.15.1:0/1521321286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25201008d0 0x7f2520100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 --2- 172.21.15.1:0/1521321286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f2520106cb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.480+0000 7f251f59e640 1 -- 172.21.15.1:0/1521321286 >> 172.21.15.1:0/1521321286 conn(0x7f25200fc610 msgr2=0x7f25200fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.481+0000 7f251f59e640 1 -- 172.21.15.1:0/1521321286 shutdown_connections 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.481+0000 7f251f59e640 1 -- 172.21.15.1:0/1521321286 wait complete. 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 Processor -- start 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 -- start start 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 0x7f2520198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f252019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2520110cd0 con 0x7f25201068d0 2024-09-12T02:32:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2520110b50 con 0x7f25201008d0 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251f59e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2520110e50 con 0x7f2520101270 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251dd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f252019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251dd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40400/0 (socket says 172.21.15.1:40400) 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251dd9b640 1 -- 172.21.15.1:0/2439782939 learned_addr learned my addr 172.21.15.1:0/2439782939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.482+0000 7f251e59c640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 0x7f2520198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 -- 172.21.15.1:0/2439782939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 msgr2=0x7f2520198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 0x7f2520198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 -- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 msgr2=0x7f252019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f252019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 -- 172.21.15.1:0/2439782939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252019d2e0 con 0x7f2520101270 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251e59c640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 0x7f2520198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251ed9d640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f252019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251dd9b640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f251400e9f0 tx=0x7f251400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251400cd80 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252019d570 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.483+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2514005500 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.484+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514010690 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.484+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2520111470 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.485+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252006b7c0 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.487+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f25140046c0 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.487+0000 7f250f7fe640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 0x7f25080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.488+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f25140cf4e0 con 0x7f2520101270 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.488+0000 7f251e59c640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 0x7f25080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.488+0000 7f251e59c640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 0x7f25080a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c00 tx=0x7f251003c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.492+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f252006b7c0 con 0x7f2520101270 2024-09-12T02:32:02.569 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:02.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.728+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2520106cb0 con 0x7f2520101270 2024-09-12T02:32:02.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.729+0000 7f250f7fe640 1 -- 172.21.15.1:0/2439782939 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f251409c3c0 con 0x7f2520101270 2024-09-12T02:32:02.730 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:32:02.730 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:32:02.730 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:32:02.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 msgr2=0x7f25080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 0x7f25080a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c00 tx=0x7f251003c040 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 msgr2=0x7f2520198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f251400e9f0 tx=0x7f251400edf0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 shutdown_connections 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f25080a2b80 0x7f25080a5040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25201068d0 0x7f252019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2520101270 0x7f2520198aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 --2- 172.21.15.1:0/2439782939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25201008d0 0x7f2520198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 >> 172.21.15.1:0/2439782939 conn(0x7f25200fc610 msgr2=0x7f25200fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.732+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 shutdown_connections 2024-09-12T02:32:02.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:02.733+0000 7f251f59e640 1 -- 172.21.15.1:0/2439782939 wait complete. 2024-09-12T02:32:03.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:03 smithi001 ceph-mon[31252]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:32:03.836 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:03 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2439782939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:03.882 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id f5d4fa5 --release --await' 2024-09-12T02:32:03.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id f5d4fa5 --release --await 2024-09-12T02:32:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:03 smithi173 ceph-mon[35036]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:32:03.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:03 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2439782939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:04.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 -- 172.21.15.1:0/2951675647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4074eb0 msgr2=0x7fede4112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 --2- 172.21.15.1:0/2951675647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4074eb0 0x7fede4112660 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009900 tx=0x7fedd402a480 comp rx=0 tx=0).stop 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 -- 172.21.15.1:0/2951675647 shutdown_connections 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 --2- 172.21.15.1:0/2951675647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4074eb0 0x7fede4112660 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 --2- 172.21.15.1:0/2951675647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4112ba0 0x7fede4114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 --2- 172.21.15.1:0/2951675647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074590 0x7fede4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.112+0000 7fedec088640 1 -- 172.21.15.1:0/2951675647 >> 172.21.15.1:0/2951675647 conn(0x7fede40fd8b0 msgr2=0x7fede40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.113+0000 7fedec088640 1 -- 172.21.15.1:0/2951675647 shutdown_connections 2024-09-12T02:32:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.113+0000 7fedec088640 1 -- 172.21.15.1:0/2951675647 wait complete. 2024-09-12T02:32:04.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.114+0000 7fedec088640 1 Processor -- start 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.114+0000 7fedec088640 1 -- start start 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 0x7fede41a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 0x7fede419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fede4118630 con 0x7fede4112ba0 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fede41184b0 con 0x7fede4074eb0 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedec088640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fede41187b0 con 0x7fede4074590 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fede9e24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fede9e24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40414/0 (socket says 172.21.15.1:40414) 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fede9e24640 1 -- 172.21.15.1:0/4150201843 learned_addr learned my addr 172.21.15.1:0/4150201843 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fede9623640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 0x7fede41a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.115+0000 7fedea625640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 0x7fede419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9623640 1 -- 172.21.15.1:0/4150201843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 msgr2=0x7fede41a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9623640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9623640 1 -- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 msgr2=0x7fede419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9623640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 0x7fede419e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9623640 1 -- 172.21.15.1:0/4150201843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede419efd0 con 0x7fede4074eb0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fede9e24640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.116+0000 7fedea625640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 0x7fede419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7fede9623640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 0x7fede41a4bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedd402aa70 tx=0x7fedd40305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7feddaffd640 1 -- 172.21.15.1:0/4150201843 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd403f030 con 0x7fede4074eb0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7feddaffd640 1 -- 172.21.15.1:0/4150201843 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd403b460 con 0x7fede4074eb0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7feddaffd640 1 -- 172.21.15.1:0/4150201843 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4035070 con 0x7fede4074eb0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede419f260 con 0x7fede4074eb0 2024-09-12T02:32:04.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.117+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede41ab440 con 0x7fede4074eb0 2024-09-12T02:32:04.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.122+0000 7fedee461740 1 Processor -- start 2024-09-12T02:32:04.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.122+0000 7feddaffd640 1 -- 172.21.15.1:0/4150201843 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fedd4042030 con 0x7fede4074eb0 2024-09-12T02:32:04.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 -- start start 2024-09-12T02:32:04.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 0x5651786ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 0x5651786d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651786302f0 con 0x5651786cbb40 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651785d7cf0 con 0x5651786ca5d0 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedee461740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56517862c2b0 con 0x5651786d5370 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fede9e24640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fede9e24640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:52874/0 (socket says 172.21.15.1:52874) 2024-09-12T02:32:04.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fede9e24640 1 -- 172.21.15.1:0/740494693 learned_addr learned my addr 172.21.15.1:0/740494693 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.123+0000 7fedea625640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 0x5651786ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fede9623640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 0x5651786d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 -- 172.21.15.1:0/740494693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 msgr2=0x5651786d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 0x5651786d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 -- 172.21.15.1:0/740494693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 msgr2=0x5651786caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 -- 172.21.15.1:0/740494693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651785bc3a0 con 0x5651786cbb40 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fede9623640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 0x5651786d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:04.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.124+0000 7fedea625640 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 0x5651786ca090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feddc00aa00 tx=0x7feddc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d971d16e1939ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.125+0000 7fedcffff640 1 -- 172.21.15.1:0/740494693 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc018020 con 0x5651786cbb40 2024-09-12T02:32:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.125+0000 7fedcffff640 1 -- 172.21.15.1:0/740494693 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc00edc0 con 0x5651786cbb40 2024-09-12T02:32:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.125+0000 7feddaffd640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 0x7fedd00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.126+0000 7fede9e24640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 0x7fedd00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.126+0000 7feddaffd640 1 -- 172.21.15.1:0/4150201843 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fedd40ef680 con 0x7fede4074eb0 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.126+0000 7fedee461740 1 -- 172.21.15.1:0/740494693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 msgr2=0x5651786ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.126+0000 7fede9e24640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 0x7fedd00a5180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5651786c7ac0 tx=0x7fede0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.126+0000 7fedee461740 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 0x5651786ca090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feddc00aa00 tx=0x7feddc009650 comp rx=0 tx=0).stop 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 -- 172.21.15.1:0/740494693 shutdown_connections 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786d5370 0x5651786d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 --2- 172.21.15.1:0/740494693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786cbb40 0x5651786ca090 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 -- 172.21.15.1:0/740494693 >> 172.21.15.1:0/740494693 conn(0x565178693310 msgr2=0x5651786c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 -- 172.21.15.1:0/740494693 shutdown_connections 2024-09-12T02:32:04.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 -- 172.21.15.1:0/740494693 wait complete. 2024-09-12T02:32:04.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.127+0000 7fedee461740 1 -- start start 2024-09-12T02:32:04.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 Processor -- start 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5651786d8110 con 0x5651786d5370 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651785eb060 con 0x5651786ca5d0 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5651786d8290 con 0x5651786cbb40 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.128+0000 7fedee461740 10 client.0 _ll_register_callbacks cb 0x56517833e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49950/0 (socket says 172.21.15.1:49950) 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 -- 172.21.15.1:0/2813097505 learned_addr learned my addr 172.21.15.1:0/2813097505 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fede9e24640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fede9623640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 -- 172.21.15.1:0/2813097505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 msgr2=0x5651786d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 -- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 msgr2=0x5651786d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786d4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fedea625640 1 -- 172.21.15.1:0/2813097505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651783a13c0 con 0x5651786d5370 2024-09-12T02:32:04.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.129+0000 7fede9623640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedea625640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feddc000f80 tx=0x7feddc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4d300c39e881c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc013780 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7feddc013920 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feddc00edc0 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feddc014780 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedee461740 10 client.15789 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.130+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651786e3a70 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc00edc0 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feddc029ab0 con 0x5651786d5370 2024-09-12T02:32:04.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 20 client.15789 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5651786e4e20 0x5651786e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 4 client.15789 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56517863d860 con 0x5651786e4e20 2024-09-12T02:32:04.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.131+0000 7fede9e24640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5651786e4e20 0x5651786e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.132+0000 7fede9e24640 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5651786e4e20 0x5651786e7210 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f05ea923ec1d8b server_cookie=c3ff164d302932ca in_seq=0 out_seq=0 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.132+0000 7fedcd7fa640 10 client.15789 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedcd7fa640 1 -- 172.21.15.1:0/2813097505 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56517863d860 con 0x5651786e4e20 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedcd7fa640 10 client.15789 handle_command_reply: tid=0 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 client.15789 shutdown 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 msgr2=0x5651786d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7feddc000f80 tx=0x7feddc00ed00 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 shutdown_connections 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786d2420 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5651786e4e20 0x5651786e7210 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 --2- 172.21.15.1:0/2813097505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786ca5d0 0x5651786d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 >> 172.21.15.1:0/2813097505 conn(0x565178693310 msgr2=0x5651786cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedcd7fa640 0 client.15789 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 shutdown_connections 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.133+0000 7fedee461740 1 -- 172.21.15.1:0/2813097505 wait complete. 2024-09-12T02:32:04.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.134+0000 7fedee461740 20 client.15789 trim_cache size 0 max 16384 2024-09-12T02:32:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.161+0000 7fedee461740 1 Processor -- start 2024-09-12T02:32:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.161+0000 7fedee461740 1 -- start start 2024-09-12T02:32:04.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fedee461740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 0x5651786e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fedee461740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 0x5651786ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fedee461740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fede9e24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 0x5651786e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fede9e24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 0x5651786e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40440/0 (socket says 172.21.15.1:40440) 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fede9623640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 0x5651786ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fede9623640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 0x5651786ec7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:52884/0 (socket says 172.21.15.1:52884) 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fedea625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.162+0000 7fedea625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49952/0 (socket says 172.21.15.1:49952) 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fede9e24640 1 -- 172.21.15.1:0/783301379 learned_addr learned my addr 172.21.15.1:0/783301379 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b3c40 con 0x5651786d5370 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b5780 con 0x5651786cbb40 2024-09-12T02:32:04.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b4310 con 0x5651786ca5d0 2024-09-12T02:32:04.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedea625640 1 -- 172.21.15.1:0/783301379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 msgr2=0x5651786e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedea625640 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 0x5651786e1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedea625640 1 -- 172.21.15.1:0/783301379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 msgr2=0x5651786ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedea625640 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 0x5651786ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.163+0000 7fedea625640 1 -- 172.21.15.1:0/783301379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651786cdae0 con 0x5651786d5370 2024-09-12T02:32:04.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:03 smithi134 ceph-mon[35091]: pgmap v376: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T02:32:04.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:03 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2439782939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.164+0000 7fedea625640 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feddc009690 tx=0x7feddc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bee1c006b2ac522 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.164+0000 7fedcf7fe640 1 -- 172.21.15.1:0/783301379 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc018070 con 0x5651786d5370 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.164+0000 7fedcf7fe640 1 -- 172.21.15.1:0/783301379 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc038020 con 0x5651786d5370 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.164+0000 7fedcf7fe640 1 -- 172.21.15.1:0/783301379 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc014920 con 0x5651786d5370 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.165+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 msgr2=0x5651786ecd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.165+0000 7fedee461740 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feddc009690 tx=0x7feddc009da0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 shutdown_connections 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786d5370 0x5651786ecd20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786cbb40 0x5651786ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 --2- 172.21.15.1:0/783301379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786ca5d0 0x5651786e1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 >> 172.21.15.1:0/783301379 conn(0x565178693310 msgr2=0x5651786d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 shutdown_connections 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.166+0000 7fedee461740 1 -- 172.21.15.1:0/783301379 wait complete. 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.167+0000 7fedee461740 1 -- start start 2024-09-12T02:32:04.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.167+0000 7fedee461740 1 Processor -- start 2024-09-12T02:32:04.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fedee461740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 0x5651786dda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fede9e24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 0x5651786dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fede9e24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 0x5651786dda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49966/0 (socket says 172.21.15.1:49966) 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fede9e24640 1 -- 172.21.15.1:0/213682169 learned_addr learned my addr 172.21.15.1:0/213682169 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786d5370 0x5651786d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b50b0 con 0x5651786ca5d0 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.168+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b49e0 con 0x5651786d5370 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fede41b1c20 con 0x5651786cbb40 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fedea625640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786d5370 0x5651786d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fedee461740 10 client.0 _ll_register_callbacks cb 0x7fede0009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 -- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786d5370 msgr2=0x5651786d92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786d5370 0x5651786d92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 -- 172.21.15.1:0/213682169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 msgr2=0x5651786dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:04.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 0x5651786dda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651786c6510 con 0x5651786cbb40 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fede9623640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d8d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5651786cb070 tx=0x7fedd40b8250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21de8d98acca9d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.169+0000 7fedcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4049040 con 0x5651786cbb40 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feddc038020 con 0x5651786cbb40 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fedd40c4640 con 0x5651786cbb40 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedd400b0b0 con 0x5651786cbb40 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedee461740 10 client.25276 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:04.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56517874f3b0 con 0x5651786cbb40 2024-09-12T02:32:04.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.170+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc038020 con 0x5651786cbb40 2024-09-12T02:32:04.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedd40bb360 con 0x5651786cbb40 2024-09-12T02:32:04.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 10 client.25276 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:04.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 10 client.25276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 20 client.25276 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56517874fae0 0x565178751f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 4 client.25276 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565178637d70 con 0x56517874fae0 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.171+0000 7fede9e24640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56517874fae0 0x565178751f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.172+0000 7fede9e24640 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56517874fae0 0x565178751f00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b424ebc87756876e server_cookie=ceef9396e9ca5367 in_seq=0 out_seq=0 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.172+0000 7fedcd7fa640 10 client.25276 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.172+0000 7fedcd7fa640 1 -- 172.21.15.1:0/213682169 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565178637d70 con 0x56517874fae0 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.172+0000 7fedcd7fa640 10 client.25276 handle_command_reply: tid=0 2024-09-12T02:32:04.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.172+0000 7fedee461740 1 client.25276 shutdown 2024-09-12T02:32:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 msgr2=0x5651786d8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d8d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5651786cb070 tx=0x7fedd40b8250 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 shutdown_connections 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56517874fae0 0x565178751f00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedcd7fa640 0 client.25276 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651786d5370 0x5651786d92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651786cbb40 0x5651786d8d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 --2- 172.21.15.1:0/213682169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5651786ca5d0 0x5651786dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 >> 172.21.15.1:0/213682169 conn(0x565178693310 msgr2=0x5651786d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.175+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 shutdown_connections 2024-09-12T02:32:04.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.178+0000 7fedee461740 1 -- 172.21.15.1:0/213682169 wait complete. 2024-09-12T02:32:04.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.178+0000 7fedee461740 20 client.25276 trim_cache size 0 max 16384 2024-09-12T02:32:04.179 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 msgr2=0x7fedd00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 0x7fedd00a5180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5651786c7ac0 tx=0x7fede0005f90 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 msgr2=0x7fede41a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 0x7fede41a4bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedd402aa70 tx=0x7fedd40305d0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 shutdown_connections 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fedd00a2cc0 0x7fedd00a5180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fede4112ba0 0x7fede419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.179+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fede4074eb0 0x7fede41a4bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.180+0000 7fedec088640 1 --2- 172.21.15.1:0/4150201843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede4074590 0x7fede41a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.180+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 >> 172.21.15.1:0/4150201843 conn(0x7fede40fd8b0 msgr2=0x7fede40fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.180+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 shutdown_connections 2024-09-12T02:32:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:04.180+0000 7fedec088640 1 -- 172.21.15.1:0/4150201843 wait complete. 2024-09-12T02:32:05.127 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:05.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.694+0000 7f66a269a640 1 -- 172.21.15.1:0/3820425738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c100a90 msgr2=0x7f669c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.694+0000 7f66a269a640 1 --2- 172.21.15.1:0/3820425738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c100a90 0x7f669c100ef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6690009930 tx=0x7f669002a420 comp rx=0 tx=0).stop 2024-09-12T02:32:05.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 -- 172.21.15.1:0/3820425738 shutdown_connections 2024-09-12T02:32:05.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 --2- 172.21.15.1:0/3820425738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c100a90 0x7f669c100ef0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 --2- 172.21.15.1:0/3820425738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c101430 0x7f669c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 --2- 172.21.15.1:0/3820425738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c106a90 0x7f669c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 -- 172.21.15.1:0/3820425738 >> 172.21.15.1:0/3820425738 conn(0x7f669c0fc7d0 msgr2=0x7f669c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 -- 172.21.15.1:0/3820425738 shutdown_connections 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.695+0000 7f66a269a640 1 -- 172.21.15.1:0/3820425738 wait complete. 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 Processor -- start 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 -- start start 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c100a90 0x7f669c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c101430 0x7f669c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f669c110ee0 con 0x7f669c101430 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.696+0000 7f66a269a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f669c110d60 con 0x7f669c106a90 2024-09-12T02:32:05.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a269a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f669c111060 con 0x7f669c100a90 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:52922/0 (socket says 172.21.15.1:52922) 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 -- 172.21.15.1:0/3519392887 learned_addr learned my addr 172.21.15.1:0/3519392887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f669bfff640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c100a90 0x7f669c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 -- 172.21.15.1:0/3519392887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c100a90 msgr2=0x7f669c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c100a90 0x7f669c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 -- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c101430 msgr2=0x7f669c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c101430 0x7f669c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 -- 172.21.15.1:0/3519392887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c19d420 con 0x7f669c106a90 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.697+0000 7f66a0c37640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f669400eb10 tx=0x7f669400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.698+0000 7f66997fa640 1 -- 172.21.15.1:0/3519392887 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694004b20 con 0x7f669c106a90 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.698+0000 7f66997fa640 1 -- 172.21.15.1:0/3519392887 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6694004cc0 con 0x7f669c106a90 2024-09-12T02:32:05.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.698+0000 7f66997fa640 1 -- 172.21.15.1:0/3519392887 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694005650 con 0x7f669c106a90 2024-09-12T02:32:05.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.698+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c19d710 con 0x7f669c106a90 2024-09-12T02:32:05.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.698+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c19db40 con 0x7f669c106a90 2024-09-12T02:32:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.701+0000 7f66997fa640 1 -- 172.21.15.1:0/3519392887 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6694005810 con 0x7f669c106a90 2024-09-12T02:32:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 Processor -- start 2024-09-12T02:32:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66997fa640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 0x7f66840a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 -- start start 2024-09-12T02:32:05.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66997fa640 1 -- 172.21.15.1:0/3519392887 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f66940d3790 con 0x7f669c106a90 2024-09-12T02:32:05.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb805510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb807e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f669b7fe640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 0x7f66840a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb757620 con 0x55dfbb7f1f80 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb6fee50 con 0x55dfbb7f28a0 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.702+0000 7f66a4a73740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb7535e0 con 0x55dfbb805a50 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49988/0 (socket says 172.21.15.1:49988) 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669bfff640 1 -- 172.21.15.1:0/266396750 learned_addr learned my addr 172.21.15.1:0/266396750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f66a0c37640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb807e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb805510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 -- 172.21.15.1:0/266396750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 msgr2=0x55dfbb807e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb807e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 -- 172.21.15.1:0/266396750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 msgr2=0x55dfbb7f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669b7fe640 1 -- 172.21.15.1:0/266396750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfbb6efd40 con 0x55dfbb7f28a0 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.703+0000 7f669bfff640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.704+0000 7f669b7fe640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 0x7f66840a5140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66900096c0 tx=0x7f6690005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.704+0000 7f669b7fe640 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb805510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6690009230 tx=0x7f6690042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=167d7f383861088e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.704+0000 7f66827fc640 1 -- 172.21.15.1:0/266396750 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669004c070 con 0x55dfbb7f28a0 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.704+0000 7f66827fc640 1 -- 172.21.15.1:0/266396750 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6690043070 con 0x55dfbb7f28a0 2024-09-12T02:32:05.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.704+0000 7f66827fc640 1 -- 172.21.15.1:0/266396750 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690035040 con 0x55dfbb7f28a0 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 -- 172.21.15.1:0/266396750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 msgr2=0x55dfbb805510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb805510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6690009230 tx=0x7f6690042000 comp rx=0 tx=0).stop 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 -- 172.21.15.1:0/266396750 shutdown_connections 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb807e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb805510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 --2- 172.21.15.1:0/266396750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 -- 172.21.15.1:0/266396750 >> 172.21.15.1:0/266396750 conn(0x55dfbb7ee5f0 msgr2=0x55dfbb7ee9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 -- 172.21.15.1:0/266396750 shutdown_connections 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.705+0000 7f66a4a73740 1 -- 172.21.15.1:0/266396750 wait complete. 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.706+0000 7f66a4a73740 1 -- start start 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.706+0000 7f66a4a73740 1 Processor -- start 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.706+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb802fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb803500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb808560 con 0x55dfbb805a50 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb6dff10 con 0x55dfbb7f28a0 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dfbb8086e0 con 0x55dfbb7f1f80 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40476/0 (socket says 172.21.15.1:40476) 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 -- 172.21.15.1:0/2823966385 learned_addr learned my addr 172.21.15.1:0/2823966385 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:05.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669b7fe640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb802fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a0c37640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb803500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 -- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 msgr2=0x55dfbb802fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb802fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 -- 172.21.15.1:0/2823966385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 msgr2=0x55dfbb803500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb803500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 10 client.0 _ll_register_callbacks cb 0x55dfbb703db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f669bfff640 1 -- 172.21.15.1:0/2823966385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfbb466580 con 0x55dfbb7f1f80 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a0c37640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb803500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.707+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6690043070 con 0x55dfbb7f1f80 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.708+0000 7f669bfff640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f668c0126d0 tx=0x7f668c012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684765062d56f8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.708+0000 7f667b7fe640 10 client.25288 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.708+0000 7f667b7fe640 1 -- 172.21.15.1:0/2823966385 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c011bb0 con 0x55dfbb7f1f80 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.708+0000 7f667b7fe640 1 -- 172.21.15.1:0/2823966385 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f668c011d50 con 0x55dfbb7f1f80 2024-09-12T02:32:05.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.708+0000 7f667b7fe640 1 -- 172.21.15.1:0/2823966385 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f668c01c420 con 0x55dfbb7f1f80 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f66a4a73740 10 client.25288 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dfbb530960 con 0x55dfbb7f1f80 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f667b7fe640 1 -- 172.21.15.1:0/2823966385 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f668c026470 con 0x55dfbb7f1f80 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f66a4a73740 10 client.25288 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f66a4a73740 10 client.25288 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.709+0000 7f66a4a73740 20 client.25288 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.710+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb815900 0x55dfbb817da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.710+0000 7f66a4a73740 4 client.25288 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.710+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfbb764b90 con 0x55dfbb815900 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.710+0000 7f669b7fe640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb815900 0x55dfbb817da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.711+0000 7f669b7fe640 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb815900 0x55dfbb817da0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca496a820af496f server_cookie=41218fe58057523f in_seq=0 out_seq=0 2024-09-12T02:32:05.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.711+0000 7f667b7fe640 10 client.25288 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f667b7fe640 1 -- 172.21.15.1:0/2823966385 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfbb764b90 con 0x55dfbb815900 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f667b7fe640 10 client.25288 handle_command_reply: tid=0 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 client.25288 shutdown 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 msgr2=0x55dfbb802a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f668c0126d0 tx=0x7f668c012b90 comp rx=0 tx=0).stop 2024-09-12T02:32:05.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 shutdown_connections 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb803500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb815900 0x55dfbb817da0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb802fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2823966385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f1f80 0x55dfbb802a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.712+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 >> 172.21.15.1:0/2823966385 conn(0x55dfbb7ee5f0 msgr2=0x55dfbb7f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.713+0000 7f667b7fe640 0 client.25288 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.713+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 shutdown_connections 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.713+0000 7f66a4a73740 1 -- 172.21.15.1:0/2823966385 wait complete. 2024-09-12T02:32:05.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.713+0000 7f66a4a73740 20 client.25288 trim_cache size 0 max 16384 2024-09-12T02:32:05.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.730+0000 7f66a4a73740 1 Processor -- start 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.730+0000 7f66a4a73740 1 -- start start 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb81d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1ab490 con 0x55dfbb7f1f80 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1acfd0 con 0x55dfbb7f28a0 2024-09-12T02:32:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a4a73740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1abb60 con 0x55dfbb805a50 2024-09-12T02:32:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f669bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40478/0 (socket says 172.21.15.1:40478) 2024-09-12T02:32:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 -- 172.21.15.1:0/2822842805 learned_addr learned my addr 172.21.15.1:0/2822842805 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f669b7fe640 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb81d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 -- 172.21.15.1:0/2822842805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 msgr2=0x55dfbb81d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb81d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 -- 172.21.15.1:0/2822842805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 msgr2=0x55dfbb7eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f66a0c37640 1 -- 172.21.15.1:0/2822842805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfbb801a30 con 0x55dfbb805a50 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.731+0000 7f669b7fe640 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb81d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.732+0000 7f66a0c37640 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66940d1210 tx=0x7f66940d3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ca28f0f9632fa10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.732+0000 7f6681ffb640 1 -- 172.21.15.1:0/2822842805 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940a4320 con 0x55dfbb805a50 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.732+0000 7f6681ffb640 1 -- 172.21.15.1:0/2822842805 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66940a8be0 con 0x55dfbb805a50 2024-09-12T02:32:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.732+0000 7f6681ffb640 1 -- 172.21.15.1:0/2822842805 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940bebb0 con 0x55dfbb805a50 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- 172.21.15.1:0/2822842805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 msgr2=0x55dfbb81dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66940d1210 tx=0x7f66940d3040 comp rx=0 tx=0).stop 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- 172.21.15.1:0/2822842805 shutdown_connections 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb805a50 0x55dfbb81dbf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f28a0 0x55dfbb81d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 --2- 172.21.15.1:0/2822842805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- 172.21.15.1:0/2822842805 >> 172.21.15.1:0/2822842805 conn(0x55dfbb7ee5f0 msgr2=0x55dfbb7fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- 172.21.15.1:0/2822842805 shutdown_connections 2024-09-12T02:32:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- 172.21.15.1:0/2822842805 wait complete. 2024-09-12T02:32:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.733+0000 7f66a4a73740 1 -- start start 2024-09-12T02:32:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 Processor -- start 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb8005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1ac900 con 0x55dfbb805a50 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1ac230 con 0x55dfbb7f1f80 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.734+0000 7f66a4a73740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f669c1a9490 con 0x55dfbb7f28a0 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40484/0 (socket says 172.21.15.1:40484) 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 -- 172.21.15.1:0/739578138 learned_addr learned my addr 172.21.15.1:0/739578138 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f66a4a73740 10 client.0 _ll_register_callbacks cb 0x7f668c009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f66a0c37640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb8005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669bfff640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 -- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f1f80 msgr2=0x55dfbb7ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 -- 172.21.15.1:0/739578138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 msgr2=0x55dfbb8005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb8005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f669b7fe640 1 -- 172.21.15.1:0/739578138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfbb87f730 con 0x55dfbb7f28a0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.735+0000 7f66a0c37640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb8005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f669b7fe640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6690009230 tx=0x7f6690009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7731fd1108f6eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f667b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669004c040 con 0x55dfbb7f28a0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f66900315b0 con 0x55dfbb7f28a0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66940a8be0 con 0x55dfbb7f28a0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.736+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66900317b0 con 0x55dfbb7f28a0 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.737+0000 7f66a4a73740 10 client.25294 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.737+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfbb880a50 con 0x55dfbb7f28a0 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66940a8be0 con 0x55dfbb7f28a0 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6690053040 con 0x55dfbb7f28a0 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 10 client.25294 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 10 client.25294 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 20 client.25294 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb880d90 0x55dfbb883180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 4 client.25294 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f5d4fa5", "release": true, "await": true}] 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.738+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f5d4fa5", "release": true, "await": true}) -- 0x55dfbb75f0a0 con 0x55dfbb880d90 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.739+0000 7f669bfff640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb880d90 0x55dfbb883180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.739+0000 7f667b7fe640 10 client.25294 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.739+0000 7f669bfff640 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb880d90 0x55dfbb883180 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d85f4ff3532edd server_cookie=7cec30b7f9360592 in_seq=0 out_seq=0 2024-09-12T02:32:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.740+0000 7f667b7fe640 1 -- 172.21.15.1:0/739578138 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55dfbb75f0a0 con 0x55dfbb880d90 2024-09-12T02:32:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.740+0000 7f667b7fe640 10 client.25294 handle_command_reply: tid=0 2024-09-12T02:32:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.740+0000 7f66a4a73740 1 client.25294 shutdown 2024-09-12T02:32:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 msgr2=0x55dfbb800060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6690009230 tx=0x7f6690009260 comp rx=0 tx=0).stop 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 shutdown_connections 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfbb805a50 0x55dfbb8005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dfbb880d90 0x55dfbb883180 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfbb7f28a0 0x55dfbb800060 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6690009230 tx=0x7f6690009260 comp rx=0 tx=0).stop 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 --2- 172.21.15.1:0/739578138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dfbb7f1f80 0x55dfbb7ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 >> 172.21.15.1:0/739578138 conn(0x55dfbb7ee5f0 msgr2=0x55dfbb7f39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.741+0000 7f667b7fe640 0 client.25294 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.742+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 shutdown_connections 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.742+0000 7f66a4a73740 1 -- 172.21.15.1:0/739578138 wait complete. 2024-09-12T02:32:05.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.742+0000 7f66a4a73740 20 client.25294 trim_cache size 0 max 16384 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24494, 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 4, 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "f5d4fa5": { 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 4, 2024-09-12T02:32:05.744 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:05.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:05.746 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:05.746 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:05.746 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:05.746 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 msgr2=0x7f66840a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 0x7f66840a5140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f66900096c0 tx=0x7f6690005d90 comp rx=0 tx=0).stop 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 msgr2=0x7f669c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f669400eb10 tx=0x7f669400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 shutdown_connections 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f66840a2c80 0x7f66840a5140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f669c101430 0x7f669c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669c106a90 0x7f669c19cd40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 --2- 172.21.15.1:0/3519392887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c100a90 0x7f669c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 >> 172.21.15.1:0/3519392887 conn(0x7f669c0fc7d0 msgr2=0x7f669c0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 shutdown_connections 2024-09-12T02:32:05.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:05.743+0000 7f66a269a640 1 -- 172.21.15.1:0/3519392887 wait complete. 2024-09-12T02:32:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:05 smithi001 ceph-mon[31252]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:05.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:05 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:05 smithi173 ceph-mon[35036]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:05.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:05 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:05.965 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:05 smithi134 ceph-mon[35091]: pgmap v377: 97 pgs: 97 active+clean; 667 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:05.965 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:05.965 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:05.965 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:05 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:06.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:32:06.052 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:32:06.712 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f5d4fa5', total seconds elapsed: 30.9 2024-09-12T02:32:06.848 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:06.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:06.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:06.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:06.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:32:07.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.434+0000 7f094a695640 1 -- 172.21.15.1:0/3610613853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101470 msgr2=0x7f0944101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.434+0000 7f094a695640 1 --2- 172.21.15.1:0/3610613853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101470 0x7f0944101850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0934009900 tx=0x7f093402a410 comp rx=0 tx=0).stop 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 -- 172.21.15.1:0/3610613853 shutdown_connections 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 --2- 172.21.15.1:0/3610613853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 0x7f094410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 --2- 172.21.15.1:0/3610613853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101e20 0x7f09441056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 --2- 172.21.15.1:0/3610613853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101470 0x7f0944101850 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 -- 172.21.15.1:0/3610613853 >> 172.21.15.1:0/3610613853 conn(0x7f0944077230 msgr2=0x7f09440fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 -- 172.21.15.1:0/3610613853 shutdown_connections 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 -- 172.21.15.1:0/3610613853 wait complete. 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.435+0000 7f094a695640 1 Processor -- start 2024-09-12T02:32:07.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 -- start start 2024-09-12T02:32:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 0x7f09441982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 0x7f094419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0944110e50 con 0x7f0944101e20 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0944110cd0 con 0x7f0944101470 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f094a695640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0944110fd0 con 0x7f0944105de0 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f093bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f093bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50048/0 (socket says 172.21.15.1:50048) 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f093bfff640 1 -- 172.21.15.1:0/3068062826 learned_addr learned my addr 172.21.15.1:0/3068062826 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f0948c32640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 0x7f094419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.436+0000 7f0943fff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 0x7f09441982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 -- 172.21.15.1:0/3068062826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 msgr2=0x7f094419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 0x7f094419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 -- 172.21.15.1:0/3068062826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 msgr2=0x7f09441982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 0x7f09441982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 -- 172.21.15.1:0/3068062826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094419d270 con 0x7f0944101e20 2024-09-12T02:32:07.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f0943fff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 0x7f09441982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f093bfff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c890 tx=0x7f092c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f0941ffb640 1 -- 172.21.15.1:0/3068062826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c004220 con 0x7f0944101e20 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f0941ffb640 1 -- 172.21.15.1:0/3068062826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f092c0043c0 con 0x7f0944101e20 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.437+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094419d560 con 0x7f0944101e20 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.439+0000 7f0941ffb640 1 -- 172.21.15.1:0/3068062826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0049e0 con 0x7f0944101e20 2024-09-12T02:32:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.439+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09440fc630 con 0x7f0944101e20 2024-09-12T02:32:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.441+0000 7f0941ffb640 1 -- 172.21.15.1:0/3068062826 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f092c004c40 con 0x7f0944101e20 2024-09-12T02:32:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.442+0000 7f0941ffb640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 0x7f09300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 Processor -- start 2024-09-12T02:32:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 -- start start 2024-09-12T02:32:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f0943fff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 0x7f09300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f0941ffb640 1 -- 172.21.15.1:0/3068062826 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f092c0d1320 con 0x7f0944101e20 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2b370 0x55b9b1a2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a38940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b9b1988280 con 0x55b9b1a2b370 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9b192fb10 con 0x55b9b1a36550 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f094ca6e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b9b1984240 con 0x55b9b1a2bc90 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f093bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f093bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40524/0 (socket says 172.21.15.1:40524) 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.443+0000 7f093bfff640 1 -- 172.21.15.1:0/2023168307 learned_addr learned my addr 172.21.15.1:0/2023168307 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f0948c32640 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a38940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f0943fff640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 0x7f09300a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09340096c0 tx=0x7f093400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f0943fff640 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2b370 0x55b9b1a2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 -- 172.21.15.1:0/2023168307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 msgr2=0x55b9b1a38940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a38940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 -- 172.21.15.1:0/2023168307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2b370 msgr2=0x55b9b1a2b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2b370 0x55b9b1a2b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 -- 172.21.15.1:0/2023168307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b193c1f0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093bfff640 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f092c096e60 tx=0x7f092c09a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a3561096420c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093a7fc640 1 -- 172.21.15.1:0/2023168307 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0cf020 con 0x55b9b1a2bc90 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093a7fc640 1 -- 172.21.15.1:0/2023168307 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f092c09edb0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.444+0000 7f093a7fc640 1 -- 172.21.15.1:0/2023168307 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c099e50 con 0x55b9b1a2bc90 2024-09-12T02:32:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.445+0000 7f094ca6e740 1 -- 172.21.15.1:0/2023168307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 msgr2=0x55b9b1a36010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.445+0000 7f094ca6e740 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f092c096e60 tx=0x7f092c09a360 comp rx=0 tx=0).stop 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 -- 172.21.15.1:0/2023168307 shutdown_connections 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a38940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a36010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 --2- 172.21.15.1:0/2023168307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2b370 0x55b9b1a2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 -- 172.21.15.1:0/2023168307 >> 172.21.15.1:0/2023168307 conn(0x55b9b1a27900 msgr2=0x55b9b1a27ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 -- 172.21.15.1:0/2023168307 shutdown_connections 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.446+0000 7f094ca6e740 1 -- 172.21.15.1:0/2023168307 wait complete. 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.447+0000 7f094ca6e740 1 -- start start 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.447+0000 7f094ca6e740 1 Processor -- start 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.447+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a2b370 0x55b9b1a334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.447+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 0x55b9b1a33f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f094ca6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b9b1a39120 con 0x55b9b1a2bc90 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f094ca6e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9b1942f10 con 0x55b9b1a2b370 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f094ca6e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b9b1a392a0 con 0x55b9b1a36550 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f094ca6e740 10 client.0 _ll_register_callbacks cb 0x55b9b190ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f0943fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a2b370 0x55b9b1a334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50066/0 (socket says 172.21.15.1:50066) 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 -- 172.21.15.1:0/4100537736 learned_addr learned my addr 172.21.15.1:0/4100537736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f0948c32640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 0x55b9b1a33f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 -- 172.21.15.1:0/4100537736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 msgr2=0x55b9b1a33f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 0x55b9b1a33f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 -- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a2b370 msgr2=0x55b9b1a334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a2b370 0x55b9b1a334b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.448+0000 7f093bfff640 1 -- 172.21.15.1:0/4100537736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b16f96a0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f0948c32640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 0x55b9b1a33f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f093bfff640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f092c0a3140 tx=0x7f092c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bdf5ace7a449d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f09237fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b8060 con 0x55b9b1a2bc90 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f092c09a050 con 0x55b9b1a2bc90 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f092c09edb0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f092c0b9250 con 0x55b9b1a2bc90 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f094ca6e740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:07.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.449+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9b1a39120 con 0x55b9b1a2bc90 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f092c09edb0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f092c099ad0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f094ca6e740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f094ca6e740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f094ca6e740 20 client.15822 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.450+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1a48310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.451+0000 7f094ca6e740 4 client.15822 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.451+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9b19957f0 con 0x55b9b1a45f20 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.451+0000 7f0943fff640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1a48310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.452+0000 7f09237fe640 10 client.15822 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.452+0000 7f0943fff640 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1a48310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9dce4b462e5d93a server_cookie=78a882fe9bbfdd13 in_seq=0 out_seq=0 2024-09-12T02:32:07.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.452+0000 7f09237fe640 1 -- 172.21.15.1:0/4100537736 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9b19957f0 con 0x55b9b1a45f20 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.452+0000 7f09237fe640 10 client.15822 handle_command_reply: tid=0 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 client.15822 shutdown 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 msgr2=0x55b9b1a339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f092c0a3140 tx=0x7f092c0076c0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 shutdown_connections 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a339f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1a48310 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a36550 0x55b9b1a33f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f09237fe640 0 client.15822 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 --2- 172.21.15.1:0/4100537736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a2b370 0x55b9b1a334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 >> 172.21.15.1:0/4100537736 conn(0x55b9b1a27900 msgr2=0x55b9b1a1e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 shutdown_connections 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.453+0000 7f094ca6e740 1 -- 172.21.15.1:0/4100537736 wait complete. 2024-09-12T02:32:07.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.454+0000 7f094ca6e740 20 client.15822 trim_cache size 0 max 16384 2024-09-12T02:32:07.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.486+0000 7f094ca6e740 1 Processor -- start 2024-09-12T02:32:07.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.486+0000 7f094ca6e740 1 -- start start 2024-09-12T02:32:07.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a4de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a33470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f09441ab5d0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09441ad110 con 0x55b9b1a36550 2024-09-12T02:32:07.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f094ca6e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09441abca0 con 0x55b9b1a2b370 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f0943fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f0943fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40534/0 (socket says 172.21.15.1:40534) 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f093bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a4de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f0943fff640 1 -- 172.21.15.1:0/257406041 learned_addr learned my addr 172.21.15.1:0/257406041 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.487+0000 7f0948c32640 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a33470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 -- 172.21.15.1:0/257406041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 msgr2=0x55b9b1a33470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a33470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 -- 172.21.15.1:0/257406041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 msgr2=0x55b9b1a4de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a4de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 -- 172.21.15.1:0/257406041 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b1a35d80 con 0x55b9b1a2b370 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0943fff640 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0934009850 tx=0x7f093403e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6907b83bcf8367ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0939ffb640 1 -- 172.21.15.1:0/257406041 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934057070 con 0x55b9b1a2b370 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0939ffb640 1 -- 172.21.15.1:0/257406041 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0934005630 con 0x55b9b1a2b370 2024-09-12T02:32:07.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.488+0000 7f0939ffb640 1 -- 172.21.15.1:0/257406041 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934035070 con 0x55b9b1a2b370 2024-09-12T02:32:07.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 -- 172.21.15.1:0/257406041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 msgr2=0x55b9b1a4d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0934009850 tx=0x7f093403e000 comp rx=0 tx=0).stop 2024-09-12T02:32:07.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 -- 172.21.15.1:0/257406041 shutdown_connections 2024-09-12T02:32:07.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a4de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a33470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 --2- 172.21.15.1:0/257406041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a4d940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 -- 172.21.15.1:0/257406041 >> 172.21.15.1:0/257406041 conn(0x55b9b1a27900 msgr2=0x55b9b1a1e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 -- 172.21.15.1:0/257406041 shutdown_connections 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.489+0000 7f094ca6e740 1 -- 172.21.15.1:0/257406041 wait complete. 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.490+0000 7f094ca6e740 1 -- start start 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.490+0000 7f094ca6e740 1 Processor -- start 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.490+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a3e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.490+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a2ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.490+0000 7f094ca6e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f094ca6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f09441aca40 con 0x55b9b1a2bc90 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f094ca6e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09441ac370 con 0x55b9b1a36550 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f094ca6e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09441a95b0 con 0x55b9b1a2b370 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f094ca6e740 10 client.0 _ll_register_callbacks cb 0x7f092c09a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f0943fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a3e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f0943fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a3e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:40544/0 (socket says 172.21.15.1:40544) 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f0948c32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f0943fff640 1 -- 172.21.15.1:0/23882179 learned_addr learned my addr 172.21.15.1:0/23882179 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a2ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 -- 172.21.15.1:0/23882179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 msgr2=0x55b9b1a3e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a3e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 -- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 msgr2=0x55b9b1a30450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:07.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a30450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.491+0000 7f093bfff640 1 -- 172.21.15.1:0/23882179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b1a30a10 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f093bfff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a2ff10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55b9b1a34a60 tx=0x7f092c007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8256dd7aa0740626 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f09237fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b8070 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f092c0850b0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9b198fd00 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f092c0b93f0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f094ca6e740 10 client.15828 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9b1a30a10 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.492+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f092c09b100 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f092c0852b0 con 0x55b9b1a2bc90 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 10 client.15828 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:07.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 20 client.15828 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1ab2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 4 client.15828 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b9b198fd00 con 0x55b9b1a45f20 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f0943fff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1ab2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f09237fe640 10 client.15828 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:07.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.493+0000 7f0943fff640 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1ab2a70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51600c9d2c395673 server_cookie=dfbe3ded86b226cb in_seq=0 out_seq=0 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.494+0000 7f09237fe640 1 -- 172.21.15.1:0/23882179 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b9b198fd00 con 0x55b9b1a45f20 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.494+0000 7f09237fe640 10 client.15828 handle_command_reply: tid=0 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 client.15828 shutdown 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 msgr2=0x55b9b1a2ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a2ff10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55b9b1a34a60 tx=0x7f092c007730 comp rx=0 tx=0).stop 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 shutdown_connections 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b9b1a2bc90 0x55b9b1a2ff10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b9b1a45f20 0x55b9b1ab2a70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f09237fe640 0 client.15828 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:07.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9b1a36550 0x55b9b1a30450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 --2- 172.21.15.1:0/23882179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b9b1a2b370 0x55b9b1a3e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.495+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 >> 172.21.15.1:0/23882179 conn(0x55b9b1a27900 msgr2=0x55b9b1a34b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.496+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 shutdown_connections 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.496+0000 7f094ca6e740 1 -- 172.21.15.1:0/23882179 wait complete. 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.496+0000 7f094ca6e740 20 client.15828 trim_cache size 0 max 16384 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "572727e1-4f1d-4ec0-b722-3db9cd0a4d94", 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-12T02:32:07.501 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 msgr2=0x7f09300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 0x7f09300a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09340096c0 tx=0x7f093400b040 comp rx=0 tx=0).stop 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 msgr2=0x7f0944198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c890 tx=0x7f092c00cd50 comp rx=0 tx=0).stop 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 shutdown_connections 2024-09-12T02:32:07.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09300a2c00 0x7f09300a50c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0944101e20 0x7f0944198800 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0944105de0 0x7f094419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 --2- 172.21.15.1:0/3068062826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944101470 0x7f09441982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 >> 172.21.15.1:0/3068062826 conn(0x7f0944077230 msgr2=0x7f09441054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 shutdown_connections 2024-09-12T02:32:07.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:07.499+0000 7f094a695640 1 -- 172.21.15.1:0/3068062826 wait complete. 2024-09-12T02:32:07.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:07 smithi173 ceph-mon[35036]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:08.021 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:07 smithi001 ceph-mon[31252]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:07 smithi134 ceph-mon[35091]: pgmap v378: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:08.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:32:08.533 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:08 smithi173 ceph-mon[35036]: scrub queued for path: / 2024-09-12T02:32:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:08 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:08 smithi173 ceph-mon[35036]: scrub summary: active paths [/] 2024-09-12T02:32:08.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:08 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:08 smithi001 ceph-mon[31252]: scrub queued for path: / 2024-09-12T02:32:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:08 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:08 smithi001 ceph-mon[31252]: scrub summary: active paths [/] 2024-09-12T02:32:09.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:08 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:08 smithi134 ceph-mon[35091]: scrub queued for path: / 2024-09-12T02:32:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:08 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:08 smithi134 ceph-mon[35091]: scrub summary: active paths [/] 2024-09-12T02:32:09.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:08 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:09.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:09 smithi001 ceph-mon[31252]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:32:09.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:09 smithi173 ceph-mon[35036]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:32:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:09 smithi134 ceph-mon[35091]: pgmap v379: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T02:32:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 -- 172.21.15.1:0/3004826229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed41009b0 msgr2=0x7f8ed4100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/3004826229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed41009b0 0x7f8ed4100d90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec402a410 comp rx=0 tx=0).stop 2024-09-12T02:32:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 -- 172.21.15.1:0/3004826229 shutdown_connections 2024-09-12T02:32:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/3004826229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed410e4d0 0x7f8ed41108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/3004826229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed4101360 0x7f8ed410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/3004826229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed41009b0 0x7f8ed4100d90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 -- 172.21.15.1:0/3004826229 >> 172.21.15.1:0/3004826229 conn(0x7f8ed40fc7d0 msgr2=0x7f8ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 -- 172.21.15.1:0/3004826229 shutdown_connections 2024-09-12T02:32:10.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.507+0000 7f8ed8f46640 1 -- 172.21.15.1:0/3004826229 wait complete. 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.508+0000 7f8ed8f46640 1 Processor -- start 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.508+0000 7f8ed8f46640 1 -- start start 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.508+0000 7f8ed8f46640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed41009b0 0x7f8ed410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.508+0000 7f8ed8f46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 0x7f8ed410af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed8f46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed8f46640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4114230 con 0x7f8ed4101360 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed8f46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41140b0 con 0x7f8ed410e4d0 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed8f46640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41143b0 con 0x7f8ed41009b0 2024-09-12T02:32:10.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed41009b0 0x7f8ed410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53028/0 (socket says 172.21.15.1:53028) 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/4039868591 learned_addr learned my addr 172.21.15.1:0/4039868591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 0x7f8ed410af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/4039868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed41009b0 msgr2=0x7f8ed410ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed41009b0 0x7f8ed410ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 msgr2=0x7f8ed410af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 0x7f8ed410af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.509+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/4039868591 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed41aaf70 con 0x7f8ed410e4d0 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 0x7f8ed410af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:10.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00eaa0 tx=0x7f8ecc00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ec37fe640 1 -- 172.21.15.1:0/4039868591 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00cdb0 con 0x7f8ed410e4d0 2024-09-12T02:32:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed41ab140 con 0x7f8ed410e4d0 2024-09-12T02:32:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ec37fe640 1 -- 172.21.15.1:0/4039868591 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ecc005020 con 0x7f8ed410e4d0 2024-09-12T02:32:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ec37fe640 1 -- 172.21.15.1:0/4039868591 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0116d0 con 0x7f8ed410e4d0 2024-09-12T02:32:10.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.510+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed41ab670 con 0x7f8ed410e4d0 2024-09-12T02:32:10.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.513+0000 7f8edb31f740 1 Processor -- start 2024-09-12T02:32:10.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.514+0000 7f8ec37fe640 1 -- 172.21.15.1:0/4039868591 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8ecc005540 con 0x7f8ed410e4d0 2024-09-12T02:32:10.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8ec37fe640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 0x7f8ebc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8ec37fe640 1 -- 172.21.15.1:0/4039868591 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8ecc0cf280 con 0x7f8ed410e4d0 2024-09-12T02:32:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 -- start start 2024-09-12T02:32:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 0x7f8ebc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76f9680 0x558bc76fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558bc76542e0 con 0x558bc76eedc0 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558bc75fbce0 con 0x558bc76ee4a0 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.515+0000 7f8edb31f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc76502a0 con 0x558bc76f9680 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53042/0 (socket says 172.21.15.1:53042) 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 -- 172.21.15.1:0/839202745 learned_addr learned my addr 172.21.15.1:0/839202745 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76f9680 0x558bc76fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 -- 172.21.15.1:0/839202745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76f9680 msgr2=0x558bc76fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76f9680 0x558bc76fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 -- 172.21.15.1:0/839202745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 msgr2=0x558bc76f9140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:10.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f9140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 -- 172.21.15.1:0/839202745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc75e0440 con 0x558bc76ee4a0 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 0x7f8ebc0a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80058c0 tx=0x7f8ec8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.516+0000 7f8ed259c640 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec4005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc542c3282f6730f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.517+0000 7f8ec0ff9640 1 -- 172.21.15.1:0/839202745 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec403f070 con 0x558bc76ee4a0 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.517+0000 7f8ec0ff9640 1 -- 172.21.15.1:0/839202745 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec4004030 con 0x558bc76ee4a0 2024-09-12T02:32:10.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.517+0000 7f8ec0ff9640 1 -- 172.21.15.1:0/839202745 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4035070 con 0x558bc76ee4a0 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- 172.21.15.1:0/839202745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 msgr2=0x558bc76ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec4005e80 comp rx=0 tx=0).stop 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- 172.21.15.1:0/839202745 shutdown_connections 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76f9680 0x558bc76fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 --2- 172.21.15.1:0/839202745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ee880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- 172.21.15.1:0/839202745 >> 172.21.15.1:0/839202745 conn(0x558bc76eaa30 msgr2=0x558bc76eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- 172.21.15.1:0/839202745 shutdown_connections 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- 172.21.15.1:0/839202745 wait complete. 2024-09-12T02:32:10.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.518+0000 7f8edb31f740 1 -- start start 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 Processor -- start 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558bc76fc250 con 0x558bc76f9680 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558bc760f050 con 0x558bc76eedc0 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc76fc3d0 con 0x558bc76ee4a0 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8edb31f740 10 client.0 _ll_register_callbacks cb 0x558bc764f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:53046/0 (socket says 172.21.15.1:53046) 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/24633079 learned_addr learned my addr 172.21.15.1:0/24633079 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.519+0000 7f8ed259c640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/24633079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 msgr2=0x558bc76f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/24633079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 msgr2=0x558bc76f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/24633079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc73c53c0 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8011470 tx=0x7f8ec80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d8d5d8da1e4307 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8eb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8022070 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.520+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8ec801e860 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.521+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ec4004030 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.521+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ec802c050 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.521+0000 7f8edb31f740 10 client.25349 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.521+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bc7707c80 con 0x558bc76eedc0 2024-09-12T02:32:10.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.521+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec4004030 con 0x558bc76eedc0 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ec80103d0 con 0x558bc76eedc0 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8edb31f740 10 client.25349 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8edb31f740 10 client.25349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8edb31f740 20 client.25349 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7709190 0x558bc770b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.522+0000 7f8edb31f740 4 client.25349 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.523+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bc7661850 con 0x558bc7709190 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.523+0000 7f8ed259c640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7709190 0x558bc770b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.523+0000 7f8eb9ffb640 10 client.25349 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.523+0000 7f8ed259c640 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7709190 0x558bc770b5c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdbbc2416cb181d6 server_cookie=4ba6858f947c5e2d in_seq=0 out_seq=0 2024-09-12T02:32:10.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.524+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/24633079 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bc7661850 con 0x558bc7709190 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.524+0000 7f8eb9ffb640 10 client.25349 handle_command_reply: tid=0 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.524+0000 7f8edb31f740 1 client.25349 shutdown 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.524+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 msgr2=0x558bc76f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.524+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8011470 tx=0x7f8ec80046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 shutdown_connections 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7709190 0x558bc770b5c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76eedc0 0x558bc76f6280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 --2- 172.21.15.1:0/24633079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 >> 172.21.15.1:0/24633079 conn(0x558bc76eaa30 msgr2=0x558bc76f0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8eb9ffb640 0 client.25349 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 shutdown_connections 2024-09-12T02:32:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 1 -- 172.21.15.1:0/24633079 wait complete. 2024-09-12T02:32:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.525+0000 7f8edb31f740 20 client.25349 trim_cache size 0 max 16384 2024-09-12T02:32:10.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.557+0000 7f8edb31f740 1 Processor -- start 2024-09-12T02:32:10.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.557+0000 7f8edb31f740 1 -- start start 2024-09-12T02:32:10.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76f9680 0x558bc7710e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b3c80 con 0x558bc76eedc0 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b57c0 con 0x558bc76f9680 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8edb31f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b4350 con 0x558bc76ee4a0 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50132/0 (socket says 172.21.15.1:50132) 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/1656958707 learned_addr learned my addr 172.21.15.1:0/1656958707 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76f9680 0x558bc7710e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/1656958707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 msgr2=0x558bc76f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/1656958707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76f9680 msgr2=0x558bc7710e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76f9680 0x558bc7710e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.558+0000 7f8ed1d9b640 1 -- 172.21.15.1:0/1656958707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc76ee2d0 con 0x558bc76eedc0 2024-09-12T02:32:10.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.559+0000 7f8ed1d9b640 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80059f0 tx=0x7f8ec80105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fcd6c04afae839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.559+0000 7f8ebbfff640 1 -- 172.21.15.1:0/1656958707 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8022070 con 0x558bc76eedc0 2024-09-12T02:32:10.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.559+0000 7f8ebbfff640 1 -- 172.21.15.1:0/1656958707 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec8010be0 con 0x558bc76eedc0 2024-09-12T02:32:10.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.559+0000 7f8ebbfff640 1 -- 172.21.15.1:0/1656958707 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004b20 con 0x558bc76eedc0 2024-09-12T02:32:10.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 -- 172.21.15.1:0/1656958707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 msgr2=0x558bc76f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80059f0 tx=0x7f8ec80105d0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 -- 172.21.15.1:0/1656958707 shutdown_connections 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76eedc0 0x558bc76f8300 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76f9680 0x558bc7710e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 --2- 172.21.15.1:0/1656958707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76ee4a0 0x558bc76f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 -- 172.21.15.1:0/1656958707 >> 172.21.15.1:0/1656958707 conn(0x558bc76eaa30 msgr2=0x558bc76eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 -- 172.21.15.1:0/1656958707 shutdown_connections 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.560+0000 7f8edb31f740 1 -- 172.21.15.1:0/1656958707 wait complete. 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 -- start start 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 Processor -- start 2024-09-12T02:32:10.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ff350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76eedc0 0x558bc76ff890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b50f0 con 0x558bc76f9680 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b4a20 con 0x558bc76ee4a0 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed41b1c60 con 0x558bc76eedc0 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8edb31f740 10 client.0 _ll_register_callbacks cb 0x7f8ec8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8ed2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50148/0 (socket says 172.21.15.1:50148) 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.561+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/2336733122 learned_addr learned my addr 172.21.15.1:0/2336733122 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed259c640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/2336733122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76eedc0 msgr2=0x558bc76ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76eedc0 0x558bc76ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 msgr2=0x558bc76ff350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ff350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 -- 172.21.15.1:0/2336733122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc7772e50 con 0x558bc76f9680 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8ed2d9d640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc098490 tx=0x7f8ecc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04b830e19e7d4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8eb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0b9060 con 0x558bc76f9680 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8ecc0051d0 con 0x558bc76f9680 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.562+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ec8010be0 con 0x558bc76f9680 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ecc01f040 con 0x558bc76f9680 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:10.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558bc7774150 con 0x558bc76f9680 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ec8010be0 con 0x558bc76f9680 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8ecc00f040 con 0x558bc76f9680 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 20 client.15840 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7774820 0x558bc7776c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 4 client.15840 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:32:10.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558bc765bd60 con 0x558bc7774820 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.563+0000 7f8ed259c640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7774820 0x558bc7776c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8ed259c640 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7774820 0x558bc7776c40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a758e6705da0a538 server_cookie=13322f8bbad6b7d0 in_seq=0 out_seq=0 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8eb9ffb640 10 client.15840 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8eb9ffb640 1 -- 172.21.15.1:0/2336733122 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558bc765bd60 con 0x558bc7774820 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8eb9ffb640 10 client.15840 handle_command_reply: tid=0 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 client.15840 shutdown 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 msgr2=0x558bc76ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc098490 tx=0x7f8ecc00c800 comp rx=0 tx=0).stop 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 shutdown_connections 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558bc76f9680 0x558bc76ffdd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558bc7774820 0x558bc7776c40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc76eedc0 0x558bc76ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 --2- 172.21.15.1:0/2336733122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558bc76ee4a0 0x558bc76ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.564+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 >> 172.21.15.1:0/2336733122 conn(0x558bc76eaa30 msgr2=0x558bc76f5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8eb9ffb640 0 client.15840 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 shutdown_connections 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8edb31f740 1 -- 172.21.15.1:0/2336733122 wait complete. 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8edb31f740 20 client.15840 trim_cache size 0 max 16384 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-12T02:32:10.570 INFO:teuthology.orchestra.run.smithi001.stdout: "572727e1-4f1d-4ec0-b722-3db9cd0a4d94": { 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "572727e1-4f1d-4ec0-b722-3db9cd0a4d94", 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:10.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 msgr2=0x7f8ebc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 0x7f8ebc0a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80058c0 tx=0x7f8ec8005850 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 msgr2=0x7f8ed410b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.565+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00eaa0 tx=0x7f8ecc00ef60 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 shutdown_connections 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8ebc0a2b80 0x7f8ebc0a5040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ed4101360 0x7f8ed410af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed410e4d0 0x7f8ed410b550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 --2- 172.21.15.1:0/4039868591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed41009b0 0x7f8ed410ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 >> 172.21.15.1:0/4039868591 conn(0x7f8ed40fc7d0 msgr2=0x7f8ed40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 shutdown_connections 2024-09-12T02:32:10.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:10.566+0000 7f8ed8f46640 1 -- 172.21.15.1:0/4039868591 wait complete. 2024-09-12T02:32:11.289 INFO:tasks.cephfs.filesystem:scrub status for tag:572727e1-4f1d-4ec0-b722-3db9cd0a4d94 - {'path': '/', 'tag': '572727e1-4f1d-4ec0-b722-3db9cd0a4d94', 'options': 'recursive,force'} 2024-09-12T02:32:11.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:11 smithi173 ceph-mon[35036]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:11 smithi001 ceph-mon[31252]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:11 smithi134 ceph-mon[35091]: pgmap v380: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T02:32:13.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:12 smithi001 ceph-mon[31252]: scrub summary: idle 2024-09-12T02:32:13.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:12 smithi134 ceph-mon[35091]: scrub summary: idle 2024-09-12T02:32:13.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:12 smithi173 ceph-mon[35036]: scrub summary: idle 2024-09-12T02:32:14.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:13 smithi001 ceph-mon[31252]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:14.147 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 93% (12025/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:32:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:13 smithi134 ceph-mon[35091]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:14.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:13 smithi173 ceph-mon[35036]: pgmap v381: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:14.589 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:32:14.589 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.589 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:32:14.589 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:32:14.590 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:14.591 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:32:14.595 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:32:14.622 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:32:14.625 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:32:14.625 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:32:15.334 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:32:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 -- 172.21.15.1:0/382050183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458101b60 msgr2=0x7f8458101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 --2- 172.21.15.1:0/382050183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458101b60 0x7f8458101f60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8454009900 tx=0x7f845402a440 comp rx=0 tx=0).stop 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 -- 172.21.15.1:0/382050183 shutdown_connections 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 --2- 172.21.15.1:0/382050183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8458103710 0x7f8458109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 --2- 172.21.15.1:0/382050183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8458102d50 0x7f84581031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 --2- 172.21.15.1:0/382050183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458101b60 0x7f8458101f60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 -- 172.21.15.1:0/382050183 >> 172.21.15.1:0/382050183 conn(0x7f84580fd2e0 msgr2=0x7f84580ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 -- 172.21.15.1:0/382050183 shutdown_connections 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.412+0000 7f845fe15640 1 -- 172.21.15.1:0/382050183 wait complete. 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 Processor -- start 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 -- start start 2024-09-12T02:32:15.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8458101b60 0x7f8458197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8458103710 0x7f845819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f845810d900 con 0x7f8458102d50 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f845810d780 con 0x7f8458101b60 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.413+0000 7f845fe15640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f845810da80 con 0x7f8458103710 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51528/0 (socket says 172.21.15.1:51528) 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 -- 172.21.15.1:0/614838690 learned_addr learned my addr 172.21.15.1:0/614838690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 -- 172.21.15.1:0/614838690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8458103710 msgr2=0x7f845819f560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8458103710 0x7f845819f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 -- 172.21.15.1:0/614838690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8458101b60 msgr2=0x7f8458197fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8458101b60 0x7f8458197fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 -- 172.21.15.1:0/614838690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845819fbd0 con 0x7f8458102d50 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845d3b0640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f844800b450 tx=0x7f844800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f844effd640 1 -- 172.21.15.1:0/614838690 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448015020 con 0x7f8458102d50 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f844effd640 1 -- 172.21.15.1:0/614838690 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8448011d70 con 0x7f8458102d50 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845819fec0 con 0x7f8458102d50 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f844effd640 1 -- 172.21.15.1:0/614838690 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844800f340 con 0x7f8458102d50 2024-09-12T02:32:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.414+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84581a0350 con 0x7f8458102d50 2024-09-12T02:32:15.421 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f844effd640 1 -- 172.21.15.1:0/614838690 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8448018020 con 0x7f8458102d50 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 Processor -- start 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 -- start start 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11d2370 0x563ba11d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ba11302f0 con 0x563ba11cd2e0 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563ba10d8270 con 0x563ba11cc9a0 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.417+0000 7f8462c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563ba112c2b0 con 0x563ba11d2370 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51540/0 (socket says 172.21.15.1:51540) 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 -- 172.21.15.1:0/8876216 learned_addr learned my addr 172.21.15.1:0/8876216 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f844effd640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 0x7f84440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845e3b2640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 0x7f84440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 -- 172.21.15.1:0/8876216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11d2370 msgr2=0x563ba11d4830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11d2370 0x563ba11d4830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 -- 172.21.15.1:0/8876216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 msgr2=0x563ba11ccda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11ccda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f844effd640 1 -- 172.21.15.1:0/614838690 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f84480cec20 con 0x7f8458102d50 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 -- 172.21.15.1:0/8876216 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba10d7340 con 0x563ba11cd2e0 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845dbb1640 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8454006010 tx=0x7f8454005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cf3b8dc163acd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f845e3b2640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 0x7f84440a50f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f845000aae0 tx=0x7f8450009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.418+0000 7f8443fff640 1 -- 172.21.15.1:0/8876216 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454040020 con 0x563ba11cd2e0 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8443fff640 1 -- 172.21.15.1:0/8876216 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84540318b0 con 0x563ba11cd2e0 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8443fff640 1 -- 172.21.15.1:0/8876216 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454035040 con 0x563ba11cd2e0 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 -- 172.21.15.1:0/8876216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 msgr2=0x563ba11d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8454006010 tx=0x7f8454005e40 comp rx=0 tx=0).stop 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 -- 172.21.15.1:0/8876216 shutdown_connections 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cd2e0 0x563ba11d1da0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11d2370 0x563ba11d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 --2- 172.21.15.1:0/8876216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 -- 172.21.15.1:0/8876216 >> 172.21.15.1:0/8876216 conn(0x563ba11c8010 msgr2=0x563ba11c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 -- 172.21.15.1:0/8876216 shutdown_connections 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.419+0000 7f8462c8a740 1 -- 172.21.15.1:0/8876216 wait complete. 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 -- start start 2024-09-12T02:32:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 Processor -- start 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11d7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563ba11d52e0 con 0x563ba11d2370 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563ba10b9290 con 0x563ba11cc9a0 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563ba11d5460 con 0x563ba11cd2e0 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f8462c8a740 10 client.0 _ll_register_callbacks cb 0x563ba10ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f845e3b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f845e3b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51554/0 (socket says 172.21.15.1:51554) 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.420+0000 7f845e3b2640 1 -- 172.21.15.1:0/2780878351 learned_addr learned my addr 172.21.15.1:0/2780878351 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845d3b0640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11d7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 -- 172.21.15.1:0/2780878351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 msgr2=0x563ba11d7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11d7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 -- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 msgr2=0x563ba11d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 -- 172.21.15.1:0/2780878351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba0e43210 con 0x563ba11d2370 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f845e3b2640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f845000da60 tx=0x7f8450004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d285574216356782 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f84417fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450018d90 con 0x563ba11d2370 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84540318b0 con 0x563ba11d2370 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8450023480 con 0x563ba11d2370 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8450023680 con 0x563ba11d2370 2024-09-12T02:32:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f8462c8a740 10 client.15852 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.421+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ba0f0f620 con 0x563ba11d2370 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84540318b0 con 0x563ba11d2370 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f845002ea20 con 0x563ba11d2370 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 10 client.15852 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 20 client.15852 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba11e28e0 0x563ba11e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 4 client.15852 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ba113da20 con 0x563ba11e28e0 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.422+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba11e28e0 0x563ba11e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.423+0000 7f84417fa640 10 client.15852 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.423+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba11e28e0 0x563ba11e4d50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e73a49c7aac18d0 server_cookie=5f44ed91cf7fca86 in_seq=0 out_seq=0 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.423+0000 7f84417fa640 1 -- 172.21.15.1:0/2780878351 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ba113da20 con 0x563ba11e28e0 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.423+0000 7f84417fa640 10 client.15852 handle_command_reply: tid=0 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 client.15852 shutdown 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 msgr2=0x563ba11de140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f845000da60 tx=0x7f8450004bc0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 shutdown_connections 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11d2370 0x563ba11de140 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba11e28e0 0x563ba11e4d50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f84417fa640 0 client.15852 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11d7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2780878351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11cc9a0 0x563ba11d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 >> 172.21.15.1:0/2780878351 conn(0x563ba11c8010 msgr2=0x563ba11c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 shutdown_connections 2024-09-12T02:32:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 1 -- 172.21.15.1:0/2780878351 wait complete. 2024-09-12T02:32:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.424+0000 7f8462c8a740 20 client.15852 trim_cache size 0 max 16384 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 Processor -- start 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 -- start start 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11e9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba11e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84581a90e0 con 0x563ba11cc9a0 2024-09-12T02:32:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84581aac20 con 0x563ba11d2370 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f8462c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84581a97b0 con 0x563ba11cd2e0 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51558/0 (socket says 172.21.15.1:51558) 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 -- 172.21.15.1:0/3895692518 learned_addr learned my addr 172.21.15.1:0/3895692518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845e3b2640 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba11e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 -- 172.21.15.1:0/3895692518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 msgr2=0x563ba11e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 -- 172.21.15.1:0/3895692518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 msgr2=0x563ba11e9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba11e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.453+0000 7f845dbb1640 1 -- 172.21.15.1:0/3895692518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ba11cd7c0 con 0x563ba11cc9a0 2024-09-12T02:32:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f845dbb1640 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f84540057c0 tx=0x7f845402a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7638309bed1fa29a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f84437fe640 1 -- 172.21.15.1:0/3895692518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454040040 con 0x563ba11cc9a0 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f84437fe640 1 -- 172.21.15.1:0/3895692518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8454005450 con 0x563ba11cc9a0 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f84437fe640 1 -- 172.21.15.1:0/3895692518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454035040 con 0x563ba11cc9a0 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f8462c8a740 1 -- 172.21.15.1:0/3895692518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 msgr2=0x563ba11c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.454+0000 7f8462c8a740 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f84540057c0 tx=0x7f845402a440 comp rx=0 tx=0).stop 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- 172.21.15.1:0/3895692518 shutdown_connections 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba11e9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba11e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- 172.21.15.1:0/3895692518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba11c70b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- 172.21.15.1:0/3895692518 >> 172.21.15.1:0/3895692518 conn(0x563ba11c8010 msgr2=0x563ba11c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- 172.21.15.1:0/3895692518 shutdown_connections 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- 172.21.15.1:0/3895692518 wait complete. 2024-09-12T02:32:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- start start 2024-09-12T02:32:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 Processor -- start 2024-09-12T02:32:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba12499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba1250a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84581aa550 con 0x563ba11cc9a0 2024-09-12T02:32:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f84581a9e80 con 0x563ba11d2370 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84581a70c0 con 0x563ba11cd2e0 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.455+0000 7f8462c8a740 10 client.0 _ll_register_callbacks cb 0x7f845000cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51566/0 (socket says 172.21.15.1:51566) 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 -- 172.21.15.1:0/2033523188 learned_addr learned my addr 172.21.15.1:0/2033523188 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845d3b0640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba12499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 -- 172.21.15.1:0/2033523188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 msgr2=0x563ba12499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba12499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 -- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 msgr2=0x563ba1250a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba1250a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 -- 172.21.15.1:0/2033523188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ba1251020 con 0x563ba11cc9a0 2024-09-12T02:32:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f845dbb1640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84540314e0 tx=0x7f8454009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e69425107819aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f84417fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454035040 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8454045830 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8454005450 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8454040040 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f8462c8a740 10 client.15858 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.456+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ba1252330 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8454005450 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8454061ca0 con 0x563ba11cc9a0 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 20 client.15858 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba1252890 0x563ba1254c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:15.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 4 client.15858 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:32:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ba1137d70 con 0x563ba1252890 2024-09-12T02:32:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.457+0000 7f845d3b0640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba1252890 0x563ba1254c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.458+0000 7f845d3b0640 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba1252890 0x563ba1254c80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e0ad7cdfb918e7c server_cookie=22eb1056614f61f9 in_seq=0 out_seq=0 2024-09-12T02:32:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.458+0000 7f84417fa640 10 client.15858 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f84417fa640 1 -- 172.21.15.1:0/2033523188 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ba1137d70 con 0x563ba1252890 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f84417fa640 10 client.15858 handle_command_reply: tid=0 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 client.15858 shutdown 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 msgr2=0x563ba1249490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84540314e0 tx=0x7f8454009680 comp rx=0 tx=0).stop 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 shutdown_connections 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563ba1252890 0x563ba1254c80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ba11d2370 0x563ba1250a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f84417fa640 0 client.15858 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563ba11cd2e0 0x563ba12499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 --2- 172.21.15.1:0/2033523188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563ba11cc9a0 0x563ba1249490 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 >> 172.21.15.1:0/2033523188 conn(0x563ba11c8010 msgr2=0x563ba11c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 shutdown_connections 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 1 -- 172.21.15.1:0/2033523188 wait complete. 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.461+0000 7f8462c8a740 20 client.15858 trim_cache size 0 max 16384 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:32:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:32:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 msgr2=0x7f84440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 0x7f84440a50f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f845000aae0 tx=0x7f8450009230 comp rx=0 tx=0).stop 2024-09-12T02:32:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 msgr2=0x7f84581984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:15.467 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f844800b450 tx=0x7f844800b910 comp rx=0 tx=0).stop 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 shutdown_connections 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f84440a2c30 0x7f84440a50f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8458102d50 0x7f84581984f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8458103710 0x7f845819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 --2- 172.21.15.1:0/614838690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8458101b60 0x7f8458197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 >> 172.21.15.1:0/614838690 conn(0x7f84580fd2e0 msgr2=0x7f8458106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 shutdown_connections 2024-09-12T02:32:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:15.462+0000 7f845fe15640 1 -- 172.21.15.1:0/614838690 wait complete. 2024-09-12T02:32:15.472 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:32:15.474 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:32:15.474 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:32:15.513 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:32:15.517 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:32:15.517 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:32:15.574 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-12T02:32:15.575 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-12T02:32:15.575 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T02:32:15.636 INFO:tasks.workunit.client.0.smithi001.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-12T02:32:15.660 INFO:tasks.workunit.client.0.smithi001.stderr:--2024-09-12 02:32:15-- http://download.ceph.com/qa/fsync-tester.c 2024-09-12T02:32:15.661 INFO:tasks.workunit.client.0.smithi001.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T02:32:15.682 INFO:tasks.workunit.client.0.smithi001.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T02:32:15.703 INFO:tasks.workunit.client.0.smithi001.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T02:32:15.703 INFO:tasks.workunit.client.0.smithi001.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-12T02:32:15.704 INFO:tasks.workunit.client.0.smithi001.stderr:Saving to: ‘fsync-tester.c’ 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr: 0K .. 100% 564M=0s 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr:2024-09-12 02:32:15 (564 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-12T02:32:15.707 INFO:tasks.workunit.client.0.smithi001.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-12T02:32:15.800 INFO:tasks.workunit.client.0.smithi001.stderr:+ ./fsync-tester 2024-09-12T02:32:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:15 smithi001 ceph-mon[31252]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:16.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:15 smithi134 ceph-mon[35091]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:16.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:15 smithi173 ceph-mon[35036]: pgmap v382: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T02:32:18.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:17 smithi001 ceph-mon[31252]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T02:32:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:17 smithi134 ceph-mon[35091]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T02:32:18.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:17 smithi173 ceph-mon[35036]: pgmap v383: 97 pgs: 97 active+clean; 668 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T02:32:20.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:19 smithi001 ceph-mon[31252]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-09-12T02:32:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:19 smithi134 ceph-mon[35091]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-09-12T02:32:20.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:19 smithi173 ceph-mon[35036]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-09-12T02:32:22.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:21 smithi001 ceph-mon[31252]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T02:32:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:21 smithi134 ceph-mon[35091]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T02:32:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:21 smithi173 ceph-mon[35036]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 177 KiB/s wr, 13 op/s 2024-09-12T02:32:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:23 smithi001 ceph-mon[31252]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 177 KiB/s wr, 11 op/s 2024-09-12T02:32:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:23 smithi134 ceph-mon[35091]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 177 KiB/s wr, 11 op/s 2024-09-12T02:32:24.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:23 smithi173 ceph-mon[35036]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 177 KiB/s wr, 11 op/s 2024-09-12T02:32:26.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:25 smithi001 ceph-mon[31252]: pgmap v387: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 604 KiB/s wr, 12 op/s 2024-09-12T02:32:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:25 smithi134 ceph-mon[35091]: pgmap v387: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 604 KiB/s wr, 12 op/s 2024-09-12T02:32:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:25 smithi173 ceph-mon[35036]: pgmap v387: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 604 KiB/s wr, 12 op/s 2024-09-12T02:32:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:27 smithi001 ceph-mon[31252]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-12T02:32:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:27 smithi134 ceph-mon[35091]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-12T02:32:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:27 smithi173 ceph-mon[35036]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 606 KiB/s wr, 14 op/s 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 -- 172.21.15.1:0/302311529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 msgr2=0x7f1158100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 --2- 172.21.15.1:0/302311529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f1158100e50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1148009900 tx=0x7f114802a410 comp rx=0 tx=0).stop 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 -- 172.21.15.1:0/302311529 shutdown_connections 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 --2- 172.21.15.1:0/302311529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158102600 0x7f1158108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 --2- 172.21.15.1:0/302311529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158101c40 0x7f11581020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 --2- 172.21.15.1:0/302311529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f1158100e50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 -- 172.21.15.1:0/302311529 >> 172.21.15.1:0/302311529 conn(0x7f11580fc1b0 msgr2=0x7f11580fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 -- 172.21.15.1:0/302311529 shutdown_connections 2024-09-12T02:32:28.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.557+0000 7f115d28d640 1 -- 172.21.15.1:0/302311529 wait complete. 2024-09-12T02:32:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 Processor -- start 2024-09-12T02:32:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 -- start start 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158101c40 0x7f115819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 0x7f115819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f115810c720 con 0x7f1158100a50 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f115810c5a0 con 0x7f1158101c40 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f115d28d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f115810c8a0 con 0x7f1158102600 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36540/0 (socket says 172.21.15.1:36540) 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.558+0000 7f1156ffd640 1 -- 172.21.15.1:0/3176864250 learned_addr learned my addr 172.21.15.1:0/3176864250 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f11577fe640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 0x7f115819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f114ffff640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158101c40 0x7f115819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 -- 172.21.15.1:0/3176864250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 msgr2=0x7f115819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 0x7f115819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 -- 172.21.15.1:0/3176864250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158101c40 msgr2=0x7f115819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158101c40 0x7f115819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 -- 172.21.15.1:0/3176864250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115819fa60 con 0x7f1158100a50 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f11577fe640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 0x7f115819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1156ffd640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1148031440 tx=0x7f1148032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1154ff9640 1 -- 172.21.15.1:0/3176864250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114803f030 con 0x7f1158100a50 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1154ff9640 1 -- 172.21.15.1:0/3176864250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1148003ce0 con 0x7f1158100a50 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115819fcf0 con 0x7f1158100a50 2024-09-12T02:32:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f1154ff9640 1 -- 172.21.15.1:0/3176864250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148035070 con 0x7f1158100a50 2024-09-12T02:32:28.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.559+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11581a0190 con 0x7f1158100a50 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.562+0000 7f1154ff9640 1 -- 172.21.15.1:0/3176864250 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1148042030 con 0x7f1158100a50 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.562+0000 7f116002d740 1 Processor -- start 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.562+0000 7f116002d740 1 -- start start 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b632da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b635830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56140b5912f0 con 0x56140b62d9a0 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56140b539270 con 0x56140b633370 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f116002d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56140b58d2b0 con 0x56140b62e2e0 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36552/0 (socket says 172.21.15.1:36552) 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 -- 172.21.15.1:0/1500356133 learned_addr learned my addr 172.21.15.1:0/1500356133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f1154ff9640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 0x7f11440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f114ffff640 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b635830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f1156ffd640 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b632da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 -- 172.21.15.1:0/1500356133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 msgr2=0x56140b632da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b632da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 -- 172.21.15.1:0/1500356133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 msgr2=0x56140b635830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b635830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.563+0000 7f11577fe640 1 -- 172.21.15.1:0/1500356133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140b538340 con 0x56140b62d9a0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f11577fe640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 0x7f11440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f1154ff9640 1 -- 172.21.15.1:0/3176864250 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f11480ef700 con 0x7f1158100a50 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f11577fe640 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f115000f530 tx=0x7f115000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3cabbc336c92b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f114d7fa640 1 -- 172.21.15.1:0/1500356133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115001c400 con 0x56140b62d9a0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f114d7fa640 1 -- 172.21.15.1:0/1500356133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500124b0 con 0x56140b62d9a0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.564+0000 7f114d7fa640 1 -- 172.21.15.1:0/1500356133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000d7a0 con 0x56140b62d9a0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- 172.21.15.1:0/1500356133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 msgr2=0x56140b62dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f11577fe640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 0x7f11440a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1150020000 tx=0x7f115001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f115000f530 tx=0x7f115000f9f0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- 172.21.15.1:0/1500356133 shutdown_connections 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b635830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b632da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 --2- 172.21.15.1:0/1500356133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62d9a0 0x56140b62dda0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- 172.21.15.1:0/1500356133 >> 172.21.15.1:0/1500356133 conn(0x56140b629010 msgr2=0x56140b629410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- 172.21.15.1:0/1500356133 shutdown_connections 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- 172.21.15.1:0/1500356133 wait complete. 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 -- start start 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.565+0000 7f116002d740 1 Processor -- start 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b637bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b638110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56140b636340 con 0x56140b633370 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56140b51a290 con 0x56140b62d9a0 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56140b6364c0 con 0x56140b62e2e0 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f116002d740 10 client.0 _ll_register_callbacks cb 0x56140b54b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36558/0 (socket says 172.21.15.1:36558) 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 -- 172.21.15.1:0/1512439696 learned_addr learned my addr 172.21.15.1:0/1512439696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f1156ffd640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b637bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f114ffff640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b638110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 -- 172.21.15.1:0/1512439696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 msgr2=0x56140b638110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b638110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 -- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 msgr2=0x56140b637bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b637bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 -- 172.21.15.1:0/1512439696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140b2a4210 con 0x56140b633370 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f11577fe640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1150010010 tx=0x7f115000d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c28681e70f76b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.566+0000 7f113e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000dd50 con 0x56140b633370 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f11500049e0 con 0x56140b633370 2024-09-12T02:32:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11500124b0 con 0x56140b633370 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1150004c20 con 0x56140b633370 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 10 client.15870 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56140b370620 con 0x56140b633370 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500124b0 con 0x56140b633370 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f115001c680 con 0x56140b633370 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 10 client.15870 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 20 client.15870 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6436f0 0x56140b645ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 4 client.15870 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.567+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56140b59ea20 con 0x56140b6436f0 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.568+0000 7f1156ffd640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6436f0 0x56140b645ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.568+0000 7f1156ffd640 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6436f0 0x56140b645ae0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203ddb7c79328a36 server_cookie=534dede5754490e3 in_seq=0 out_seq=0 2024-09-12T02:32:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.568+0000 7f113e7fc640 10 client.15870 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f113e7fc640 1 -- 172.21.15.1:0/1512439696 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56140b59ea20 con 0x56140b6436f0 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f113e7fc640 10 client.15870 handle_command_reply: tid=0 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 client.15870 shutdown 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 msgr2=0x56140b63f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1150010010 tx=0x7f115000d790 comp rx=0 tx=0).stop 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 shutdown_connections 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b63f150 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6436f0 0x56140b645ae0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b638110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 --2- 172.21.15.1:0/1512439696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b637bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f113e7fc640 0 client.15870 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 >> 172.21.15.1:0/1512439696 conn(0x56140b629010 msgr2=0x56140b62a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 shutdown_connections 2024-09-12T02:32:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 1 -- 172.21.15.1:0/1512439696 wait complete. 2024-09-12T02:32:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.569+0000 7f116002d740 20 client.15870 trim_cache size 0 max 16384 2024-09-12T02:32:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 Processor -- start 2024-09-12T02:32:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 -- start start 2024-09-12T02:32:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b629ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b63f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11581a90c0 con 0x56140b633370 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11581aac00 con 0x56140b62d9a0 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f116002d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11581a9790 con 0x56140b62e2e0 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.584+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36562/0 (socket says 172.21.15.1:36562) 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 -- 172.21.15.1:0/39967892 learned_addr learned my addr 172.21.15.1:0/39967892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f114ffff640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b63f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f1156ffd640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b629ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 -- 172.21.15.1:0/39967892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 msgr2=0x56140b63f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b63f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 -- 172.21.15.1:0/39967892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 msgr2=0x56140b629ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b629ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 -- 172.21.15.1:0/39967892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140b645e50 con 0x56140b633370 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f1156ffd640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b629ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f11577fe640 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1150006010 tx=0x7f115000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03fe1d5a33fe2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f114cff9640 1 -- 172.21.15.1:0/39967892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115003d040 con 0x56140b633370 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f114cff9640 1 -- 172.21.15.1:0/39967892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115002a040 con 0x56140b633370 2024-09-12T02:32:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.585+0000 7f114cff9640 1 -- 172.21.15.1:0/39967892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150004a70 con 0x56140b633370 2024-09-12T02:32:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 -- 172.21.15.1:0/39967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 msgr2=0x56140b62a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1150006010 tx=0x7f115000f9f0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 -- 172.21.15.1:0/39967892 shutdown_connections 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b633370 0x56140b62a400 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62e2e0 0x56140b63f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 --2- 172.21.15.1:0/39967892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b62d9a0 0x56140b629ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 -- 172.21.15.1:0/39967892 >> 172.21.15.1:0/39967892 conn(0x56140b629010 msgr2=0x56140b637bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 -- 172.21.15.1:0/39967892 shutdown_connections 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.586+0000 7f116002d740 1 -- 172.21.15.1:0/39967892 wait complete. 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 -- start start 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 Processor -- start 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62d9a0 0x56140b63c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b63dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11581aa530 con 0x56140b62e2e0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11581a9e60 con 0x56140b633370 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11581a70a0 con 0x56140b62d9a0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f116002d740 10 client.0 _ll_register_callbacks cb 0x7f115001f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36574/0 (socket says 172.21.15.1:36574) 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 -- 172.21.15.1:0/239806057 learned_addr learned my addr 172.21.15.1:0/239806057 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f11577fe640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b63dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f1156ffd640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62d9a0 0x56140b63c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 -- 172.21.15.1:0/239806057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62d9a0 msgr2=0x56140b63c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62d9a0 0x56140b63c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 -- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 msgr2=0x56140b63dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b63dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f114ffff640 1 -- 172.21.15.1:0/239806057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140b63e340 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.587+0000 7f11577fe640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b63dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f114ffff640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f11400126d0 tx=0x7f1140012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc041703b2480f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140005220 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f11400053c0 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115002a040 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11400055c0 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 10 client.15876 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56140b6ae3e0 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115002a040 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f114001c070 con 0x56140b62e2e0 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 10 client.15876 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 20 client.15876 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6aee40 0x56140b6b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 4 client.15876 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.588+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56140b598d70 con 0x56140b6aee40 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.589+0000 7f1156ffd640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6aee40 0x56140b6b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.589+0000 7f113e7fc640 10 client.15876 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.589+0000 7f1156ffd640 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6aee40 0x56140b6b1260 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5392da824e6f1a4 server_cookie=b6548daff8f4cd17 in_seq=0 out_seq=0 2024-09-12T02:32:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.598+0000 7f113e7fc640 1 -- 172.21.15.1:0/239806057 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56140b598d70 con 0x56140b6aee40 2024-09-12T02:32:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.598+0000 7f113e7fc640 10 client.15876 handle_command_reply: tid=0 2024-09-12T02:32:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.598+0000 7f116002d740 1 client.15876 shutdown 2024-09-12T02:32:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 msgr2=0x56140b63cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f11400126d0 tx=0x7f1140012ad0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 shutdown_connections 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56140b62e2e0 0x56140b63cd20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x56140b6aee40 0x56140b6b1260 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56140b633370 0x56140b63dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f113e7fc640 0 client.15876 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 --2- 172.21.15.1:0/239806057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56140b62d9a0 0x56140b63c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 >> 172.21.15.1:0/239806057 conn(0x56140b629010 msgr2=0x56140b6279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 shutdown_connections 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 1 -- 172.21.15.1:0/239806057 wait complete. 2024-09-12T02:32:28.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f116002d740 20 client.15876 trim_cache size 0 max 16384 2024-09-12T02:32:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:32:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:32:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:32:28.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 msgr2=0x7f11440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 0x7f11440a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1150020000 tx=0x7f115001d000 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 msgr2=0x7f115806ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.599+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1148031440 tx=0x7f1148032ce0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 shutdown_connections 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11440a2c30 0x7f11440a50f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1158102600 0x7f115819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1158101c40 0x7f115819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 --2- 172.21.15.1:0/3176864250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1158100a50 0x7f115806ac70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 >> 172.21.15.1:0/3176864250 conn(0x7f11580fc1b0 msgr2=0x7f1158104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 shutdown_connections 2024-09-12T02:32:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:28.600+0000 7f115d28d640 1 -- 172.21.15.1:0/3176864250 wait complete. 2024-09-12T02:32:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:29 smithi001 ceph-mon[31252]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2024-09-12T02:32:30.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:29 smithi134 ceph-mon[35091]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2024-09-12T02:32:30.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:29 smithi173 ceph-mon[35036]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2024-09-12T02:32:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:31 smithi001 ceph-mon[31252]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 866 KiB/s wr, 17 op/s 2024-09-12T02:32:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:31 smithi134 ceph-mon[35091]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 866 KiB/s wr, 17 op/s 2024-09-12T02:32:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:31 smithi173 ceph-mon[35036]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 866 KiB/s wr, 17 op/s 2024-09-12T02:32:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:33 smithi001 ceph-mon[31252]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:33 smithi134 ceph-mon[35091]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:33 smithi173 ceph-mon[35036]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:36.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:35 smithi001 ceph-mon[31252]: pgmap v392: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:36.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:35 smithi134 ceph-mon[35091]: pgmap v392: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:35 smithi173 ceph-mon[35036]: pgmap v392: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:38.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:37 smithi001 ceph-mon[31252]: pgmap v393: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 863 KiB/s wr, 17 op/s 2024-09-12T02:32:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:37 smithi134 ceph-mon[35091]: pgmap v393: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 863 KiB/s wr, 17 op/s 2024-09-12T02:32:38.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:37 smithi173 ceph-mon[35036]: pgmap v393: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 863 KiB/s wr, 17 op/s 2024-09-12T02:32:39.999 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:39 smithi173 ceph-mon[35036]: pgmap v394: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:39 smithi001 ceph-mon[31252]: pgmap v394: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:39 smithi134 ceph-mon[35091]: pgmap v394: 97 pgs: 97 active+clean; 1.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:32:41.290 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:32:41.570 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 -- 172.21.15.1:0/1283885503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358100a50 msgr2=0x7f1358100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 --2- 172.21.15.1:0/1283885503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358100a50 0x7f1358100e50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1354009900 tx=0x7f135402a410 comp rx=0 tx=0).stop 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 -- 172.21.15.1:0/1283885503 shutdown_connections 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 --2- 172.21.15.1:0/1283885503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358102600 0x7f1358108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 --2- 172.21.15.1:0/1283885503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358101c40 0x7f13581020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 --2- 172.21.15.1:0/1283885503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358100a50 0x7f1358100e50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 -- 172.21.15.1:0/1283885503 >> 172.21.15.1:0/1283885503 conn(0x7f13580fc1b0 msgr2=0x7f13580fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 -- 172.21.15.1:0/1283885503 shutdown_connections 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.693+0000 7f135fae6640 1 -- 172.21.15.1:0/1283885503 wait complete. 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 Processor -- start 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 -- start start 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 0x7f13581049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358101c40 0x7f1358103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f135810c6b0 con 0x7f1358102600 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f135810c530 con 0x7f1358100a50 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135fae6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f135810c830 con 0x7f1358101c40 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135e083640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135e083640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35668/0 (socket says 172.21.15.1:35668) 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135e083640 1 -- 172.21.15.1:0/1861030912 learned_addr learned my addr 172.21.15.1:0/1861030912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135d081640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358101c40 0x7f1358103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.694+0000 7f135d882640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 0x7f13581049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 -- 172.21.15.1:0/1861030912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358101c40 msgr2=0x7f1358103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358101c40 0x7f1358103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 -- 172.21.15.1:0/1861030912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 msgr2=0x7f13581049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 0x7f13581049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 -- 172.21.15.1:0/1861030912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1358103df0 con 0x7f1358102600 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135d882640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 0x7f13581049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135e083640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f135000cce0 tx=0x7f135000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f134affd640 1 -- 172.21.15.1:0/1861030912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135000f450 con 0x7f1358102600 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13581a1e20 con 0x7f1358102600 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f134affd640 1 -- 172.21.15.1:0/1861030912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f135000fad0 con 0x7f1358102600 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f134affd640 1 -- 172.21.15.1:0/1861030912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350018b60 con 0x7f1358102600 2024-09-12T02:32:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.695+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13581a2230 con 0x7f1358102600 2024-09-12T02:32:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.698+0000 7f136287d740 1 Processor -- start 2024-09-12T02:32:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.698+0000 7f134affd640 1 -- 172.21.15.1:0/1861030912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f135000fc80 con 0x7f1358102600 2024-09-12T02:32:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.698+0000 7f136287d740 1 -- start start 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a67a9a0 0x55da5a67ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a67fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da5a5de2f0 con 0x55da5a680370 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da5a586270 con 0x55da5a67b2e0 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f136287d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da5a5da2b0 con 0x55da5a67a9a0 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35684/0 (socket says 172.21.15.1:35684) 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 -- 172.21.15.1:0/4011703546 learned_addr learned my addr 172.21.15.1:0/4011703546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d882640 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a67fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f134affd640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 0x7f13440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a67a9a0 0x55da5a67ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135e083640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 0x7f13440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 -- 172.21.15.1:0/4011703546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a67a9a0 msgr2=0x55da5a67ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a67a9a0 0x55da5a67ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 -- 172.21.15.1:0/4011703546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 msgr2=0x55da5a67fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f134affd640 1 -- 172.21.15.1:0/1861030912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f13500cf570 con 0x7f1358102600 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a67fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.699+0000 7f135d081640 1 -- 172.21.15.1:0/4011703546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5a585340 con 0x55da5a680370 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.700+0000 7f135d081640 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f134c011770 tx=0x7f134c00a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa725df9eb29eb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.700+0000 7f135e083640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 0x7f13440a50f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f135009bd40 tx=0x7f1350091290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.700+0000 7f1343fff640 1 -- 172.21.15.1:0/4011703546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c00fa50 con 0x55da5a680370 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.700+0000 7f1343fff640 1 -- 172.21.15.1:0/4011703546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c005500 con 0x55da5a680370 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.700+0000 7f1343fff640 1 -- 172.21.15.1:0/4011703546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c004b80 con 0x55da5a680370 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- 172.21.15.1:0/4011703546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 msgr2=0x55da5a682830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f134c011770 tx=0x7f134c00a810 comp rx=0 tx=0).stop 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- 172.21.15.1:0/4011703546 shutdown_connections 2024-09-12T02:32:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a680370 0x55da5a682830 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a67fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 --2- 172.21.15.1:0/4011703546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a67a9a0 0x55da5a67ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- 172.21.15.1:0/4011703546 >> 172.21.15.1:0/4011703546 conn(0x55da5a676010 msgr2=0x55da5a676410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- 172.21.15.1:0/4011703546 shutdown_connections 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- 172.21.15.1:0/4011703546 wait complete. 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 -- start start 2024-09-12T02:32:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.701+0000 7f136287d740 1 Processor -- start 2024-09-12T02:32:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a685130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a680370 0x55da5a68c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55da5a683340 con 0x55da5a67a9a0 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da5a567290 con 0x55da5a67b2e0 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da5a6834c0 con 0x55da5a680370 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f136287d740 10 client.0 _ll_register_callbacks cb 0x55da5a598140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35694/0 (socket says 172.21.15.1:35694) 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 -- 172.21.15.1:0/867295672 learned_addr learned my addr 172.21.15.1:0/867295672 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d882640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a685130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 -- 172.21.15.1:0/867295672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a680370 msgr2=0x55da5a68c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a680370 0x55da5a68c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 -- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 msgr2=0x55da5a685130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a685130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 -- 172.21.15.1:0/867295672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da5a2f1210 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d882640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a685130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f135d081640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f134c00fc80 tx=0x7f134c005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a38709795efc77e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.702+0000 7f13417fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c004d30 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f134c029420 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f134c005500 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f134c011020 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da5a3bd620 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c005500 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f134c010ad0 con 0x55da5a67a9a0 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 20 client.15888 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a6905b0 0x55da5a6929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 4 client.15888 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.703+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da5a5eba20 con 0x55da5a6905b0 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.704+0000 7f135d882640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a6905b0 0x55da5a6929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.704+0000 7f135d882640 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a6905b0 0x55da5a6929a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb92beee504bd6c server_cookie=b2521af00f875d7a in_seq=0 out_seq=0 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.704+0000 7f13417fa640 10 client.15888 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f13417fa640 1 -- 172.21.15.1:0/867295672 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da5a5eba20 con 0x55da5a6905b0 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f13417fa640 10 client.15888 handle_command_reply: tid=0 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 client.15888 shutdown 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 msgr2=0x55da5a684bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f134c00fc80 tx=0x7f134c005450 comp rx=0 tx=0).stop 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 shutdown_connections 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a6905b0 0x55da5a6929a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a680370 0x55da5a68c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67b2e0 0x55da5a685130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 --2- 172.21.15.1:0/867295672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67a9a0 0x55da5a684bf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f13417fa640 0 client.15888 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 >> 172.21.15.1:0/867295672 conn(0x55da5a676010 msgr2=0x55da5a677820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 shutdown_connections 2024-09-12T02:32:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 1 -- 172.21.15.1:0/867295672 wait complete. 2024-09-12T02:32:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.705+0000 7f136287d740 20 client.15888 trim_cache size 0 max 16384 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.720+0000 7f136287d740 1 Processor -- start 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.720+0000 7f136287d740 1 -- start start 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.720+0000 7f136287d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a6850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.720+0000 7f136287d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a68c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.720+0000 7f136287d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f136287d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13581ab1c0 con 0x55da5a67b2e0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f136287d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13581acd00 con 0x55da5a67a9a0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f136287d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13581ab890 con 0x55da5a676010 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35710/0 (socket says 172.21.15.1:35710) 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 -- 172.21.15.1:0/2890165153 learned_addr learned my addr 172.21.15.1:0/2890165153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d882640 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a68c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a6850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 -- 172.21.15.1:0/2890165153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 msgr2=0x55da5a6850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a6850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 -- 172.21.15.1:0/2890165153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 msgr2=0x55da5a68c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a68c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 -- 172.21.15.1:0/2890165153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5a692d10 con 0x55da5a67b2e0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f135d081640 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f134c010ef0 tx=0x7f134c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e456a6d8d870c06f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.721+0000 7f13437fe640 1 -- 172.21.15.1:0/2890165153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c005500 con 0x55da5a67b2e0 2024-09-12T02:32:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f13437fe640 1 -- 172.21.15.1:0/2890165153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c024030 con 0x55da5a67b2e0 2024-09-12T02:32:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f13437fe640 1 -- 172.21.15.1:0/2890165153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c02bdc0 con 0x55da5a67b2e0 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 -- 172.21.15.1:0/2890165153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 msgr2=0x55da5a6749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f134c010ef0 tx=0x7f134c01a040 comp rx=0 tx=0).stop 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 -- 172.21.15.1:0/2890165153 shutdown_connections 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6749a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a68c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 --2- 172.21.15.1:0/2890165153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a6850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 -- 172.21.15.1:0/2890165153 >> 172.21.15.1:0/2890165153 conn(0x55da5a67fec0 msgr2=0x55da5a6849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 -- 172.21.15.1:0/2890165153 shutdown_connections 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.722+0000 7f136287d740 1 -- 172.21.15.1:0/2890165153 wait complete. 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 -- start start 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 Processor -- start 2024-09-12T02:32:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a689030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a689570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13581ac630 con 0x55da5a67b2e0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13581abf60 con 0x55da5a67a9a0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13581a91a0 con 0x55da5a676010 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.723+0000 7f136287d740 10 client.0 _ll_register_callbacks cb 0x7f1354009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35714/0 (socket says 172.21.15.1:35714) 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 -- 172.21.15.1:0/2926175261 learned_addr learned my addr 172.21.15.1:0/2926175261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a689030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d882640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a689570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 -- 172.21.15.1:0/2926175261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 msgr2=0x55da5a689030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a689030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 -- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 msgr2=0x55da5a689570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a689570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 -- 172.21.15.1:0/2926175261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da5a6f97c0 con 0x55da5a67b2e0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d882640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a689570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f135d081640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f134c011770 tx=0x7f134c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f267704f007c11d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f13417fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c02bd30 con 0x55da5a67b2e0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f134c004b30 con 0x55da5a67b2e0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f134c024030 con 0x55da5a67b2e0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f134c005710 con 0x55da5a67b2e0 2024-09-12T02:32:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f136287d740 10 client.15894 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.724+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da5a6faab0 con 0x55da5a67b2e0 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c024030 con 0x55da5a67b2e0 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f134c0105f0 con 0x55da5a67b2e0 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 10 client.15894 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 10 client.15894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 20 client.15894 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a680370 0x55da5a6fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 4 client.15894 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da5a5e5d70 con 0x55da5a680370 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.725+0000 7f135d882640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a680370 0x55da5a6fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.726+0000 7f13417fa640 10 client.15894 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:41.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.726+0000 7f135d882640 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a680370 0x55da5a6fd3e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9962f7a27b56255a server_cookie=5cde3f38129995b1 in_seq=0 out_seq=0 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f13417fa640 1 -- 172.21.15.1:0/2926175261 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da5a5e5d70 con 0x55da5a680370 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f13417fa640 10 client.15894 handle_command_reply: tid=0 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 client.15894 shutdown 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 msgr2=0x55da5a6f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f134c011770 tx=0x7f134c013040 comp rx=0 tx=0).stop 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 shutdown_connections 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55da5a67b2e0 0x55da5a6f9250 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55da5a680370 0x55da5a6fd3e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da5a67a9a0 0x55da5a689570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 --2- 172.21.15.1:0/2926175261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da5a676010 0x55da5a689030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f13417fa640 0 client.15894 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 >> 172.21.15.1:0/2926175261 conn(0x55da5a67fec0 msgr2=0x55da5a676f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 shutdown_connections 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 1 -- 172.21.15.1:0/2926175261 wait complete. 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.736+0000 7f136287d740 20 client.15894 trim_cache size 0 max 16384 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:32:41.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 msgr2=0x7f13440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 0x7f13440a50f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f135009bd40 tx=0x7f1350091290 comp rx=0 tx=0).stop 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 msgr2=0x7f1358103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f135000cce0 tx=0x7f135000a620 comp rx=0 tx=0).stop 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 shutdown_connections 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f13440a2c30 0x7f13440a50f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1358102600 0x7f1358103560 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1358101c40 0x7f1358103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 --2- 172.21.15.1:0/1861030912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1358100a50 0x7f13581049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 >> 172.21.15.1:0/1861030912 conn(0x7f13580fc1b0 msgr2=0x7f13580fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 shutdown_connections 2024-09-12T02:32:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:41.737+0000 7f135fae6640 1 -- 172.21.15.1:0/1861030912 wait complete. 2024-09-12T02:32:41.996 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:41 smithi001 ceph-mon[31252]: pgmap v395: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:42.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 -- 172.21.15.1:0/673052917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102ef0 msgr2=0x7faf9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 --2- 172.21.15.1:0/673052917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102ef0 0x7faf9c10da40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7faf94009ca0 tx=0x7faf9402a950 comp rx=0 tx=0).stop 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 -- 172.21.15.1:0/673052917 shutdown_connections 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 --2- 172.21.15.1:0/673052917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102ef0 0x7faf9c10da40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 --2- 172.21.15.1:0/673052917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c102570 0x7faf9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 --2- 172.21.15.1:0/673052917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c100e20 0x7faf9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 -- 172.21.15.1:0/673052917 >> 172.21.15.1:0/673052917 conn(0x7faf9c0fc7d0 msgr2=0x7faf9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 -- 172.21.15.1:0/673052917 shutdown_connections 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.090+0000 7fafa40f0640 1 -- 172.21.15.1:0/673052917 wait complete. 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 Processor -- start 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 -- start start 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c100e20 0x7faf9c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c102ef0 0x7faf9c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c110f80 con 0x7faf9c102570 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c110e00 con 0x7faf9c102ef0 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa40f0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c111100 con 0x7faf9c100e20 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35738/0 (socket says 172.21.15.1:35738) 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa168b640 1 -- 172.21.15.1:0/3587285598 learned_addr learned my addr 172.21.15.1:0/3587285598 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c100e20 0x7faf9c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.091+0000 7fafa268d640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c102ef0 0x7faf9c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 -- 172.21.15.1:0/3587285598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c100e20 msgr2=0x7faf9c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c100e20 0x7faf9c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 -- 172.21.15.1:0/3587285598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c102ef0 msgr2=0x7faf9c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c102ef0 0x7faf9c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 -- 172.21.15.1:0/3587285598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c19f690 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa168b640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e9f0 tx=0x7faf8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7faf92ffd640 1 -- 172.21.15.1:0/3587285598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00cd80 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c19f980 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7faf92ffd640 1 -- 172.21.15.1:0/3587285598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf8c005500 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7faf92ffd640 1 -- 172.21.15.1:0/3587285598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c010690 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.092+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1a7260 con 0x7faf9c102570 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 Processor -- start 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 -- start start 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 0x5576b1e48140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e48680 0x5576b1e4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5576b1da32e0 con 0x5576b1e48680 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5576b1d4ace0 con 0x5576b1e3d4a0 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa64c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5576b1d9f2a0 con 0x5576b1e3ddc0 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa268d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa268d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:40972/0 (socket says 172.21.15.1:40972) 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.095+0000 7fafa268d640 1 -- 172.21.15.1:0/444091940 learned_addr learned my addr 172.21.15.1:0/444091940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 0x5576b1e48140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 -- 172.21.15.1:0/444091940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 msgr2=0x5576b1e48140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 0x5576b1e48140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 -- 172.21.15.1:0/444091940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e48680 msgr2=0x5576b1e4aa70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e48680 0x5576b1e4aa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 -- 172.21.15.1:0/444091940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b1d2f440 con 0x5576b1e3d4a0 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 0x5576b1e48140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7fafa268d640 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf94030020 tx=0x7faf94009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e708ee705b57f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7faf92ffd640 1 -- 172.21.15.1:0/3587285598 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faf8c0046c0 con 0x7faf9c102570 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7faf87fff640 1 -- 172.21.15.1:0/444091940 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94034040 con 0x5576b1e3d4a0 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7faf87fff640 1 -- 172.21.15.1:0/444091940 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf9402fb30 con 0x5576b1e3d4a0 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.096+0000 7faf87fff640 1 -- 172.21.15.1:0/444091940 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94004400 con 0x5576b1e3d4a0 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7faf92ffd640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 0x7faf880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 -- 172.21.15.1:0/444091940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 msgr2=0x5576b1e3d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf94030020 tx=0x7faf94009360 comp rx=0 tx=0).stop 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7faf92ffd640 1 -- 172.21.15.1:0/3587285598 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faf8c0cf4f0 con 0x7faf9c102570 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 0x7faf880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 -- 172.21.15.1:0/444091940 shutdown_connections 2024-09-12T02:32:42.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e48680 0x5576b1e4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3ddc0 0x5576b1e48140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 --2- 172.21.15.1:0/444091940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e3d880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 -- 172.21.15.1:0/444091940 >> 172.21.15.1:0/444091940 conn(0x5576b1e39a30 msgr2=0x5576b1e39e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.097+0000 7fafa64c9740 1 -- 172.21.15.1:0/444091940 shutdown_connections 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.098+0000 7fafa64c9740 1 -- 172.21.15.1:0/444091940 wait complete. 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.098+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 0x7faf880a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5576b1e3a890 tx=0x7faf98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.098+0000 7fafa64c9740 1 -- start start 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.098+0000 7fafa64c9740 1 Processor -- start 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e47fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e45790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5576b1e4b250 con 0x5576b1e3ddc0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5576b1d5e050 con 0x5576b1e48680 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5576b1e4b3d0 con 0x5576b1e3d4a0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa64c9740 10 client.0 _ll_register_callbacks cb 0x5576b1d9e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35746/0 (socket says 172.21.15.1:35746) 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 -- 172.21.15.1:0/3928698627 learned_addr learned my addr 172.21.15.1:0/3928698627 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa268d640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e45790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e47fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 -- 172.21.15.1:0/3928698627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 msgr2=0x5576b1e47fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e47fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 -- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 msgr2=0x5576b1e45790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e45790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 -- 172.21.15.1:0/3928698627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b1b143c0 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7fafa168b640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c6a0 tx=0x7faf8c09b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30621f6c329a92a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.099+0000 7faf857fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0cf2e0 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faf8c0a4510 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf9402fb30 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf8c0a49a0 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 10 client.15903 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576b1e56c30 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf9402fb30 con 0x5576b1e3ddc0 2024-09-12T02:32:42.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf8c0b2030 con 0x5576b1e3ddc0 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 10 client.15903 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 20 client.15903 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1e58140 0x5576b1e5a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 4 client.15903 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.100+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576b1db0850 con 0x5576b1e58140 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.101+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1e58140 0x5576b1e5a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.101+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1e58140 0x5576b1e5a530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c308aebfd37242 server_cookie=73dc5925bf51f613 in_seq=0 out_seq=0 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.101+0000 7faf857fa640 10 client.15903 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7faf857fa640 1 -- 172.21.15.1:0/3928698627 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576b1db0850 con 0x5576b1e58140 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7faf857fa640 10 client.15903 handle_command_reply: tid=0 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 client.15903 shutdown 2024-09-12T02:32:42.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 msgr2=0x5576b1e45250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c6a0 tx=0x7faf8c09b750 comp rx=0 tx=0).stop 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 shutdown_connections 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e45250 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1e58140 0x5576b1e5a530 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e45790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 --2- 172.21.15.1:0/3928698627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e47fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7faf857fa640 0 client.15903 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 >> 172.21.15.1:0/3928698627 conn(0x5576b1e39a30 msgr2=0x5576b1e3f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 shutdown_connections 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 1 -- 172.21.15.1:0/3928698627 wait complete. 2024-09-12T02:32:42.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.102+0000 7fafa64c9740 20 client.15903 trim_cache size 0 max 16384 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 Processor -- start 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 -- start start 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e5fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1af7a0 con 0x5576b1e3ddc0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1b12e0 con 0x5576b1e48680 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa64c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1afe70 con 0x5576b1e3d4a0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35750/0 (socket says 172.21.15.1:35750) 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa168b640 1 -- 172.21.15.1:0/1304588704 learned_addr learned my addr 172.21.15.1:0/1304588704 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.120+0000 7fafa268d640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e5fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 -- 172.21.15.1:0/1304588704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 msgr2=0x5576b1e5fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e5fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 -- 172.21.15.1:0/1304588704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 msgr2=0x5576b1e43b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 -- 172.21.15.1:0/1304588704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b1e3aae0 con 0x5576b1e3d4a0 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa168b640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:42.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa268d640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:42.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e544b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5576b1e45f60 tx=0x7faf98017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9992fcba9bd32821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7faf877fe640 1 -- 172.21.15.1:0/1304588704 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98023070 con 0x5576b1e3d4a0 2024-09-12T02:32:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7faf877fe640 1 -- 172.21.15.1:0/1304588704 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf98005500 con 0x5576b1e3d4a0 2024-09-12T02:32:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.121+0000 7faf877fe640 1 -- 172.21.15.1:0/1304588704 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98004a00 con 0x5576b1e3d4a0 2024-09-12T02:32:42.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 -- 172.21.15.1:0/1304588704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 msgr2=0x5576b1e544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e544b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5576b1e45f60 tx=0x7faf98017000 comp rx=0 tx=0).stop 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 -- 172.21.15.1:0/1304588704 shutdown_connections 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e43b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e48680 0x5576b1e5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 --2- 172.21.15.1:0/1304588704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e3d4a0 0x5576b1e544b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 -- 172.21.15.1:0/1304588704 >> 172.21.15.1:0/1304588704 conn(0x5576b1e39a30 msgr2=0x5576b1e38b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 -- 172.21.15.1:0/1304588704 shutdown_connections 2024-09-12T02:32:42.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.122+0000 7fafa64c9740 1 -- 172.21.15.1:0/1304588704 wait complete. 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.123+0000 7fafa64c9740 1 -- start start 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.123+0000 7fafa64c9740 1 Processor -- start 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e4c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e48680 0x5576b1e4ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1b0c10 con 0x5576b1e3ddc0 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1b0540 con 0x5576b1e3d4a0 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1ad780 con 0x5576b1e48680 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa64c9740 10 client.0 _ll_register_callbacks cb 0x7faf8c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa168b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35764/0 (socket says 172.21.15.1:35764) 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa168b640 1 -- 172.21.15.1:0/2614503217 learned_addr learned my addr 172.21.15.1:0/2614503217 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:42.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e4c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa268d640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e48680 0x5576b1e4ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 -- 172.21.15.1:0/2614503217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e48680 msgr2=0x5576b1e4ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e48680 0x5576b1e4ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 -- 172.21.15.1:0/2614503217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 msgr2=0x5576b1e4c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa1e8c640 1 -- 172.21.15.1:0/2614503217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b1e3a6c0 con 0x5576b1e3d4a0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.124+0000 7fafa168b640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa1e8c640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e4c390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf98005b60 tx=0x7faf98012c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a270e7b6bb5bb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98038070 con 0x5576b1e3d4a0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7faf980039f0 con 0x5576b1e3d4a0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf98005500 con 0x5576b1e3d4a0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf98044050 con 0x5576b1e3d4a0 2024-09-12T02:32:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa64c9740 10 client.25403 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576b1ec2e90 con 0x5576b1e3d4a0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf98005500 con 0x5576b1e3d4a0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf98034690 con 0x5576b1e3d4a0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa64c9740 10 client.25403 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.125+0000 7fafa64c9740 10 client.25403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa64c9740 20 client.25403 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1ec34f0 0x5576b1ec58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa64c9740 4 client.25403 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576b1daad60 con 0x5576b1ec34f0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa168b640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1ec34f0 0x5576b1ec58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa168b640 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1ec34f0 0x5576b1ec58e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15d3ab3da008bb0 server_cookie=852dcdaaef7e4895 in_seq=0 out_seq=0 2024-09-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7faf857fa640 10 client.25403 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7faf857fa640 1 -- 172.21.15.1:0/2614503217 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5576b1daad60 con 0x5576b1ec34f0 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7faf857fa640 10 client.25403 handle_command_reply: tid=0 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.126+0000 7fafa64c9740 1 client.25403 shutdown 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 msgr2=0x5576b1e4c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e4c390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf98005b60 tx=0x7faf98012c70 comp rx=0 tx=0).stop 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 shutdown_connections 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576b1e3ddc0 0x5576b1e4c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5576b1ec34f0 0x5576b1ec58e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5576b1e48680 0x5576b1e4ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7faf857fa640 0 client.25403 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 --2- 172.21.15.1:0/2614503217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5576b1e3d4a0 0x5576b1e4c390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 >> 172.21.15.1:0/2614503217 conn(0x5576b1e39a30 msgr2=0x5576b1e3eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 shutdown_connections 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 1 -- 172.21.15.1:0/2614503217 wait complete. 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.127+0000 7fafa64c9740 20 client.25403 trim_cache size 0 max 16384 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 msgr2=0x7faf880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 0x7faf880a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5576b1e3a890 tx=0x7faf98005f90 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 msgr2=0x7faf9c19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e9f0 tx=0x7faf8c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 shutdown_connections 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7faf880a2b80 0x7faf880a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf9c102570 0x7faf9c19ac20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9c102ef0 0x7faf9c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 --2- 172.21.15.1:0/3587285598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9c100e20 0x7faf9c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 >> 172.21.15.1:0/3587285598 conn(0x7faf9c0fc7d0 msgr2=0x7faf9c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 shutdown_connections 2024-09-12T02:32:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:42.128+0000 7fafa40f0640 1 -- 172.21.15.1:0/3587285598 wait complete. 2024-09-12T02:32:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:41 smithi134 ceph-mon[35091]: pgmap v395: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:41 smithi173 ceph-mon[35036]: pgmap v395: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:42.846 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:32:42.846 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:32:43.129 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:43.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/1326587192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08101df0 msgr2=0x7f8d081021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/1326587192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08101df0 0x7f8d081021d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009900 tx=0x7f8cfc02a410 comp rx=0 tx=0).stop 2024-09-12T02:32:43.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/1326587192 shutdown_connections 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/1326587192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d08106f20 0x7f8d0810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/1326587192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d081027a0 0x7f8d081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/1326587192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08101df0 0x7f8d081021d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/1326587192 >> 172.21.15.1:0/1326587192 conn(0x7f8d080fd8f0 msgr2=0x7f8d080ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/1326587192 shutdown_connections 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.710+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/1326587192 wait complete. 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 Processor -- start 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 -- start start 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d08101df0 0x7f8d081983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d081027a0 0x7f8d081988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d08111f80 con 0x7f8d08106f20 2024-09-12T02:32:43.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d08111e00 con 0x7f8d08101df0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0eb5d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8d08112100 con 0x7f8d081027a0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0d0fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0d0fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35770/0 (socket says 172.21.15.1:35770) 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0d0fa640 1 -- 172.21.15.1:0/3979153618 learned_addr learned my addr 172.21.15.1:0/3979153618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d0c8f9640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d08101df0 0x7f8d081983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.711+0000 7f8d07fff640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d081027a0 0x7f8d081988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 -- 172.21.15.1:0/3979153618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d081027a0 msgr2=0x7f8d081988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d081027a0 0x7f8d081988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 -- 172.21.15.1:0/3979153618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d08101df0 msgr2=0x7f8d081983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d08101df0 0x7f8d081983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 -- 172.21.15.1:0/3979153618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0819d360 con 0x7f8d08106f20 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0d0fa640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cce0 tx=0x7f8d0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:43.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000f450 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0819d650 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d0000fad0 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00018c10 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.712+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d08074420 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.714+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d081032d0 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.714+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8d0000f5f0 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.715+0000 7f8d05ffb640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 0x7f8cf80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.715+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8d000cf690 con 0x7f8d08106f20 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.715+0000 7f8d0c8f9640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 0x7f8cf80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.716+0000 7f8d0c8f9640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 0x7f8cf80a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009230 tx=0x7f8cfc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:43.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.720+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d00014030 con 0x7f8d08106f20 2024-09-12T02:32:43.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:43 smithi001 ceph-mon[31252]: pgmap v396: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:43.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.934+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d0810a100 con 0x7f8d08106f20 2024-09-12T02:32:43.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.934+0000 7f8d05ffb640 1 -- 172.21.15.1:0/3979153618 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f8d0009c5d0 con 0x7f8d08106f20 2024-09-12T02:32:43.935 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:32:43.935 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:32:43.935 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:32:43.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 msgr2=0x7f8cf80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 0x7f8cf80a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009230 tx=0x7f8cfc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 msgr2=0x7f8d0819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cce0 tx=0x7f8d0000a620 comp rx=0 tx=0).stop 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 shutdown_connections 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f8cf80a2b80 0x7f8cf80a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d08106f20 0x7f8d0819cc80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d081027a0 0x7f8d081988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 --2- 172.21.15.1:0/3979153618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d08101df0 0x7f8d081983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 >> 172.21.15.1:0/3979153618 conn(0x7f8d080fd8f0 msgr2=0x7f8d080fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 shutdown_connections 2024-09-12T02:32:43.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:43.937+0000 7f8d0eb5d640 1 -- 172.21.15.1:0/3979153618 wait complete. 2024-09-12T02:32:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:43 smithi134 ceph-mon[35091]: pgmap v396: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:43 smithi173 ceph-mon[35036]: pgmap v396: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 860 KiB/s wr, 14 op/s 2024-09-12T02:32:44.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T02:32:44.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:44 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3979153618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:44.884 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:45.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:44 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3979153618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:45.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:44 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3979153618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 -- 172.21.15.1:0/4076380976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc10c180 msgr2=0x7f3bbc10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 --2- 172.21.15.1:0/4076380976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc10c180 0x7f3bbc10e620 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009ca0 tx=0x7f3bb402a950 comp rx=0 tx=0).stop 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 -- 172.21.15.1:0/4076380976 shutdown_connections 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 --2- 172.21.15.1:0/4076380976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc10c180 0x7f3bbc10e620 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 --2- 172.21.15.1:0/4076380976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc103670 0x7f3bbc10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 --2- 172.21.15.1:0/4076380976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.414+0000 7f3bc168c640 1 -- 172.21.15.1:0/4076380976 >> 172.21.15.1:0/4076380976 conn(0x7f3bbc0fc7d0 msgr2=0x7f3bbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.415+0000 7f3bc168c640 1 -- 172.21.15.1:0/4076380976 shutdown_connections 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.415+0000 7f3bc168c640 1 -- 172.21.15.1:0/4076380976 wait complete. 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.415+0000 7f3bc168c640 1 Processor -- start 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 -- start start 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 0x7f3bbc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc111f40 con 0x7f3bbc103670 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc111dc0 con 0x7f3bbc10c180 2024-09-12T02:32:45.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bc168c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1120c0 con 0x7f3bbc102d50 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35784/0 (socket says 172.21.15.1:35784) 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bba7fc640 1 -- 172.21.15.1:0/3206983456 learned_addr learned my addr 172.21.15.1:0/3206983456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.416+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 0x7f3bbc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 -- 172.21.15.1:0/3206983456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 msgr2=0x7f3bbc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 -- 172.21.15.1:0/3206983456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 msgr2=0x7f3bbc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 0x7f3bbc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 -- 172.21.15.1:0/3206983456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc19d3b0 con 0x7f3bbc103670 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 0x7f3bbc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000d740 tx=0x7f3bb000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3ba3fff640 1 -- 172.21.15.1:0/3206983456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0017070 con 0x7f3bbc103670 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3ba3fff640 1 -- 172.21.15.1:0/3206983456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bb000de50 con 0x7f3bbc103670 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bbc19d6a0 con 0x7f3bbc103670 2024-09-12T02:32:45.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3ba3fff640 1 -- 172.21.15.1:0/3206983456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000f620 con 0x7f3bbc103670 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.417+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bbc1a4f80 con 0x7f3bbc103670 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.419+0000 7f3ba3fff640 1 -- 172.21.15.1:0/3206983456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3bb0009c30 con 0x7f3bbc103670 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 Processor -- start 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 -- start start 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba4e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555eba4492f0 con 0x555eba4e35d0 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555eba3f0cf0 con 0x555eba4f2780 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555eba4452b0 con 0x555eba4e4b40 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35792/0 (socket says 172.21.15.1:35792) 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.420+0000 7f3bbaffd640 1 -- 172.21.15.1:0/2240227113 learned_addr learned my addr 172.21.15.1:0/2240227113 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba4e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 -- 172.21.15.1:0/2240227113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 msgr2=0x555eba4e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba4e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 -- 172.21.15.1:0/2240227113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 msgr2=0x555eba4f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 -- 172.21.15.1:0/2240227113 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eba3d53a0 con 0x555eba4e35d0 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3ba3fff640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 0x7f3ba40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 0x7f3ba40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3bac008c60 tx=0x7f3bac00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dd99c8edc3b9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3ba3fff640 1 -- 172.21.15.1:0/3206983456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3bb00cec80 con 0x7f3bbc103670 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3ba17fa640 1 -- 172.21.15.1:0/2240227113 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac014070 con 0x555eba4e35d0 2024-09-12T02:32:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3ba17fa640 1 -- 172.21.15.1:0/2240227113 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bac0047a0 con 0x555eba4e35d0 2024-09-12T02:32:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.421+0000 7f3ba17fa640 1 -- 172.21.15.1:0/2240227113 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac010740 con 0x555eba4e35d0 2024-09-12T02:32:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2240227113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 msgr2=0x555eba4e3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 0x7f3ba40a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4030040 tx=0x7f3bb4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3bac008c60 tx=0x7f3bac00e720 comp rx=0 tx=0).stop 2024-09-12T02:32:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2240227113 shutdown_connections 2024-09-12T02:32:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4e3a10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2240227113 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba4e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2240227113 >> 172.21.15.1:0/2240227113 conn(0x555eba4ac310 msgr2=0x555eba4dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2240227113 shutdown_connections 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.422+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2240227113 wait complete. 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 -- start start 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 Processor -- start 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e35d0 0x555eba4f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4efc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555eba4f5480 con 0x555eba4e4b40 2024-09-12T02:32:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555eba404060 con 0x555eba4f2780 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555eba4f5600 con 0x555eba4e35d0 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bc3a65740 10 client.0 _ll_register_callbacks cb 0x555eba1578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35800/0 (socket says 172.21.15.1:35800) 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bba7fc640 1 -- 172.21.15.1:0/470678719 learned_addr learned my addr 172.21.15.1:0/470678719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e35d0 0x555eba4f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.423+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 -- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e35d0 msgr2=0x555eba4f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e35d0 0x555eba4f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 -- 172.21.15.1:0/470678719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 msgr2=0x555eba4efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 -- 172.21.15.1:0/470678719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eba1ba3c0 con 0x555eba4e4b40 2024-09-12T02:32:45.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009610 tx=0x7f3bb009b350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b083bb5a6f6bef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3b9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0020050 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3bb009a910 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bac0047a0 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3bb00b4050 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bc3a65740 10 client.15927 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555eba500fc0 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.424+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bac0047a0 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3bb00b41f0 con 0x555eba4e4b40 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 10 client.15927 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:32:45.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 20 client.15927 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba502480 0x555eba504870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 4 client.15927 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eba456860 con 0x555eba502480 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.425+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba502480 0x555eba504870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.426+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba502480 0x555eba504870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=938974c9fc818345 server_cookie=7b7ccbea0e6d768d in_seq=0 out_seq=0 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.426+0000 7f3b9eff5640 10 client.15927 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3b9eff5640 1 -- 172.21.15.1:0/470678719 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555eba456860 con 0x555eba502480 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3b9eff5640 10 client.15927 handle_command_reply: tid=0 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 client.15927 shutdown 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 msgr2=0x555eba4ef470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009610 tx=0x7f3bb009b350 comp rx=0 tx=0).stop 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 shutdown_connections 2024-09-12T02:32:45.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba502480 0x555eba504870 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e4b40 0x555eba4ef470 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba4efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3b9eff5640 0 client.15927 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/470678719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e35d0 0x555eba4f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 >> 172.21.15.1:0/470678719 conn(0x555eba4ac310 msgr2=0x555eba4e5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 shutdown_connections 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 1 -- 172.21.15.1:0/470678719 wait complete. 2024-09-12T02:32:45.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.427+0000 7f3bc3a65740 20 client.15927 trim_cache size 0 max 16384 2024-09-12T02:32:45.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.440+0000 7f3bc3a65740 1 Processor -- start 2024-09-12T02:32:45.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.440+0000 7f3bc3a65740 1 -- start start 2024-09-12T02:32:45.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba50a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba50a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1ab3f0 con 0x555eba4e35d0 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1acf30 con 0x555eba4f2780 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1abac0 con 0x555eba4e4b40 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba50a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35812/0 (socket says 172.21.15.1:35812) 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 -- 172.21.15.1:0/686964153 learned_addr learned my addr 172.21.15.1:0/686964153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba50a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 -- 172.21.15.1:0/686964153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 msgr2=0x555eba50a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba50a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 -- 172.21.15.1:0/686964153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 msgr2=0x555eba50a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba50a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbaffd640 1 -- 172.21.15.1:0/686964153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eba4ed9e0 con 0x555eba4e35d0 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.441+0000 7f3bbb7fe640 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba50a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.442+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3bac008c60 tx=0x7f3bac008550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f937b0158ce8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.442+0000 7f3ba0ff9640 1 -- 172.21.15.1:0/686964153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac014040 con 0x555eba4e35d0 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.442+0000 7f3ba0ff9640 1 -- 172.21.15.1:0/686964153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bac005590 con 0x555eba4e35d0 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.442+0000 7f3ba0ff9640 1 -- 172.21.15.1:0/686964153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac010690 con 0x555eba4e35d0 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- 172.21.15.1:0/686964153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 msgr2=0x555eba4dfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3bac008c60 tx=0x7f3bac008550 comp rx=0 tx=0).stop 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- 172.21.15.1:0/686964153 shutdown_connections 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4f2780 0x555eba50a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4e4b40 0x555eba50a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/686964153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4e35d0 0x555eba4dfe10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- 172.21.15.1:0/686964153 >> 172.21.15.1:0/686964153 conn(0x555eba4ac310 msgr2=0x555eba4df700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- 172.21.15.1:0/686964153 shutdown_connections 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- 172.21.15.1:0/686964153 wait complete. 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 -- start start 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 Processor -- start 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4e4b40 0x555eba4fa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.443+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bc3a65740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4f7860 0x555eba4f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1ac860 con 0x555eba4f2780 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1ac190 con 0x555eba4e4b40 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bc3a65740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc1a93d0 con 0x555eba4f7860 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bc3a65740 10 client.0 _ll_register_callbacks cb 0x7f3bb0010c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35818/0 (socket says 172.21.15.1:35818) 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 -- 172.21.15.1:0/2928212500 learned_addr learned my addr 172.21.15.1:0/2928212500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:45.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4e4b40 0x555eba4fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 -- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4f7860 msgr2=0x555eba4f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4f7860 0x555eba4f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 -- 172.21.15.1:0/2928212500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4e4b40 msgr2=0x555eba4fa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4e4b40 0x555eba4fa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.444+0000 7f3bba7fc640 1 -- 172.21.15.1:0/2928212500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eba4f8220 con 0x555eba4f2780 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bba7fc640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b45e0 tx=0x7f3bb009b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827b89bb6f32d270 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00b8020 con 0x555eba4f2780 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3bb009a570 con 0x555eba4f2780 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bac005590 con 0x555eba4f2780 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3bb0020040 con 0x555eba4f2780 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:45.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555eba56dd80 con 0x555eba4f2780 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bac005590 con 0x555eba4f2780 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3bb009a910 con 0x555eba4f2780 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 10 client.15933 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.445+0000 7f3bc3a65740 20 client.15933 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.446+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba56e500 0x555eba570920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.446+0000 7f3bc3a65740 4 client.15933 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.446+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eba450d70 con 0x555eba56e500 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.446+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba56e500 0x555eba570920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.446+0000 7f3b9eff5640 10 client.15933 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bbaffd640 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba56e500 0x555eba570920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a5b4742bbd9e8e3c server_cookie=592a0d944b1c4c7c in_seq=0 out_seq=0 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3b9eff5640 1 -- 172.21.15.1:0/2928212500 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eba450d70 con 0x555eba56e500 2024-09-12T02:32:45.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3b9eff5640 10 client.15933 handle_command_reply: tid=0 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 client.15933 shutdown 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 msgr2=0x555eba4fadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b45e0 tx=0x7f3bb009b3c0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 shutdown_connections 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x555eba56e500 0x555eba570920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555eba4f2780 0x555eba4fadd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555eba4f7860 0x555eba4f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 --2- 172.21.15.1:0/2928212500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eba4e4b40 0x555eba4fa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 >> 172.21.15.1:0/2928212500 conn(0x555eba4ac310 msgr2=0x555eba4f0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3b9eff5640 0 client.15933 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 shutdown_connections 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 1 -- 172.21.15.1:0/2928212500 wait complete. 2024-09-12T02:32:45.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.447+0000 7f3bc3a65740 20 client.15933 trim_cache size 0 max 16384 2024-09-12T02:32:45.459 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 msgr2=0x7f3ba40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 0x7f3ba40a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4030040 tx=0x7f3bb4005c50 comp rx=0 tx=0).stop 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 msgr2=0x7f3bbc198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000d740 tx=0x7f3bb000dc00 comp rx=0 tx=0).stop 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 shutdown_connections 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f3ba40a2b80 0x7f3ba40a5040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bbc103670 0x7f3bbc198940 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc10c180 0x7f3bbc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 --2- 172.21.15.1:0/3206983456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bbc102d50 0x7f3bbc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 >> 172.21.15.1:0/3206983456 conn(0x7f3bbc0fc7d0 msgr2=0x7f3bbc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 shutdown_connections 2024-09-12T02:32:45.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:45.448+0000 7f3bc168c640 1 -- 172.21.15.1:0/3206983456 wait complete. 2024-09-12T02:32:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:45 smithi001 ceph-mon[31252]: pgmap v397: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-12T02:32:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:45 smithi134 ceph-mon[35091]: pgmap v397: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-12T02:32:46.178 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T02:32:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:45 smithi173 ceph-mon[35036]: pgmap v397: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2024-09-12T02:32:46.453 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:48.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:47 smithi001 ceph-mon[31252]: pgmap v398: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:47 smithi134 ceph-mon[35091]: pgmap v398: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:47 smithi173 ceph-mon[35036]: pgmap v398: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 864 KiB/s wr, 17 op/s 2024-09-12T02:32:48.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.535+0000 7f86aa35a640 1 -- 172.21.15.1:0/199105120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4102570 msgr2=0x7f86a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.535+0000 7f86aa35a640 1 --2- 172.21.15.1:0/199105120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4102570 0x7f86a41029b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8698009900 tx=0x7f869802a480 comp rx=0 tx=0).stop 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.535+0000 7f86aa35a640 1 -- 172.21.15.1:0/199105120 shutdown_connections 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 --2- 172.21.15.1:0/199105120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4102570 0x7f86a41029b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 --2- 172.21.15.1:0/199105120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102ef0 0x7f86a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 --2- 172.21.15.1:0/199105120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4100e20 0x7f86a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 -- 172.21.15.1:0/199105120 >> 172.21.15.1:0/199105120 conn(0x7f86a40fc7d0 msgr2=0x7f86a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 -- 172.21.15.1:0/199105120 shutdown_connections 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 -- 172.21.15.1:0/199105120 wait complete. 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 Processor -- start 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.536+0000 7f86aa35a640 1 -- start start 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102570 0x7f86a4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4102ef0 0x7f86a419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4110f80 con 0x7f86a4100e20 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4110e00 con 0x7f86a4102ef0 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86aa35a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4111100 con 0x7f86a4102570 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35838/0 (socket says 172.21.15.1:35838) 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a3fff640 1 -- 172.21.15.1:0/3896928672 learned_addr learned my addr 172.21.15.1:0/3896928672 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a88f7640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4102ef0 0x7f86a419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a37fe640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102570 0x7f86a4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a3fff640 1 -- 172.21.15.1:0/3896928672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102570 msgr2=0x7f86a4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.537+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102570 0x7f86a4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a3fff640 1 -- 172.21.15.1:0/3896928672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4102ef0 msgr2=0x7f86a419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4102ef0 0x7f86a419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a3fff640 1 -- 172.21.15.1:0/3896928672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a419d400 con 0x7f86a4100e20 2024-09-12T02:32:48.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f869400c920 tx=0x7f869400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a17fa640 1 -- 172.21.15.1:0/3896928672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694007c70 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a419d6f0 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a17fa640 1 -- 172.21.15.1:0/3896928672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8694007e10 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86a17fa640 1 -- 172.21.15.1:0/3896928672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694018890 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.538+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a41a4fd0 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.541+0000 7f86a17fa640 1 -- 172.21.15.1:0/3896928672 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8694018a70 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.541+0000 7f86ac733740 1 Processor -- start 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.541+0000 7f86ac733740 1 -- start start 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.541+0000 7f86a17fa640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 0x7f868c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a17fa640 1 -- 172.21.15.1:0/3896928672 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f86940cf1b0 con 0x7f86a4100e20 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042fb40 0x55605042e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x55605042ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5560503942f0 con 0x556050439370 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55605033bcf0 con 0x55605042e5d0 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86ac733740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5560503902b0 con 0x55605042fb40 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 0x7f868c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35846/0 (socket says 172.21.15.1:35846) 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 -- 172.21.15.1:0/1948620971 learned_addr learned my addr 172.21.15.1:0/1948620971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a3fff640 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042fb40 0x55605042e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a37fe640 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x55605042ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 -- 172.21.15.1:0/1948620971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042fb40 msgr2=0x55605042e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042fb40 0x55605042e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 -- 172.21.15.1:0/1948620971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 msgr2=0x55605042ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x55605042ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.542+0000 7f86a88f7640 1 -- 172.21.15.1:0/1948620971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560503203a0 con 0x556050439370 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.543+0000 7f86a88f7640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 0x7f868c0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f869c012c80 tx=0x7f869c009e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.543+0000 7f86a88f7640 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f869c010bd0 tx=0x7f869c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f630262fcd92487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.543+0000 7f868a7fc640 1 -- 172.21.15.1:0/1948620971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c024070 con 0x556050439370 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.543+0000 7f868a7fc640 1 -- 172.21.15.1:0/1948620971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f869c00ebf0 con 0x556050439370 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.543+0000 7f868a7fc640 1 -- 172.21.15.1:0/1948620971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0056b0 con 0x556050439370 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- 172.21.15.1:0/1948620971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 msgr2=0x55605043b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f869c010bd0 tx=0x7f869c01c000 comp rx=0 tx=0).stop 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- 172.21.15.1:0/1948620971 shutdown_connections 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x55605043b760 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x55605042ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 --2- 172.21.15.1:0/1948620971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042fb40 0x55605042e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- 172.21.15.1:0/1948620971 >> 172.21.15.1:0/1948620971 conn(0x5560503f7310 msgr2=0x55605042ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- 172.21.15.1:0/1948620971 shutdown_connections 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- 172.21.15.1:0/1948620971 wait complete. 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 -- start start 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.544+0000 7f86ac733740 1 Processor -- start 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050438d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050439370 0x556050436600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556050440420 con 0x55605042fb40 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55605034f060 con 0x556050439370 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5560504405a0 con 0x55605042e5d0 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86ac733740 10 client.0 _ll_register_callbacks cb 0x5560500a28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35852/0 (socket says 172.21.15.1:35852) 2024-09-12T02:32:48.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 -- 172.21.15.1:0/2254812712 learned_addr learned my addr 172.21.15.1:0/2254812712 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a3fff640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050438d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a88f7640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050439370 0x556050436600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 -- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 msgr2=0x556050438d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050438d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 -- 172.21.15.1:0/2254812712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050439370 msgr2=0x556050436600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050439370 0x556050436600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 -- 172.21.15.1:0/2254812712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560501053c0 con 0x55605042fb40 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86a37fe640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f869802a9a0 tx=0x7f8698005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf715790f6b2a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.545+0000 7f86837fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698035040 con 0x55605042fb40 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f869c00ebf0 con 0x55605042fb40 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f86980048c0 con 0x55605042fb40 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8698004ac0 con 0x55605042fb40 2024-09-12T02:32:48.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55605044bf10 con 0x55605042fb40 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f869c00ebf0 con 0x55605042fb40 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8698031540 con 0x55605042fb40 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 10 client.15945 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 20 client.15945 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55605044d3d0 0x55605044f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 4 client.15945 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.546+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560503a1860 con 0x55605044d3d0 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.547+0000 7f86a3fff640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55605044d3d0 0x55605044f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.547+0000 7f86837fe640 10 client.15945 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.547+0000 7f86a3fff640 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55605044d3d0 0x55605044f810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60e320c73b6efa26 server_cookie=7f2a750bfc2cc427 in_seq=0 out_seq=0 2024-09-12T02:32:48.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86837fe640 1 -- 172.21.15.1:0/2254812712 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560503a1860 con 0x55605044d3d0 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86837fe640 10 client.15945 handle_command_reply: tid=0 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 client.15945 shutdown 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 msgr2=0x556050436010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f869802a9a0 tx=0x7f8698005250 comp rx=0 tx=0).stop 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 shutdown_connections 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x55605044d3d0 0x55605044f810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050436010 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050439370 0x556050436600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 --2- 172.21.15.1:0/2254812712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050438d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86837fe640 0 client.15945 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 >> 172.21.15.1:0/2254812712 conn(0x5560503f7310 msgr2=0x556050430960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 shutdown_connections 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 1 -- 172.21.15.1:0/2254812712 wait complete. 2024-09-12T02:32:48.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.548+0000 7f86ac733740 20 client.15945 trim_cache size 0 max 16384 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 Processor -- start 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 -- start start 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x556050449710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556050439370 0x5560504550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ab370 con 0x55605042fb40 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41aceb0 con 0x55605042e5d0 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86ac733740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41aba40 con 0x556050439370 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35866/0 (socket says 172.21.15.1:35866) 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 -- 172.21.15.1:0/443637340 learned_addr learned my addr 172.21.15.1:0/443637340 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 -- 172.21.15.1:0/443637340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556050439370 msgr2=0x5560504550e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556050439370 0x5560504550e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 -- 172.21.15.1:0/443637340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 msgr2=0x556050449710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x556050449710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.562+0000 7f86a37fe640 1 -- 172.21.15.1:0/443637340 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605042ebe0 con 0x55605042fb40 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.563+0000 7f86a37fe640 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8698009850 tx=0x7f8698004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5991ebad8ff5a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.563+0000 7f8689ffb640 1 -- 172.21.15.1:0/443637340 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698035030 con 0x55605042fb40 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.563+0000 7f8689ffb640 1 -- 172.21.15.1:0/443637340 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8698040070 con 0x55605042fb40 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.563+0000 7f8689ffb640 1 -- 172.21.15.1:0/443637340 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698004c60 con 0x55605042fb40 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- 172.21.15.1:0/443637340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 msgr2=0x556050434ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8698009850 tx=0x7f8698004420 comp rx=0 tx=0).stop 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- 172.21.15.1:0/443637340 shutdown_connections 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55605042fb40 0x556050434ff0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556050439370 0x5560504550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 --2- 172.21.15.1:0/443637340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55605042e5d0 0x556050449710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- 172.21.15.1:0/443637340 >> 172.21.15.1:0/443637340 conn(0x5560503f7310 msgr2=0x5560504348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- 172.21.15.1:0/443637340 shutdown_connections 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- 172.21.15.1:0/443637340 wait complete. 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.564+0000 7f86ac733740 1 -- start start 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 Processor -- start 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050446140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050433550 0x5560504b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ac7e0 con 0x556050439370 2024-09-12T02:32:48.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ac110 con 0x556050433550 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41a9350 con 0x55605042e5d0 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86ac733740 10 client.0 _ll_register_callbacks cb 0x7f8698004520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.565+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35874/0 (socket says 172.21.15.1:35874) 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 -- 172.21.15.1:0/3066605802 learned_addr learned my addr 172.21.15.1:0/3066605802 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a88f7640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050433550 0x5560504b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050446140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 -- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 msgr2=0x556050446140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050446140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 -- 172.21.15.1:0/3066605802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050433550 msgr2=0x5560504b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050433550 0x5560504b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 -- 172.21.15.1:0/3066605802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556050433c90 con 0x556050439370 2024-09-12T02:32:48.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86a37fe640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f86980314e0 tx=0x7f8698005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80be37d68dc5877 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86837fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698035070 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f86980046c0 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.566+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8698040070 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8698004e60 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 10 client.15951 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560504b8660 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8698040070 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8698045470 con 0x556050439370 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 10 client.15951 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:32:48.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 20 client.15951 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5560504b8cc0 0x5560504bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 4 client.15951 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.567+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55605039bd70 con 0x5560504b8cc0 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5560504b8cc0 0x5560504bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86837fe640 10 client.15951 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86a3fff640 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5560504b8cc0 0x5560504bb0b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4871558aefb2b09 server_cookie=cf16c97b85b3d51c in_seq=0 out_seq=0 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86837fe640 1 -- 172.21.15.1:0/3066605802 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55605039bd70 con 0x5560504b8cc0 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86837fe640 10 client.15951 handle_command_reply: tid=0 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.568+0000 7f86ac733740 1 client.15951 shutdown 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 msgr2=0x556050432e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f86980314e0 tx=0x7f8698005fd0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 shutdown_connections 2024-09-12T02:32:48.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5560504b8cc0 0x5560504bb0b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86837fe640 0 client.15951 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556050439370 0x556050432e60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556050433550 0x5560504b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 --2- 172.21.15.1:0/3066605802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55605042e5d0 0x556050446140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 >> 172.21.15.1:0/3066605802 conn(0x5560503f7310 msgr2=0x5560504294e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 shutdown_connections 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 1 -- 172.21.15.1:0/3066605802 wait complete. 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.569+0000 7f86ac733740 20 client.15951 trim_cache size 0 max 16384 2024-09-12T02:32:48.580 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 msgr2=0x7f868c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 0x7f868c0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f869c012c80 tx=0x7f869c009e80 comp rx=0 tx=0).stop 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 msgr2=0x7f86a4198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f869400c920 tx=0x7f869400cde0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 shutdown_connections 2024-09-12T02:32:48.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f868c0a2b80 0x7f868c0a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86a4102ef0 0x7f86a419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86a4102570 0x7f86a4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 --2- 172.21.15.1:0/3896928672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86a4100e20 0x7f86a4198450 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 >> 172.21.15.1:0/3896928672 conn(0x7f86a40fc7d0 msgr2=0x7f86a406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 shutdown_connections 2024-09-12T02:32:48.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:48.570+0000 7f86aa35a640 1 -- 172.21.15.1:0/3896928672 wait complete. 2024-09-12T02:32:49.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:32:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:49.974 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:49 smithi001 ceph-mon[31252]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 -- 172.21.15.1:0/3796631102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941036e0 msgr2=0x7f1194107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 --2- 172.21.15.1:0/3796631102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941036e0 0x7f1194107b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f117c009930 tx=0x7f117c02a420 comp rx=0 tx=0).stop 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 -- 172.21.15.1:0/3796631102 shutdown_connections 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 --2- 172.21.15.1:0/3796631102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941036e0 0x7f1194107b90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 --2- 172.21.15.1:0/3796631102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941082a0 0x7f119410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 --2- 172.21.15.1:0/3796631102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 0x7f1194103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 -- 172.21.15.1:0/3796631102 >> 172.21.15.1:0/3796631102 conn(0x7f11940fc7d0 msgr2=0x7f11940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 -- 172.21.15.1:0/3796631102 shutdown_connections 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.064+0000 7f1198ad6640 1 -- 172.21.15.1:0/3796631102 wait complete. 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 Processor -- start 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 -- start start 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 0x7f1194198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 0x7f1194198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11941120c0 con 0x7f11941082a0 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1194111f40 con 0x7f1194102d30 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.065+0000 7f1198ad6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1194112240 con 0x7f11941036e0 2024-09-12T02:32:50.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35894/0 (socket says 172.21.15.1:35894) 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 -- 172.21.15.1:0/2276274200 learned_addr learned my addr 172.21.15.1:0/2276274200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f119259c640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 0x7f1194198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 0x7f1194198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 -- 172.21.15.1:0/2276274200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 msgr2=0x7f1194198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 0x7f1194198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 -- 172.21.15.1:0/2276274200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 msgr2=0x7f1194198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 0x7f1194198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 -- 172.21.15.1:0/2276274200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119419d5d0 con 0x7f11941082a0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 0x7f1194198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1192d9d640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b970 tx=0x7f118c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f118b7fe640 1 -- 172.21.15.1:0/2276274200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c019070 con 0x7f11941082a0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119419d8c0 con 0x7f11941082a0 2024-09-12T02:32:50.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f118b7fe640 1 -- 172.21.15.1:0/2276274200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f118c00cb40 con 0x7f11941082a0 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.066+0000 7f118b7fe640 1 -- 172.21.15.1:0/2276274200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c007650 con 0x7f11941082a0 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.067+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11941a51a0 con 0x7f11941082a0 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.069+0000 7f118b7fe640 1 -- 172.21.15.1:0/2276274200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f118c01c070 con 0x7f11941082a0 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.069+0000 7f119aeaf740 1 Processor -- start 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 -- start start 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 0x558d24a83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a90760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d249e92f0 con 0x558d24a84b40 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d24990cf0 con 0x558d24a8e370 2024-09-12T02:32:50.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119aeaf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d249e52b0 con 0x558d24a835d0 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f118b7fe640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 0x7f11800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f1191d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f1191d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35904/0 (socket says 172.21.15.1:35904) 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f1191d9b640 1 -- 172.21.15.1:0/2763451278 learned_addr learned my addr 172.21.15.1:0/2763451278 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f118b7fe640 1 -- 172.21.15.1:0/2276274200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f118c0ce6a0 con 0x7f11941082a0 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f1192d9d640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 0x7f11800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f119259c640 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 0x558d24a83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.070+0000 7f1191d9b640 1 -- 172.21.15.1:0/2763451278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 msgr2=0x558d24a83a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 0x558d24a83a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1191d9b640 1 -- 172.21.15.1:0/2763451278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 msgr2=0x558d24a90760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a90760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1191d9b640 1 -- 172.21.15.1:0/2763451278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d249753a0 con 0x558d24a84b40 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f119259c640 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 0x558d24a83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1192d9d640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 0x7f11800a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f118c0a3620 tx=0x7f118c004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f11940697d0 tx=0x7f117c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed10ef3db1556595 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1188ff9640 1 -- 172.21.15.1:0/2763451278 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c035040 con 0x558d24a84b40 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1188ff9640 1 -- 172.21.15.1:0/2763451278 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c0035f0 con 0x558d24a84b40 2024-09-12T02:32:50.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.071+0000 7f1188ff9640 1 -- 172.21.15.1:0/2763451278 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c03d6e0 con 0x558d24a84b40 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 -- 172.21.15.1:0/2763451278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 msgr2=0x558d24a83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f11940697d0 tx=0x7f117c0316f0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 -- 172.21.15.1:0/2763451278 shutdown_connections 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a90760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a835d0 0x558d24a83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2763451278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a83090 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 -- 172.21.15.1:0/2763451278 >> 172.21.15.1:0/2763451278 conn(0x558d24a4c310 msgr2=0x558d24a7fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 -- 172.21.15.1:0/2763451278 shutdown_connections 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.072+0000 7f119aeaf740 1 -- 172.21.15.1:0/2763451278 wait complete. 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 -- start start 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 Processor -- start 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 0x558d24a8b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a8b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558d24a91010 con 0x558d24a835d0 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d249a4060 con 0x558d24a8e370 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.073+0000 7f119aeaf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d24a91190 con 0x558d24a84b40 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f119aeaf740 10 client.0 _ll_register_callbacks cb 0x558d246f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35912/0 (socket says 172.21.15.1:35912) 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 -- 172.21.15.1:0/2183240051 learned_addr learned my addr 172.21.15.1:0/2183240051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a8b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f119259c640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 0x558d24a8b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 -- 172.21.15.1:0/2183240051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 msgr2=0x558d24a8b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 0x558d24a8b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 -- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 msgr2=0x558d24a8b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a8b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 -- 172.21.15.1:0/2183240051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d2475a3c0 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f119259c640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 0x558d24a8b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f117c004630 tx=0x7f117c005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447460ab571cbf3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.074+0000 7f1179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c035030 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f117c005220 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117c0035f0 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f117c05a050 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 10 client.15963 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d24a9ca90 con 0x558d24a835d0 2024-09-12T02:32:50.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c0035f0 con 0x558d24a835d0 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f117c052020 con 0x558d24a835d0 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 10 client.15963 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 20 client.15963 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24aa01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 4 client.15963 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.075+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d249f6860 con 0x558d24a9dde0 2024-09-12T02:32:50.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.076+0000 7f119259c640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24aa01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.076+0000 7f1179ffb640 10 client.15963 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.076+0000 7f119259c640 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24aa01d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6981aae5da26e8d server_cookie=fa08c677c41c994c in_seq=0 out_seq=0 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f1179ffb640 1 -- 172.21.15.1:0/2183240051 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d249f6860 con 0x558d24a9dde0 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f1179ffb640 10 client.15963 handle_command_reply: tid=0 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 client.15963 shutdown 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 msgr2=0x558d24a8dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f117c004630 tx=0x7f117c005a70 comp rx=0 tx=0).stop 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 shutdown_connections 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24aa01d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a8e370 0x558d24a8b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a84b40 0x558d24a8b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f1179ffb640 0 client.15963 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2183240051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a835d0 0x558d24a8dd50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.077+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 >> 172.21.15.1:0/2183240051 conn(0x558d24a4c310 msgr2=0x558d24a85960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.078+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 shutdown_connections 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.078+0000 7f119aeaf740 1 -- 172.21.15.1:0/2183240051 wait complete. 2024-09-12T02:32:50.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.078+0000 7f119aeaf740 20 client.15963 trim_cache size 0 max 16384 2024-09-12T02:32:50.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.098+0000 7f119aeaf740 1 Processor -- start 2024-09-12T02:32:50.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.098+0000 7f119aeaf740 1 -- start start 2024-09-12T02:32:50.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a7fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11941ad5d0 con 0x558d24a84b40 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11941af110 con 0x558d24a835d0 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119aeaf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11941adca0 con 0x558d24a8e370 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35924/0 (socket says 172.21.15.1:35924) 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 -- 172.21.15.1:0/820918606 learned_addr learned my addr 172.21.15.1:0/820918606 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f1191d9b640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a7fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f1191d9b640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 -- 172.21.15.1:0/820918606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 msgr2=0x558d24a86120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a86120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 -- 172.21.15.1:0/820918606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 msgr2=0x558d24a7fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a7fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f119259c640 1 -- 172.21.15.1:0/820918606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d24a7e310 con 0x558d24a84b40 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.099+0000 7f1191d9b640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.100+0000 7f119259c640 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1184005d90 tx=0x7f118400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec37af86c722a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.100+0000 7f117bfff640 1 -- 172.21.15.1:0/820918606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1184004020 con 0x558d24a84b40 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.100+0000 7f117bfff640 1 -- 172.21.15.1:0/820918606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11840041c0 con 0x558d24a84b40 2024-09-12T02:32:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.100+0000 7f117bfff640 1 -- 172.21.15.1:0/820918606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118401c890 con 0x558d24a84b40 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- 172.21.15.1:0/820918606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 msgr2=0x558d24a8cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1184005d90 tx=0x7f118400f7f0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- 172.21.15.1:0/820918606 shutdown_connections 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a8cf70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a86120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 --2- 172.21.15.1:0/820918606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a7fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- 172.21.15.1:0/820918606 >> 172.21.15.1:0/820918606 conn(0x558d24a4c310 msgr2=0x558d24a8c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- 172.21.15.1:0/820918606 shutdown_connections 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- 172.21.15.1:0/820918606 wait complete. 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 -- start start 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.101+0000 7f119aeaf740 1 Processor -- start 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a96c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11941aea40 con 0x558d24a84b40 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f11941ae370 con 0x558d24a835d0 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11941ab5b0 con 0x558d24a8e370 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119aeaf740 10 client.0 _ll_register_callbacks cb 0x7f117c031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35938/0 (socket says 172.21.15.1:35938) 2024-09-12T02:32:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 -- 172.21.15.1:0/2157149314 learned_addr learned my addr 172.21.15.1:0/2157149314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a96c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 -- 172.21.15.1:0/2157149314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 msgr2=0x558d24a925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a925b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 -- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 msgr2=0x558d24a96c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a96c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.102+0000 7f119259c640 1 -- 172.21.15.1:0/2157149314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d24a92de0 con 0x558d24a84b40 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f119259c640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1184003fd0 tx=0x7f118400a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4462c536500a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118401ca20 con 0x558d24a84b40 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f118401cbc0 con 0x558d24a84b40 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11840041c0 con 0x558d24a84b40 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11840035f0 con 0x558d24a84b40 2024-09-12T02:32:50.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f119aeaf740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d24b08850 con 0x558d24a84b40 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11840041c0 con 0x558d24a84b40 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f118402e020 con 0x558d24a84b40 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.103+0000 7f119aeaf740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f119aeaf740 10 client.15969 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f119aeaf740 20 client.15969 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24b0af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f119aeaf740 4 client.15969 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d249f0d70 con 0x558d24a9dde0 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24b0af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f1179ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.104+0000 7f1191d9b640 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24b0af80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ccb32850d98b358 server_cookie=7707170308d63a8 in_seq=0 out_seq=0 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f1179ffb640 1 -- 172.21.15.1:0/2157149314 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d249f0d70 con 0x558d24a9dde0 2024-09-12T02:32:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f1179ffb640 10 client.15969 handle_command_reply: tid=0 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 client.15969 shutdown 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 msgr2=0x558d24a91fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1184003fd0 tx=0x7f118400a590 comp rx=0 tx=0).stop 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 shutdown_connections 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558d24a84b40 0x558d24a91fc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x558d24a9dde0 0x558d24b0af80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d24a8e370 0x558d24a925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 --2- 172.21.15.1:0/2157149314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d24a835d0 0x558d24a96c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f1179ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 >> 172.21.15.1:0/2157149314 conn(0x558d24a4c310 msgr2=0x558d24a8d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 shutdown_connections 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 1 -- 172.21.15.1:0/2157149314 wait complete. 2024-09-12T02:32:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.105+0000 7f119aeaf740 20 client.15969 trim_cache size 0 max 16384 2024-09-12T02:32:50.111 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 msgr2=0x7f11800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 0x7f11800a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f118c0a3620 tx=0x7f118c004b50 comp rx=0 tx=0).stop 2024-09-12T02:32:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 msgr2=0x7f119419cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b970 tx=0x7f118c00be30 comp rx=0 tx=0).stop 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 shutdown_connections 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f11800a2b80 0x7f11800a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11941082a0 0x7f119419cef0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11941036e0 0x7f1194198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 --2- 172.21.15.1:0/2276274200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1194102d30 0x7f1194198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 >> 172.21.15.1:0/2276274200 conn(0x7f11940fc7d0 msgr2=0x7f1194105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 shutdown_connections 2024-09-12T02:32:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:50.106+0000 7f1198ad6640 1 -- 172.21.15.1:0/2276274200 wait complete. 2024-09-12T02:32:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:49 smithi134 ceph-mon[35091]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-09-12T02:32:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:49 smithi173 ceph-mon[35036]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 15 op/s 2024-09-12T02:32:50.857 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:32:51.137 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:51.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 -- 172.21.15.1:0/2878943332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102ef0 msgr2=0x7fc44810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 --2- 172.21.15.1:0/2878943332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102ef0 0x7fc44810da40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc44002a950 comp rx=0 tx=0).stop 2024-09-12T02:32:51.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 -- 172.21.15.1:0/2878943332 shutdown_connections 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 --2- 172.21.15.1:0/2878943332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102ef0 0x7fc44810da40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 --2- 172.21.15.1:0/2878943332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102570 0x7fc4481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 --2- 172.21.15.1:0/2878943332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 0x7fc448101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 -- 172.21.15.1:0/2878943332 >> 172.21.15.1:0/2878943332 conn(0x7fc4480fc7d0 msgr2=0x7fc4480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 -- 172.21.15.1:0/2878943332 shutdown_connections 2024-09-12T02:32:51.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.649+0000 7fc44e645640 1 -- 172.21.15.1:0/2878943332 wait complete. 2024-09-12T02:32:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 Processor -- start 2024-09-12T02:32:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 -- start start 2024-09-12T02:32:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 0x7fc44819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102ef0 0x7fc44819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481142d0 con 0x7fc448102570 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc448114150 con 0x7fc448102ef0 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44e645640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc448114450 con 0x7fc448100e20 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47352/0 (socket says 172.21.15.1:47352) 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 -- 172.21.15.1:0/1386080371 learned_addr learned my addr 172.21.15.1:0/1386080371 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:51.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc447fff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 0x7fc44819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102ef0 0x7fc44819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 -- 172.21.15.1:0/1386080371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 msgr2=0x7fc44819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 0x7fc44819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 -- 172.21.15.1:0/1386080371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102ef0 msgr2=0x7fc44819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.650+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102ef0 0x7fc44819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc43ffff640 1 -- 172.21.15.1:0/1386080371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819f600 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9f0 tx=0x7fc43000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc445ffb640 1 -- 172.21.15.1:0/1386080371 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43000cd80 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819f8f0 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc445ffb640 1 -- 172.21.15.1:0/1386080371 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc430010910 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc445ffb640 1 -- 172.21.15.1:0/1386080371 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4300188f0 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.651+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a71d0 con 0x7fc448102570 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 Processor -- start 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 -- start start 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec25d0 0x562cefec2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefecd370 0x562cefecf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cefe282f0 con 0x562cefec3b40 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562cefdcfcf0 con 0x562cefecd370 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc450a1e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562cefe242b0 con 0x562cefec25d0 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc44cbe2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc44cbe2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47360/0 (socket says 172.21.15.1:47360) 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc44cbe2640 1 -- 172.21.15.1:0/4029500004 learned_addr learned my addr 172.21.15.1:0/4029500004 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc447fff640 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec25d0 0x562cefec2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.654+0000 7fc445ffb640 1 -- 172.21.15.1:0/1386080371 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc430018ad0 con 0x7fc448102570 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 -- 172.21.15.1:0/4029500004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec25d0 msgr2=0x562cefec2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec25d0 0x562cefec2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 -- 172.21.15.1:0/4029500004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefecd370 msgr2=0x562cefecf760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefecd370 0x562cefecf760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 -- 172.21.15.1:0/4029500004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cefdb43a0 con 0x562cefec3b40 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc440005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b741663b705bdd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc43e7fc640 1 -- 172.21.15.1:0/4029500004 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440048070 con 0x562cefec3b40 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc43e7fc640 1 -- 172.21.15.1:0/4029500004 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440003e50 con 0x562cefec3b40 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc43e7fc640 1 -- 172.21.15.1:0/4029500004 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440034040 con 0x562cefec3b40 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.655+0000 7fc445ffb640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 0x7fc4340a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc447fff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 0x7fc4340a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc445ffb640 1 -- 172.21.15.1:0/1386080371 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc4300cf3d0 con 0x7fc448102570 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc447fff640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 0x7fc4340a5030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x562cefebfac0 tx=0x7fc438005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 -- 172.21.15.1:0/4029500004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 msgr2=0x562cefec2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ca0 tx=0x7fc440005f80 comp rx=0 tx=0).stop 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 -- 172.21.15.1:0/4029500004 shutdown_connections 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefecd370 0x562cefecf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec25d0 0x562cefec2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 --2- 172.21.15.1:0/4029500004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec2090 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 -- 172.21.15.1:0/4029500004 >> 172.21.15.1:0/4029500004 conn(0x562cefe8b310 msgr2=0x562cefebec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 -- 172.21.15.1:0/4029500004 shutdown_connections 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.656+0000 7fc450a1e740 1 -- 172.21.15.1:0/4029500004 wait complete. 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.657+0000 7fc450a1e740 1 -- start start 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.657+0000 7fc450a1e740 1 Processor -- start 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefecce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefeca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cefed0010 con 0x562cefec3b40 2024-09-12T02:32:51.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562cefde3060 con 0x562cefec25d0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562cefed0190 con 0x562cefecd370 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc450a1e740 10 client.0 _ll_register_callbacks cb 0x562cefb368c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47366/0 (socket says 172.21.15.1:47366) 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 -- 172.21.15.1:0/45670374 learned_addr learned my addr 172.21.15.1:0/45670374 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc447fff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefecce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefeca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 -- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 msgr2=0x562cefeca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefeca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 -- 172.21.15.1:0/45670374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 msgr2=0x562cefecce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefecce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 -- 172.21.15.1:0/45670374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cefb993c0 con 0x562cefec3b40 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc43ffff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c6a0 tx=0x7fc43009bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeb4e3dbb1125df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc4277fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.658+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4300a4880 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc440003e50 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc430098330 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc43009b110 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cefedbbe0 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc440003e50 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc4300a4ad0 con 0x562cefec3b40 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 10 client.15981 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 20 client.15981 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562cefedcf30 0x562cefedf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 4 client.15981 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:51.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.659+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cefe35860 con 0x562cefedcf30 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.660+0000 7fc447fff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562cefedcf30 0x562cefedf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.660+0000 7fc447fff640 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562cefedcf30 0x562cefedf320 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c30f88145522ea5a server_cookie=bdc4c2ea8aa168c7 in_seq=0 out_seq=0 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.660+0000 7fc4277fe640 10 client.15981 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc4277fe640 1 -- 172.21.15.1:0/45670374 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cefe35860 con 0x562cefedcf30 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc4277fe640 10 client.15981 handle_command_reply: tid=0 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 client.15981 shutdown 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 msgr2=0x562cefeca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c6a0 tx=0x7fc43009bcc0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 shutdown_connections 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562cefedcf30 0x562cefedf320 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefeca0c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefeca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc4277fe640 0 client.15981 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 --2- 172.21.15.1:0/45670374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefecce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 >> 172.21.15.1:0/45670374 conn(0x562cefe8b310 msgr2=0x562cefec4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 shutdown_connections 2024-09-12T02:32:51.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.661+0000 7fc450a1e740 1 -- 172.21.15.1:0/45670374 wait complete. 2024-09-12T02:32:51.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.662+0000 7fc450a1e740 20 client.15981 trim_cache size 0 max 16384 2024-09-12T02:32:51.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 Processor -- start 2024-09-12T02:32:51.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 -- start start 2024-09-12T02:32:51.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefec3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefec5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481af690 con 0x562cefec3b40 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481b11d0 con 0x562cefec25d0 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc450a1e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481afd60 con 0x562cefecd370 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc43ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47382/0 (socket says 172.21.15.1:47382) 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc43ffff640 1 -- 172.21.15.1:0/1944401171 learned_addr learned my addr 172.21.15.1:0/1944401171 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.675+0000 7fc447fff640 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefec3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefec5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 -- 172.21.15.1:0/1944401171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 msgr2=0x562cefec5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefec5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 -- 172.21.15.1:0/1944401171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 msgr2=0x562cefec3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefec3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 -- 172.21.15.1:0/1944401171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cefecfad0 con 0x562cefec3b40 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9c0 tx=0x7fc43009a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272ae0e7c37c24e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43dffb640 1 -- 172.21.15.1:0/1944401171 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430097f60 con 0x562cefec3b40 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43dffb640 1 -- 172.21.15.1:0/1944401171 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4300a4880 con 0x562cefec3b40 2024-09-12T02:32:51.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.676+0000 7fc43dffb640 1 -- 172.21.15.1:0/1944401171 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430010690 con 0x562cefec3b40 2024-09-12T02:32:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 -- 172.21.15.1:0/1944401171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 msgr2=0x562cefec91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9c0 tx=0x7fc43009a1d0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 -- 172.21.15.1:0/1944401171 shutdown_connections 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefec3b40 0x562cefec91b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefecd370 0x562cefec5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1944401171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefec3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 -- 172.21.15.1:0/1944401171 >> 172.21.15.1:0/1944401171 conn(0x562cefe8b310 msgr2=0x562cefeb9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 -- 172.21.15.1:0/1944401171 shutdown_connections 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.677+0000 7fc450a1e740 1 -- 172.21.15.1:0/1944401171 wait complete. 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 -- start start 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 Processor -- start 2024-09-12T02:32:51.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefed5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec3b40 0x562cefed5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481b0b00 con 0x562cefecd370 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481b0430 con 0x562cefec25d0 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.678+0000 7fc450a1e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481ad670 con 0x562cefec3b40 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc450a1e740 10 client.0 _ll_register_callbacks cb 0x7fc43000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47386/0 (socket says 172.21.15.1:47386) 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 -- 172.21.15.1:0/1527677762 learned_addr learned my addr 172.21.15.1:0/1527677762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc43ffff640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec3b40 0x562cefed5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc447fff640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefed5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 -- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec3b40 msgr2=0x562cefed5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec3b40 0x562cefed5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 -- 172.21.15.1:0/1527677762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 msgr2=0x562cefed5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefed5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 -- 172.21.15.1:0/1527677762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cefed1260 con 0x562cefecd370 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc44cbe2640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc440009620 tx=0x7fc440003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5c076856681e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc4277fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440048040 con 0x562cefecd370 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc440003cf0 con 0x562cefecd370 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.679+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4300a4880 con 0x562cefecd370 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc440034040 con 0x562cefecd370 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:51.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ceff476a0 con 0x562cefecd370 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4300a4880 con 0x562cefecd370 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc44004b030 con 0x562cefecd370 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 10 client.15987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 20 client.15987 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562ceff479e0 0x562ceff49dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 4 client.15987 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cefe2fd70 con 0x562ceff479e0 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.680+0000 7fc447fff640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562ceff479e0 0x562ceff49dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc4277fe640 10 client.15987 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc447fff640 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562ceff479e0 0x562ceff49dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cffc08211706a25e server_cookie=f61d13490549bcb0 in_seq=0 out_seq=0 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc4277fe640 1 -- 172.21.15.1:0/1527677762 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cefe2fd70 con 0x562ceff479e0 2024-09-12T02:32:51.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc4277fe640 10 client.15987 handle_command_reply: tid=0 2024-09-12T02:32:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 client.15987 shutdown 2024-09-12T02:32:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 msgr2=0x562cefed0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc440009620 tx=0x7fc440003b80 comp rx=0 tx=0).stop 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 shutdown_connections 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x562ceff479e0 0x562ceff49dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cefecd370 0x562cefed0a30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562cefec3b40 0x562cefed5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 --2- 172.21.15.1:0/1527677762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562cefec25d0 0x562cefed5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 >> 172.21.15.1:0/1527677762 conn(0x562cefe8b310 msgr2=0x562cefec91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc4277fe640 0 client.15987 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 shutdown_connections 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.681+0000 7fc450a1e740 1 -- 172.21.15.1:0/1527677762 wait complete. 2024-09-12T02:32:51.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.682+0000 7fc450a1e740 20 client.15987 trim_cache size 0 max 16384 2024-09-12T02:32:51.691 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.682+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 msgr2=0x7fc4340a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.682+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 0x7fc4340a5030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x562cefebfac0 tx=0x7fc438005f90 comp rx=0 tx=0).stop 2024-09-12T02:32:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.682+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 msgr2=0x7fc44819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:51.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.682+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e9f0 tx=0x7fc43000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 shutdown_connections 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc4340a2b70 0x7fc4340a5030 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448102570 0x7fc44819ab90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc448102ef0 0x7fc44819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 --2- 172.21.15.1:0/1386080371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc448100e20 0x7fc44819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 >> 172.21.15.1:0/1386080371 conn(0x7fc4480fc7d0 msgr2=0x7fc4481067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 shutdown_connections 2024-09-12T02:32:51.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:51.683+0000 7fc44e645640 1 -- 172.21.15.1:0/1386080371 wait complete. 2024-09-12T02:32:51.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:51 smithi001 ceph-mon[31252]: pgmap v400: 97 pgs: 97 active+clean; 138 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T02:32:52.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:51 smithi134 ceph-mon[35091]: pgmap v400: 97 pgs: 97 active+clean; 138 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T02:32:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:51 smithi173 ceph-mon[35036]: pgmap v400: 97 pgs: 97 active+clean; 138 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 19 op/s 2024-09-12T02:32:52.212 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T02:32:52.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:32:52.430 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:32:52.497 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:52.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 -- 172.21.15.1:0/4186645115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701008e0 msgr2=0x7f5570100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 --2- 172.21.15.1:0/4186645115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701008e0 0x7f5570100cc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f556c009900 tx=0x7f556c02a410 comp rx=0 tx=0).stop 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 -- 172.21.15.1:0/4186645115 shutdown_connections 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 --2- 172.21.15.1:0/4186645115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f5570110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 --2- 172.21.15.1:0/4186645115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5570101290 0x7f557010df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 --2- 172.21.15.1:0/4186645115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55701008e0 0x7f5570100cc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 -- 172.21.15.1:0/4186645115 >> 172.21.15.1:0/4186645115 conn(0x7f55700fc7d0 msgr2=0x7f55700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 -- 172.21.15.1:0/4186645115 shutdown_connections 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.966+0000 7f5577bab640 1 -- 172.21.15.1:0/4186645115 wait complete. 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 Processor -- start 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 -- start start 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55701008e0 0x7f557019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:52.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f557019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55701141a0 con 0x7f5570101290 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5570114020 con 0x7f55701008e0 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5577bab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5570114320 con 0x7f557010e490 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5575146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5575146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47408/0 (socket says 172.21.15.1:47408) 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5575146640 1 -- 172.21.15.1:0/3702644919 learned_addr learned my addr 172.21.15.1:0/3702644919 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5575947640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55701008e0 0x7f557019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.967+0000 7f5576148640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f557019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 -- 172.21.15.1:0/3702644919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 msgr2=0x7f557019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f557019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 -- 172.21.15.1:0/3702644919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55701008e0 msgr2=0x7f557019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:52.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55701008e0 0x7f557019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 -- 172.21.15.1:0/3702644919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557019f650 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5576148640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f557019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5575146640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f556000d950 tx=0x7f556000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560017030 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5560004020 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557019f940 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600047a0 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.968+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55701a7220 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.969+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5570100cc0 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.971+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f55600041d0 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.972+0000 7f5566ffd640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 0x7f555c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.972+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f55600cf140 con 0x7f5570101290 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.972+0000 7f5575947640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 0x7f555c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:52.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.973+0000 7f5575947640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 0x7f555c0a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f556c009230 tx=0x7f556c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:52.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:52.975+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f556009c020 con 0x7f5570101290 2024-09-12T02:32:53.034 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:53.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.207+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f557019ba00 con 0x7f5570101290 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.208+0000 7f5566ffd640 1 -- 172.21.15.1:0/3702644919 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f556009b920 con 0x7f5570101290 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:32:53.208 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 msgr2=0x7f555c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:53.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 0x7f555c0a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f556c009230 tx=0x7f556c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 msgr2=0x7f557019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f556000d950 tx=0x7f556000de10 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 shutdown_connections 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f555c0a2b80 0x7f555c0a5040 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5570101290 0x7f557019abe0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f557010e490 0x7f557019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 --2- 172.21.15.1:0/3702644919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55701008e0 0x7f557019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 >> 172.21.15.1:0/3702644919 conn(0x7f55700fc7d0 msgr2=0x7f557010f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 shutdown_connections 2024-09-12T02:32:53.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:53.210+0000 7f5577bab640 1 -- 172.21.15.1:0/3702644919 wait complete. 2024-09-12T02:32:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:53 smithi001 ceph-mon[31252]: pgmap v401: 97 pgs: 97 active+clean; 182 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2024-09-12T02:32:53.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:53 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3702644919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:53.978 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T02:32:53.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T02:32:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:53 smithi134 ceph-mon[35091]: pgmap v401: 97 pgs: 97 active+clean; 182 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2024-09-12T02:32:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:53 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3702644919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 -- 172.21.15.1:0/1695066663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698102d90 msgr2=0x7f3698103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1695066663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698102d90 0x7f3698103170 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3694009930 tx=0x7f369402a420 comp rx=0 tx=0).stop 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 -- 172.21.15.1:0/1695066663 shutdown_connections 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1695066663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698108290 0x7f369810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1695066663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698103740 0x7f3698107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1695066663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698102d90 0x7f3698103170 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.171+0000 7f36a04ef640 1 -- 172.21.15.1:0/1695066663 >> 172.21.15.1:0/1695066663 conn(0x7f36980fc7d0 msgr2=0x7f36980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.172+0000 7f36a04ef640 1 -- 172.21.15.1:0/1695066663 shutdown_connections 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.172+0000 7f36a04ef640 1 -- 172.21.15.1:0/1695066663 wait complete. 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.172+0000 7f36a04ef640 1 Processor -- start 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.172+0000 7f36a04ef640 1 -- start start 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 0x7f36981a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 0x7f369819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36981120d0 con 0x7f3698103740 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3698111f50 con 0x7f3698102d90 2024-09-12T02:32:54.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f36a04ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3698112250 con 0x7f3698108290 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369da8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369da8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47426/0 (socket says 172.21.15.1:47426) 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369da8a640 1 -- 172.21.15.1:0/1131646932 learned_addr learned my addr 172.21.15.1:0/1131646932 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 0x7f36981a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369ea8c640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 0x7f369819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 -- 172.21.15.1:0/1131646932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 msgr2=0x7f369819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 0x7f369819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 -- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 msgr2=0x7f36981a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369e28b640 1 -- 172.21.15.1:0/1131646932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369819ad50 con 0x7f3698102d90 2024-09-12T02:32:54.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369ea8c640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 0x7f369819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.173+0000 7f369da8a640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 0x7f36981a0460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f369402a940 tx=0x7f3694003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f368f7fe640 1 -- 172.21.15.1:0/1131646932 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369403f070 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369819afe0 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f368f7fe640 1 -- 172.21.15.1:0/1131646932 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3694031c90 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f368f7fe640 1 -- 172.21.15.1:0/1131646932 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694035030 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.174+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36981a7330 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.177+0000 7f368f7fe640 1 -- 172.21.15.1:0/1131646932 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3694042070 con 0x7f3698102d90 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.177+0000 7f36a28c8740 1 Processor -- start 2024-09-12T02:32:54.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 -- start start 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5650692492f0 con 0x5650692ee370 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5650691f0cf0 con 0x5650692e4b40 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f36a28c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5650692452b0 con 0x5650692e35d0 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:44884/0 (socket says 172.21.15.1:44884) 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 -- 172.21.15.1:0/238843681 learned_addr learned my addr 172.21.15.1:0/238843681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369da8a640 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369e28b640 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 -- 172.21.15.1:0/238843681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 msgr2=0x5650692e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 -- 172.21.15.1:0/238843681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 msgr2=0x5650692f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.178+0000 7f369ea8c640 1 -- 172.21.15.1:0/238843681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650691d53a0 con 0x5650692e4b40 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f369ea8c640 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3690009fd0 tx=0x7f3690010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c5bda943380297 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f368f7fe640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f368cff9640 1 -- 172.21.15.1:0/238843681 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690011700 con 0x5650692e4b40 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f368cff9640 1 -- 172.21.15.1:0/238843681 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690011d80 con 0x5650692e4b40 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.179+0000 7f368cff9640 1 -- 172.21.15.1:0/238843681 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369000e3c0 con 0x5650692e4b40 2024-09-12T02:32:54.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f368f7fe640 1 -- 172.21.15.1:0/1131646932 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f36940efa10 con 0x7f3698102d90 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 -- 172.21.15.1:0/238843681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 msgr2=0x5650692e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3690009fd0 tx=0x7f3690010860 comp rx=0 tx=0).stop 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f369e28b640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 0x7f36840a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36940b8bc0 tx=0x7f36940f1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 -- 172.21.15.1:0/238843681 shutdown_connections 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 --2- 172.21.15.1:0/238843681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692e3090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.180+0000 7f36a28c8740 1 -- 172.21.15.1:0/238843681 >> 172.21.15.1:0/238843681 conn(0x5650692ac310 msgr2=0x5650692dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.181+0000 7f36a28c8740 1 -- 172.21.15.1:0/238843681 shutdown_connections 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.181+0000 7f36a28c8740 1 -- 172.21.15.1:0/238843681 wait complete. 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.181+0000 7f36a28c8740 1 -- start start 2024-09-12T02:32:54.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.181+0000 7f36a28c8740 1 Processor -- start 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692eb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650692eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47440/0 (socket says 172.21.15.1:47440) 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f369ea8c640 1 -- 172.21.15.1:0/654592272 learned_addr learned my addr 172.21.15.1:0/654592272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5650692f1070 con 0x5650692e35d0 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x565069204060 con 0x5650692e4b40 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5650692f11f0 con 0x5650692ee370 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f36a28c8740 10 client.0 _ll_register_callbacks cb 0x565068f578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:54.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f369ea8c640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650692eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.182+0000 7f369da8a640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 -- 172.21.15.1:0/654592272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 msgr2=0x5650692eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650692eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 -- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 msgr2=0x5650692eb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692eb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565068fba3c0 con 0x5650692e35d0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369da8a640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692eb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f369ea8c640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3690011010 tx=0x7f369001bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f514d718821b841c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f3681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690011500 con 0x5650692e35d0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690011d80 con 0x5650692e35d0 2024-09-12T02:32:54.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f36900116a0 con 0x5650692e35d0 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3690031050 con 0x5650692e35d0 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f36a28c8740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.183+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565069305370 con 0x5650692e35d0 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690011d80 con 0x5650692e35d0 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36900056e0 con 0x5650692e35d0 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 20 client.16005 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:54.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069309030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 4 client.16005 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.184+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565069256860 con 0x565069306bd0 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.185+0000 7f369da8a640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069309030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.185+0000 7f3681ffb640 10 client.16005 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.185+0000 7f369da8a640 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069309030 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3660574b0487650 server_cookie=c6638c7b49ace88a in_seq=0 out_seq=0 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f3681ffb640 1 -- 172.21.15.1:0/654592272 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565069256860 con 0x565069306bd0 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f3681ffb640 10 client.16005 handle_command_reply: tid=0 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 client.16005 shutdown 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 msgr2=0x5650692edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3690011010 tx=0x7f369001bb90 comp rx=0 tx=0).stop 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 shutdown_connections 2024-09-12T02:32:54.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069309030 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650692eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f3681ffb640 0 client.16005 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692eb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 --2- 172.21.15.1:0/654592272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.186+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 >> 172.21.15.1:0/654592272 conn(0x5650692ac310 msgr2=0x5650692e5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.187+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 shutdown_connections 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.187+0000 7f36a28c8740 1 -- 172.21.15.1:0/654592272 wait complete. 2024-09-12T02:32:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.187+0000 7f36a28c8740 20 client.16005 trim_cache size 0 max 16384 2024-09-12T02:32:54.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:53 smithi173 ceph-mon[35036]: pgmap v401: 97 pgs: 97 active+clean; 182 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 18 op/s 2024-09-12T02:32:54.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:53 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3702644919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:32:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 Processor -- start 2024-09-12T02:32:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 -- start start 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650693022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36981ab4c0 con 0x5650692e4b40 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36981ad000 con 0x5650692e35d0 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f36a28c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36981abb90 con 0x5650692ee370 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f369da8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f369da8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47452/0 (socket says 172.21.15.1:47452) 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f369da8a640 1 -- 172.21.15.1:0/1649417000 learned_addr learned my addr 172.21.15.1:0/1649417000 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.202+0000 7f369ea8c640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 -- 172.21.15.1:0/1649417000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 msgr2=0x5650693022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369ea8c640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650693022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650693022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 -- 172.21.15.1:0/1649417000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 msgr2=0x5650692edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 -- 172.21.15.1:0/1649417000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650692df510 con 0x5650692e4b40 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369ea8c640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f369da8a640 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f36980ff040 tx=0x7f3688005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d6652f45c148c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f3683fff640 1 -- 172.21.15.1:0/1649417000 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368800fbb0 con 0x5650692e4b40 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f3683fff640 1 -- 172.21.15.1:0/1649417000 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f368800fd50 con 0x5650692e4b40 2024-09-12T02:32:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.203+0000 7f3683fff640 1 -- 172.21.15.1:0/1649417000 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368801e420 con 0x5650692e4b40 2024-09-12T02:32:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- 172.21.15.1:0/1649417000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 msgr2=0x5650692ea910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f36980ff040 tx=0x7f3688005f90 comp rx=0 tx=0).stop 2024-09-12T02:32:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- 172.21.15.1:0/1649417000 shutdown_connections 2024-09-12T02:32:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692e4b40 0x5650692ea910 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692ee370 0x5650693022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 --2- 172.21.15.1:0/1649417000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e35d0 0x5650692edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- 172.21.15.1:0/1649417000 >> 172.21.15.1:0/1649417000 conn(0x5650692ac310 msgr2=0x565069301bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- 172.21.15.1:0/1649417000 shutdown_connections 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- 172.21.15.1:0/1649417000 wait complete. 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.204+0000 7f36a28c8740 1 -- start start 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 Processor -- start 2024-09-12T02:32:54.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692fa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36981ac930 con 0x5650692ee370 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36981ac260 con 0x5650692e4b40 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36981a94a0 con 0x5650692e35d0 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f36a28c8740 10 client.0 _ll_register_callbacks cb 0x7f3688009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f369ea8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692fa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47466/0 (socket says 172.21.15.1:47466) 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f369ea8c640 1 -- 172.21.15.1:0/483523743 learned_addr learned my addr 172.21.15.1:0/483523743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.205+0000 7f369da8a640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692fa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369ea8c640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 -- 172.21.15.1:0/483523743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 msgr2=0x5650692f9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692f9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 -- 172.21.15.1:0/483523743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 msgr2=0x5650692fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 -- 172.21.15.1:0/483523743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506936fbf0 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f369da8a640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692fa280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5650692db260 tx=0x7f368800ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf58023b58ce885 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f3681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688004c60 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3688004e00 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.206+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f368800fd50 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3688035070 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 10 client.25490 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565069370ef0 con 0x5650692e4b40 2024-09-12T02:32:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f368800fd50 con 0x5650692e4b40 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3688025030 con 0x5650692e4b40 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 10 client.25490 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 10 client.25490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 20 client.25490 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069373540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 4 client.25490 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.207+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565069250d70 con 0x565069306bd0 2024-09-12T02:32:54.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.208+0000 7f369ea8c640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069373540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f3681ffb640 10 client.25490 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f369ea8c640 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069373540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e86f6ed237702a server_cookie=922f70158813c835 in_seq=0 out_seq=0 2024-09-12T02:32:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f3681ffb640 1 -- 172.21.15.1:0/483523743 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565069250d70 con 0x565069306bd0 2024-09-12T02:32:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f3681ffb640 10 client.25490 handle_command_reply: tid=0 2024-09-12T02:32:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 client.25490 shutdown 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 msgr2=0x5650692fa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692fa280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5650692db260 tx=0x7f368800ff90 comp rx=0 tx=0).stop 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 shutdown_connections 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5650692ee370 0x5650692fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x565069306bd0 0x565069373540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5650692e4b40 0x5650692fa280 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f3681ffb640 0 client.25490 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 --2- 172.21.15.1:0/483523743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5650692e35d0 0x5650692f9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.209+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 >> 172.21.15.1:0/483523743 conn(0x5650692ac310 msgr2=0x5650692de500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.210+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 shutdown_connections 2024-09-12T02:32:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.210+0000 7f36a28c8740 1 -- 172.21.15.1:0/483523743 wait complete. 2024-09-12T02:32:54.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.210+0000 7f36a28c8740 20 client.25490 trim_cache size 0 max 16384 2024-09-12T02:32:54.214 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:32:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.211+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 msgr2=0x7f36840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 0x7f36840a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36940b8bc0 tx=0x7f36940f1040 comp rx=0 tx=0).stop 2024-09-12T02:32:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 msgr2=0x7f36981a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 0x7f36981a0460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f369402a940 tx=0x7f3694003b20 comp rx=0 tx=0).stop 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 shutdown_connections 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.212+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3698103740 0x7f36981a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.213+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3698108290 0x7f369819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.213+0000 7f36a04ef640 1 --2- 172.21.15.1:0/1131646932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3698102d90 0x7f36981a0460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.213+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 >> 172.21.15.1:0/1131646932 conn(0x7f36980fc7d0 msgr2=0x7f3698100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.213+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 shutdown_connections 2024-09-12T02:32:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:54.213+0000 7f36a04ef640 1 -- 172.21.15.1:0/1131646932 wait complete. 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/3510283279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 msgr2=0x7fd2e410a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/3510283279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e410a030 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009900 tx=0x7fd2dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/3510283279 shutdown_connections 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/3510283279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e410a030 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/3510283279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e4102de0 0x7fd2e4103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/3510283279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e40ffe10 0x7fd2e4100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/3510283279 >> 172.21.15.1:0/3510283279 conn(0x7fd2e40fb930 msgr2=0x7fd2e40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.833+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/3510283279 shutdown_connections 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/3510283279 wait complete. 2024-09-12T02:32:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 Processor -- start 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 -- start start 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e40ffe10 0x7fd2e4102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 0x7fd2e4100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e410d7c0 con 0x7fd2e41037a0 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e410d640 con 0x7fd2e4102de0 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.834+0000 7fd2eb9b7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e410d940 con 0x7fd2e40ffe10 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e9f54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e9f54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47488/0 (socket says 172.21.15.1:47488) 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 0x7fd2e4100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e9f54640 1 -- 172.21.15.1:0/2152232661 learned_addr learned my addr 172.21.15.1:0/2152232661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e9753640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e40ffe10 0x7fd2e4102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 -- 172.21.15.1:0/2152232661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e40ffe10 msgr2=0x7fd2e4102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e40ffe10 0x7fd2e4102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 -- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 msgr2=0x7fd2e41012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 -- 172.21.15.1:0/2152232661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e4101b60 con 0x7fd2e4102de0 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 0x7fd2e4100d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800d6d0 tx=0x7fd2d800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2d67fc640 1 -- 172.21.15.1:0/2152232661 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8017070 con 0x7fd2e4102de0 2024-09-12T02:32:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.835+0000 7fd2d67fc640 1 -- 172.21.15.1:0/2152232661 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2d8009820 con 0x7fd2e4102de0 2024-09-12T02:32:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.836+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e41a1ea0 con 0x7fd2e4102de0 2024-09-12T02:32:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.836+0000 7fd2d67fc640 1 -- 172.21.15.1:0/2152232661 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8004d00 con 0x7fd2e4102de0 2024-09-12T02:32:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.836+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e41a2300 con 0x7fd2e4102de0 2024-09-12T02:32:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.838+0000 7fd2d67fc640 1 -- 172.21.15.1:0/2152232661 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd2d80099d0 con 0x7fd2e4102de0 2024-09-12T02:32:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.838+0000 7fd2ee82c740 1 Processor -- start 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.838+0000 7fd2ee82c740 1 -- start start 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b18da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b20830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561571a7c2f0 con 0x561571b192e0 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561571a24270 con 0x561571b1e370 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561571a782b0 con 0x561571b189a0 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2d67fc640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 0x7fd2d00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47502/0 (socket says 172.21.15.1:47502) 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 -- 172.21.15.1:0/2672211925 learned_addr learned my addr 172.21.15.1:0/2672211925 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b20830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 0x7fd2d00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2d67fc640 1 -- 172.21.15.1:0/2152232661 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd2d80ceb10 con 0x7fd2e4102de0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b18da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 -- 172.21.15.1:0/2672211925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 msgr2=0x561571b18da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b18da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 -- 172.21.15.1:0/2672211925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 msgr2=0x561571b20830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b20830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 -- 172.21.15.1:0/2672211925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561571a23340 con 0x561571b192e0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.839+0000 7fd2e9753640 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011470 tx=0x7fd2e0011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af956ff5397f7d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 0x7fd2d00a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc031440 tx=0x7fd2dc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2cf7fe640 1 -- 172.21.15.1:0/2672211925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0003970 con 0x561571b192e0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2cf7fe640 1 -- 172.21.15.1:0/2672211925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e0004020 con 0x561571b192e0 2024-09-12T02:32:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2cf7fe640 1 -- 172.21.15.1:0/2672211925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000f9c0 con 0x561571b192e0 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 -- 172.21.15.1:0/2672211925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 msgr2=0x561571b1dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011470 tx=0x7fd2e0011930 comp rx=0 tx=0).stop 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 -- 172.21.15.1:0/2672211925 shutdown_connections 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b192e0 0x561571b1dda0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b20830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/2672211925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b18da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 -- 172.21.15.1:0/2672211925 >> 172.21.15.1:0/2672211925 conn(0x561571b14010 msgr2=0x561571b14410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.840+0000 7fd2ee82c740 1 -- 172.21.15.1:0/2672211925 shutdown_connections 2024-09-12T02:32:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 -- 172.21.15.1:0/2672211925 wait complete. 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 -- start start 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 Processor -- start 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b22b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b192e0 0x561571b23080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561571b21340 con 0x561571b1e370 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561571a05290 con 0x561571b192e0 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561571b214c0 con 0x561571b189a0 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2ee82c740 10 client.0 _ll_register_callbacks cb 0x561571a36140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.841+0000 7fd2e9f54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47518/0 (socket says 172.21.15.1:47518) 2024-09-12T02:32:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 -- 172.21.15.1:0/3143493053 learned_addr learned my addr 172.21.15.1:0/3143493053 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b22b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b192e0 0x561571b23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 -- 172.21.15.1:0/3143493053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 msgr2=0x561571b22b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b22b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 -- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b192e0 msgr2=0x561571b23080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b192e0 0x561571b23080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 -- 172.21.15.1:0/3143493053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56157178f210 con 0x561571b1e370 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0042f0 tx=0x7fd2dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9cae5ffe873d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc050070 con 0x561571b1e370 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd2dc003ac0 con 0x561571b1e370 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e0004020 con 0x561571b1e370 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.842+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2dc05c050 con 0x561571b1e370 2024-09-12T02:32:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56157185b620 con 0x561571b1e370 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e0004020 con 0x561571b1e370 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2dc03d450 con 0x561571b1e370 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 20 client.16023 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b2e7d0 0x561571b30bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 4 client.16023 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561571a89a20 con 0x561571b2e7d0 2024-09-12T02:32:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.843+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b2e7d0 0x561571b30bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.844+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b2e7d0 0x561571b30bc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0619c1d6f1e01bc server_cookie=8be3c6f87eab085e in_seq=0 out_seq=0 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.844+0000 7fd2ccff9640 10 client.16023 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.844+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3143493053 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561571a89a20 con 0x561571b2e7d0 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.844+0000 7fd2ccff9640 10 client.16023 handle_command_reply: tid=0 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 client.16023 shutdown 2024-09-12T02:32:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 msgr2=0x561571b2a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0042f0 tx=0x7fd2dc009260 comp rx=0 tx=0).stop 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 shutdown_connections 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b1e370 0x561571b2a0c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b2e7d0 0x561571b30bc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b192e0 0x561571b23080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3143493053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b189a0 0x561571b22b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ccff9640 0 client.16023 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 >> 172.21.15.1:0/3143493053 conn(0x561571b14010 msgr2=0x561571b15820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 shutdown_connections 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3143493053 wait complete. 2024-09-12T02:32:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.845+0000 7fd2ee82c740 20 client.16023 trim_cache size 0 max 16384 2024-09-12T02:32:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 Processor -- start 2024-09-12T02:32:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 -- start start 2024-09-12T02:32:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b2a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41ab210 con 0x561571b189a0 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41acd50 con 0x561571b1e370 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41ab8e0 con 0x561571b192e0 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47524/0 (socket says 172.21.15.1:47524) 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 -- 172.21.15.1:0/3952822488 learned_addr learned my addr 172.21.15.1:0/3952822488 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b2a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 -- 172.21.15.1:0/3952822488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 msgr2=0x561571b2a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b2a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 -- 172.21.15.1:0/3952822488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 msgr2=0x561571b354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9753640 1 -- 172.21.15.1:0/3952822488 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561571b30f30 con 0x561571b189a0 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.860+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.861+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004350 tx=0x7fd2e0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd4dc02601fb22f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.861+0000 7fd2ceffd640 1 -- 172.21.15.1:0/3952822488 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0033070 con 0x561571b189a0 2024-09-12T02:32:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.861+0000 7fd2ceffd640 1 -- 172.21.15.1:0/3952822488 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e0003970 con 0x561571b189a0 2024-09-12T02:32:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.861+0000 7fd2ceffd640 1 -- 172.21.15.1:0/3952822488 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00047c0 con 0x561571b189a0 2024-09-12T02:32:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3952822488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 msgr2=0x561571b130b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004350 tx=0x7fd2e0004610 comp rx=0 tx=0).stop 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3952822488 shutdown_connections 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b2a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3952822488 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b130b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3952822488 >> 172.21.15.1:0/3952822488 conn(0x561571b14010 msgr2=0x561571b129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3952822488 shutdown_connections 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3952822488 wait complete. 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 -- start start 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.862+0000 7fd2ee82c740 1 Processor -- start 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b27d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b28d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41ac680 con 0x561571b189a0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41abfb0 con 0x561571b1e370 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e41a91f0 con 0x561571b192e0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ee82c740 10 client.0 _ll_register_callbacks cb 0x7fd2dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47534/0 (socket says 172.21.15.1:47534) 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 -- 172.21.15.1:0/3393389861 learned_addr learned my addr 172.21.15.1:0/3393389861 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b27d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b28d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 -- 172.21.15.1:0/3393389861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 msgr2=0x561571b27d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b27d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 -- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 msgr2=0x561571b28d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b28d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 -- 172.21.15.1:0/3393389861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561571b29320 con 0x561571b189a0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9f54640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b28d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b27d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2e9753640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004fd0 tx=0x7fd2e0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f94e8cd94645ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.863+0000 7fd2ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0033070 con 0x561571b189a0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd2e002b040 con 0x561571b189a0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e0003970 con 0x561571b189a0 2024-09-12T02:32:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2e00047c0 con 0x561571b189a0 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 10 client.16029 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561571b994a0 con 0x561571b189a0 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e0003970 con 0x561571b189a0 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2e000f600 con 0x561571b189a0 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 20 client.16029 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b99c60 0x561571b9c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 4 client.16029 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.864+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561571a83d70 con 0x561571b99c60 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.865+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b99c60 0x561571b9c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.865+0000 7fd2ccff9640 10 client.16029 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.865+0000 7fd2e8f52640 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b99c60 0x561571b9c080 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83bd8c43939368b0 server_cookie=edac8766fd2c9eb4 in_seq=0 out_seq=0 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ccff9640 1 -- 172.21.15.1:0/3393389861 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561571a83d70 con 0x561571b99c60 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ccff9640 10 client.16029 handle_command_reply: tid=0 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 client.16029 shutdown 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 msgr2=0x561571b27810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004fd0 tx=0x7fd2e0009f60 comp rx=0 tx=0).stop 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 shutdown_connections 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x561571b99c60 0x561571b9c080 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561571b1e370 0x561571b28d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561571b192e0 0x561571b27d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ccff9640 0 client.16029 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 --2- 172.21.15.1:0/3393389861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561571b189a0 0x561571b27810 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 >> 172.21.15.1:0/3393389861 conn(0x561571b14010 msgr2=0x561571b129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 shutdown_connections 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 1 -- 172.21.15.1:0/3393389861 wait complete. 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.876+0000 7fd2ee82c740 20 client.16029 trim_cache size 0 max 16384 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:32:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:32:54.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 msgr2=0x7fd2d00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 0x7fd2d00a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc031440 tx=0x7fd2dc009560 comp rx=0 tx=0).stop 2024-09-12T02:32:54.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 msgr2=0x7fd2e4100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:54.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 0x7fd2e4100d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800d6d0 tx=0x7fd2d800db90 comp rx=0 tx=0).stop 2024-09-12T02:32:54.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 shutdown_connections 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd2d00a2c30 0x7fd2d00a50f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2e41037a0 0x7fd2e41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2e4102de0 0x7fd2e4100d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 --2- 172.21.15.1:0/2152232661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2e40ffe10 0x7fd2e4102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 >> 172.21.15.1:0/2152232661 conn(0x7fd2e40fb930 msgr2=0x7fd2e41060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 shutdown_connections 2024-09-12T02:32:54.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:32:54.877+0000 7fd2eb9b7640 1 -- 172.21.15.1:0/2152232661 wait complete. 2024-09-12T02:32:54.930 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 -- 172.21.15.1:0/886116217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102ef0 msgr2=0x7f03a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/886116217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102ef0 0x7f03a010da40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0388009900 tx=0x7f038802a480 comp rx=0 tx=0).stop 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 -- 172.21.15.1:0/886116217 shutdown_connections 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/886116217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102ef0 0x7f03a010da40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/886116217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0102570 0x7f03a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/886116217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0100e20 0x7f03a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.418+0000 7f03a6d8b640 1 -- 172.21.15.1:0/886116217 >> 172.21.15.1:0/886116217 conn(0x7f03a00fc7d0 msgr2=0x7f03a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 -- 172.21.15.1:0/886116217 shutdown_connections 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 -- 172.21.15.1:0/886116217 wait complete. 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 Processor -- start 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 -- start start 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 0x7f03a01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.419+0000 7f03a6d8b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0102ef0 0x7f03a019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a6d8b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0110f80 con 0x7f03a0102570 2024-09-12T02:32:55.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a6d8b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0110e00 con 0x7f03a0100e20 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a6d8b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0111100 con 0x7f03a0102ef0 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47552/0 (socket says 172.21.15.1:47552) 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 -- 172.21.15.1:0/150440835 learned_addr learned my addr 172.21.15.1:0/150440835 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a4b27640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 0x7f03a01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a5328640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0102ef0 0x7f03a019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 -- 172.21.15.1:0/150440835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0102ef0 msgr2=0x7f03a019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0102ef0 0x7f03a019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 -- 172.21.15.1:0/150440835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 msgr2=0x7f03a01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 0x7f03a01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 -- 172.21.15.1:0/150440835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a019d490 con 0x7f03a0102570 2024-09-12T02:32:55.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f03a4b27640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 0x7f03a01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:55.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039ffff640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f039000eab0 tx=0x7f039000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.420+0000 7f039dffb640 1 -- 172.21.15.1:0/150440835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039000ce40 con 0x7f03a0102570 2024-09-12T02:32:55.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.421+0000 7f039dffb640 1 -- 172.21.15.1:0/150440835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0390011950 con 0x7f03a0102570 2024-09-12T02:32:55.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.421+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a019d780 con 0x7f03a0102570 2024-09-12T02:32:55.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.421+0000 7f039dffb640 1 -- 172.21.15.1:0/150440835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390010ae0 con 0x7f03a0102570 2024-09-12T02:32:55.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.421+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a01a5060 con 0x7f03a0102570 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.423+0000 7f039dffb640 1 -- 172.21.15.1:0/150440835 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0390011b00 con 0x7f03a0102570 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 Processor -- start 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 -- start start 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f039dffb640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 0x7f038c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed109140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fbed05d2a0 con 0x55fbed0fbb70 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbed004b10 con 0x55fbed106d50 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f03a9164740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbed059260 con 0x55fbed0fc490 2024-09-12T02:32:55.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.424+0000 7f039dffb640 1 -- 172.21.15.1:0/150440835 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f03900cf670 con 0x7f03a0102570 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47568/0 (socket says 172.21.15.1:47568) 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 -- 172.21.15.1:0/673138342 learned_addr learned my addr 172.21.15.1:0/673138342 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a5328640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 0x7f038c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f039ffff640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 -- 172.21.15.1:0/673138342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 msgr2=0x55fbed106810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed106810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a5328640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 -- 172.21.15.1:0/673138342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 msgr2=0x55fbed109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 -- 172.21.15.1:0/673138342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbecdceb90 con 0x55fbed0fbb70 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f039ffff640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:55.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a5328640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a4b27640 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f03980104d0 tx=0x7f0398010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593d618b34a9f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.425+0000 7f03a5328640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 0x7f038c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0388006010 tx=0x7f0388004260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f0396ffd640 1 -- 172.21.15.1:0/673138342 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398011760 con 0x55fbed0fbb70 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f0396ffd640 1 -- 172.21.15.1:0/673138342 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0398011de0 con 0x55fbed0fbb70 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f0396ffd640 1 -- 172.21.15.1:0/673138342 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039801ce60 con 0x55fbed0fbb70 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 -- 172.21.15.1:0/673138342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 msgr2=0x55fbed0fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f03980104d0 tx=0x7f0398010990 comp rx=0 tx=0).stop 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 -- 172.21.15.1:0/673138342 shutdown_connections 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 --2- 172.21.15.1:0/673138342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0fbf50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.426+0000 7f03a9164740 1 -- 172.21.15.1:0/673138342 >> 172.21.15.1:0/673138342 conn(0x55fbed0f8100 msgr2=0x55fbed0f84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 -- 172.21.15.1:0/673138342 shutdown_connections 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 -- 172.21.15.1:0/673138342 wait complete. 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 -- start start 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 Processor -- start 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.427+0000 7f03a9164740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed104100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a9164740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed104640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a9164740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fbed109920 con 0x55fbed106d50 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a5328640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed104640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a5328640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed104640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47580/0 (socket says 172.21.15.1:47580) 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed104100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a5328640 1 -- 172.21.15.1:0/147409354 learned_addr learned my addr 172.21.15.1:0/147409354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbecfe56e0 con 0x55fbed0fbb70 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbed109aa0 con 0x55fbed0fc490 2024-09-12T02:32:55.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a9164740 10 client.0 _ll_register_callbacks cb 0x55fbed009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f03a4b27640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 -- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 msgr2=0x55fbed103bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed103bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 -- 172.21.15.1:0/147409354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 msgr2=0x55fbed104640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed104640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbed112d90 con 0x55fbed0fc490 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f039ffff640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed104100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f039009bde0 tx=0x7f039009c610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822732202dfd2e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.428+0000 7f037ffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039009c2b0 con 0x55fbed0fc490 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0398011de0 con 0x55fbed0fc490 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f03900a4630 con 0x55fbed0fc490 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0390081050 con 0x55fbed0fc490 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 10 client.25489 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:55.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbed115740 con 0x55fbed0fc490 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0398011de0 con 0x55fbed0fc490 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f039000f040 con 0x55fbed0fc490 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 10 client.25489 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 10 client.25489 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 20 client.25489 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed116b50 0x55fbed118f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 4 client.25489 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.429+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbed06a9d0 con 0x55fbed116b50 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.430+0000 7f03a4b27640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed116b50 0x55fbed118f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.430+0000 7f037ffff640 10 client.25489 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.430+0000 7f03a4b27640 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed116b50 0x55fbed118f60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e1ea46da3270c2 server_cookie=d461a420db39bee1 in_seq=0 out_seq=0 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f037ffff640 1 -- 172.21.15.1:0/147409354 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbed06a9d0 con 0x55fbed116b50 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f037ffff640 10 client.25489 handle_command_reply: tid=0 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 client.25489 shutdown 2024-09-12T02:32:55.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 msgr2=0x55fbed104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed104100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f039009bde0 tx=0x7f039009c610 comp rx=0 tx=0).stop 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 shutdown_connections 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed116b50 0x55fbed118f60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed104100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 --2- 172.21.15.1:0/147409354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f037ffff640 0 client.25489 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 >> 172.21.15.1:0/147409354 conn(0x55fbed0f8100 msgr2=0x55fbed0f2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 shutdown_connections 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 1 -- 172.21.15.1:0/147409354 wait complete. 2024-09-12T02:32:55.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.431+0000 7f03a9164740 20 client.25489 trim_cache size 0 max 16384 2024-09-12T02:32:55.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 Processor -- start 2024-09-12T02:32:55.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 -- start start 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed11e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01ab430 con 0x55fbed0fbb70 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01acf70 con 0x55fbed106d50 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a9164740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01abb00 con 0x55fbed0fc490 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a4b27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a4b27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47590/0 (socket says 172.21.15.1:47590) 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.449+0000 7f03a4b27640 1 -- 172.21.15.1:0/3962659664 learned_addr learned my addr 172.21.15.1:0/3962659664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 -- 172.21.15.1:0/3962659664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 msgr2=0x55fbed11e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 -- 172.21.15.1:0/3962659664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 msgr2=0x55fbed11ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 -- 172.21.15.1:0/3962659664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbed0f7f30 con 0x55fbed0fbb70 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03a4b27640 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f039800be90 tx=0x7f039801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6bfb874ef08da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03967fc640 1 -- 172.21.15.1:0/3962659664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039802e030 con 0x55fbed0fbb70 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03967fc640 1 -- 172.21.15.1:0/3962659664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0398004020 con 0x55fbed0fbb70 2024-09-12T02:32:55.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.450+0000 7f03967fc640 1 -- 172.21.15.1:0/3962659664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03980053a0 con 0x55fbed0fbb70 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- 172.21.15.1:0/3962659664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 msgr2=0x55fbed0f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f039800be90 tx=0x7f039801ca60 comp rx=0 tx=0).stop 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- 172.21.15.1:0/3962659664 shutdown_connections 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed106d50 0x55fbed11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed11e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 --2- 172.21.15.1:0/3962659664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed0fbb70 0x55fbed0f2d60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- 172.21.15.1:0/3962659664 >> 172.21.15.1:0/3962659664 conn(0x55fbed0f8100 msgr2=0x55fbed0f2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- 172.21.15.1:0/3962659664 shutdown_connections 2024-09-12T02:32:55.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- 172.21.15.1:0/3962659664 wait complete. 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 -- start start 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.451+0000 7f03a9164740 1 Processor -- start 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed10f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed10bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01ac8a0 con 0x55fbed106d50 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01ac1d0 con 0x55fbed0fbb70 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01a9410 con 0x55fbed0fc490 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a9164740 10 client.0 _ll_register_callbacks cb 0x7f039009b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a5328640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a5328640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47604/0 (socket says 172.21.15.1:47604) 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a5328640 1 -- 172.21.15.1:0/308294518 learned_addr learned my addr 172.21.15.1:0/308294518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:55.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f039ffff640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed10bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.452+0000 7f03a4b27640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed10f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 -- 172.21.15.1:0/308294518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 msgr2=0x55fbed10bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed10bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 -- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 msgr2=0x55fbed10f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed10f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 -- 172.21.15.1:0/308294518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbed0f8d90 con 0x55fbed106d50 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a4b27640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a5328640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0388009230 tx=0x7f0388009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e444dd0b391d8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f037ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038804f070 con 0x55fbed106d50 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0388005220 con 0x55fbed106d50 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0398004020 con 0x55fbed106d50 2024-09-12T02:32:55.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f038805a050 con 0x55fbed106d50 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a9164740 10 client.16047 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.453+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbed182570 con 0x55fbed106d50 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0398004020 con 0x55fbed106d50 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0388031540 con 0x55fbed106d50 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 10 client.16047 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 20 client.16047 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed182d60 0x55fbed185180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 4 client.16047 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x55fbed064d20 con 0x55fbed182d60 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.454+0000 7f03a4b27640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed182d60 0x55fbed185180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.455+0000 7f037ffff640 10 client.16047 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:55.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.455+0000 7f03a4b27640 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed182d60 0x55fbed185180 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edcef0c5a30d003 server_cookie=18b1a9b70d340ee1 in_seq=0 out_seq=0 2024-09-12T02:32:55.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f037ffff640 1 -- 172.21.15.1:0/308294518 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55fbed064d20 con 0x55fbed182d60 2024-09-12T02:32:55.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f037ffff640 10 client.16047 handle_command_reply: tid=0 2024-09-12T02:32:55.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 client.16047 shutdown 2024-09-12T02:32:55.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 msgr2=0x55fbed10c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0388009230 tx=0x7f0388009260 comp rx=0 tx=0).stop 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 shutdown_connections 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbed106d50 0x55fbed10c200 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55fbed182d60 0x55fbed185180 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbed0fc490 0x55fbed10bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f037ffff640 0 client.16047 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 --2- 172.21.15.1:0/308294518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbed0fbb70 0x55fbed10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.467+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 >> 172.21.15.1:0/308294518 conn(0x55fbed0f8100 msgr2=0x55fbed0f2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.468+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 shutdown_connections 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.468+0000 7f03a9164740 1 -- 172.21.15.1:0/308294518 wait complete. 2024-09-12T02:32:55.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.468+0000 7f03a9164740 20 client.16047 trim_cache size 0 max 16384 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24494, 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 6, 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "4e6740dc": { 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 6, 2024-09-12T02:32:55.470 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 133.4, 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:32:55.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:32:55.472 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 msgr2=0x7f038c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 0x7f038c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0388006010 tx=0x7f0388004260 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 msgr2=0x7f03a0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f039000eab0 tx=0x7f039000ef70 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 shutdown_connections 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f038c0a2b80 0x7f038c0a5040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03a0102570 0x7f03a0198a20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03a0102ef0 0x7f03a019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 --2- 172.21.15.1:0/150440835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03a0100e20 0x7f03a01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 >> 172.21.15.1:0/150440835 conn(0x7f03a00fc7d0 msgr2=0x7f03a006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:55.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 shutdown_connections 2024-09-12T02:32:55.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:55.469+0000 7f03a6d8b640 1 -- 172.21.15.1:0/150440835 wait complete. 2024-09-12T02:32:55.940 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:32:55.940 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:32:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:55 smithi001 ceph-mon[31252]: pgmap v402: 97 pgs: 97 active+clean; 194 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-12T02:32:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:55 smithi134 ceph-mon[35091]: pgmap v402: 97 pgs: 97 active+clean; 194 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-12T02:32:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:55 smithi173 ceph-mon[35036]: pgmap v402: 97 pgs: 97 active+clean; 194 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-12T02:32:56.223 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4e6740dc', quiesce took 4.0 seconds. Will release after: 9.4 2024-09-12T02:32:56.281 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- 172.21.15.1:0/3566046941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 msgr2=0x7f097810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 --2- 172.21.15.1:0/3566046941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f097810d130 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f097000adb0 tx=0x7f097002b7a0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- 172.21.15.1:0/3566046941 shutdown_connections 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 --2- 172.21.15.1:0/3566046941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f097810d130 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 --2- 172.21.15.1:0/3566046941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100e30 0x7f0978104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 --2- 172.21.15.1:0/3566046941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100480 0x7f0978100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- 172.21.15.1:0/3566046941 >> 172.21.15.1:0/3566046941 conn(0x7f0978077210 msgr2=0x7f09780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- 172.21.15.1:0/3566046941 shutdown_connections 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- 172.21.15.1:0/3566046941 wait complete. 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 Processor -- start 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.794+0000 7f097fa49640 1 -- start start 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100480 0x7f09780fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100e30 0x7f09780fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f097810fd90 con 0x7f09781055b0 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f097810fc10 con 0x7f0978100480 2024-09-12T02:32:56.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097fa49640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f097810ff10 con 0x7f0978100e30 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47636/0 (socket says 172.21.15.1:47636) 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 -- 172.21.15.1:0/1036886320 learned_addr learned my addr 172.21.15.1:0/1036886320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097cfe4640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100e30 0x7f09780fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097d7e5640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100480 0x7f09780fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 -- 172.21.15.1:0/1036886320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100e30 msgr2=0x7f09780fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100e30 0x7f09780fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 -- 172.21.15.1:0/1036886320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100480 msgr2=0x7f09780fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100480 0x7f09780fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 -- 172.21.15.1:0/1036886320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09781a6a90 con 0x7f09781055b0 2024-09-12T02:32:56.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f097dfe6640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0970005cc0 tx=0x7f0970003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.795+0000 7f096e7fc640 1 -- 172.21.15.1:0/1036886320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970040070 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.796+0000 7f096e7fc640 1 -- 172.21.15.1:0/1036886320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09700309f0 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.796+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09781a6d20 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.796+0000 7f096e7fc640 1 -- 172.21.15.1:0/1036886320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970004600 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.796+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09781a7250 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.798+0000 7f096e7fc640 1 -- 172.21.15.1:0/1036886320 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f09700328a0 con 0x7f09781055b0 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.798+0000 7f0981e22740 1 Processor -- start 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 -- start start 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840990af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990b480 0x558409915800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558409870280 con 0x558409915d40 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558409817b10 con 0x55840990b480 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f0981e22740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55840986c240 con 0x55840990ab60 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f096e7fc640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 0x7f09640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47650/0 (socket says 172.21.15.1:47650) 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 -- 172.21.15.1:0/866065903 learned_addr learned my addr 172.21.15.1:0/866065903 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097d7e5640 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990b480 0x558409915800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840990af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097dfe6640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 0x7f09640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f096e7fc640 1 -- 172.21.15.1:0/1036886320 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f09700f03c0 con 0x7f09781055b0 2024-09-12T02:32:56.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 -- 172.21.15.1:0/866065903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 msgr2=0x55840990af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840990af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 -- 172.21.15.1:0/866065903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990b480 msgr2=0x558409915800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990b480 0x558409915800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.799+0000 7f097cfe4640 1 -- 172.21.15.1:0/866065903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584098241f0 con 0x558409915d40 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.800+0000 7f097cfe4640 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09680126a0 tx=0x7f096800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365bcffeb1fa57c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.800+0000 7f09637fe640 1 -- 172.21.15.1:0/866065903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968004020 con 0x558409915d40 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.800+0000 7f09637fe640 1 -- 172.21.15.1:0/866065903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09680041c0 con 0x558409915d40 2024-09-12T02:32:56.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.800+0000 7f09637fe640 1 -- 172.21.15.1:0/866065903 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096801f790 con 0x558409915d40 2024-09-12T02:32:56.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- 172.21.15.1:0/866065903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 msgr2=0x558409918130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f097dfe6640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 0x7f09640a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09700bc8a0 tx=0x7f0970049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09680126a0 tx=0x7f096800b650 comp rx=0 tx=0).stop 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- 172.21.15.1:0/866065903 shutdown_connections 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x558409918130 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990b480 0x558409915800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 --2- 172.21.15.1:0/866065903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840990af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- 172.21.15.1:0/866065903 >> 172.21.15.1:0/866065903 conn(0x5584099070f0 msgr2=0x5584099074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- 172.21.15.1:0/866065903 shutdown_connections 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- 172.21.15.1:0/866065903 wait complete. 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 -- start start 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.801+0000 7f0981e22740 1 Processor -- start 2024-09-12T02:32:56.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x558409912cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558409915d40 0x558409913730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558409918910 con 0x55840990b480 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55840982af10 con 0x55840990ab60 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558409918a90 con 0x558409915d40 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f0981e22740 10 client.0 _ll_register_callbacks cb 0x5584097f3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47652/0 (socket says 172.21.15.1:47652) 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 -- 172.21.15.1:0/1885489565 learned_addr learned my addr 172.21.15.1:0/1885489565 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097cfe4640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x558409912cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097cfe4640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558409915d40 0x558409913730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 -- 172.21.15.1:0/1885489565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558409915d40 msgr2=0x558409913730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558409915d40 0x558409913730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 -- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 msgr2=0x558409912cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x558409912cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.802+0000 7f097d7e5640 1 -- 172.21.15.1:0/1885489565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584095e16a0 con 0x55840990b480 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f097d7e5640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f09740127a0 tx=0x7f0974012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e3c9056db6a7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097401f060 con 0x55840990b480 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0974010ce0 con 0x55840990b480 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09680041c0 con 0x55840990b480 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f097401a430 con 0x55840990b480 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0981e22740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:56.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558409924610 con 0x55840990b480 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09680041c0 con 0x55840990b480 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f097400e5e0 con 0x55840990b480 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0981e22740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.803+0000 7f0981e22740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f0981e22740 20 client.16059 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409925ad0 0x558409927f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f0981e22740 4 client.16059 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55840987d7f0 con 0x558409925ad0 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f097cfe4640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409925ad0 0x558409927f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f097cfe4640 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409925ad0 0x558409927f20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa24661a4ec78d3a server_cookie=8175552a76816c79 in_seq=0 out_seq=0 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.804+0000 7f0960ff9640 10 client.16059 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:56.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0960ff9640 1 -- 172.21.15.1:0/1885489565 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55840987d7f0 con 0x558409925ad0 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0960ff9640 10 client.16059 handle_command_reply: tid=0 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 client.16059 shutdown 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 msgr2=0x5584099131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f09740127a0 tx=0x7f0974012c60 comp rx=0 tx=0).stop 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 shutdown_connections 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x5584099131f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409925ad0 0x558409927f20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558409915d40 0x558409913730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 --2- 172.21.15.1:0/1885489565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x558409912cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 >> 172.21.15.1:0/1885489565 conn(0x5584099070f0 msgr2=0x55840990cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0960ff9640 0 client.16059 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:56.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 shutdown_connections 2024-09-12T02:32:56.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.805+0000 7f0981e22740 1 -- 172.21.15.1:0/1885489565 wait complete. 2024-09-12T02:32:56.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.806+0000 7f0981e22740 20 client.16059 trim_cache size 0 max 16384 2024-09-12T02:32:56.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 Processor -- start 2024-09-12T02:32:56.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 -- start start 2024-09-12T02:32:56.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x55840992d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 0x55840992dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f09781af7f0 con 0x558409915d40 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09781b1330 con 0x55840990ab60 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f0981e22740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09781afec0 con 0x55840990b480 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47654/0 (socket says 172.21.15.1:47654) 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 -- 172.21.15.1:0/980863477 learned_addr learned my addr 172.21.15.1:0/980863477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x55840992d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097d7e5640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 0x55840992dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 -- 172.21.15.1:0/980863477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 msgr2=0x55840992dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 0x55840992dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 -- 172.21.15.1:0/980863477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 msgr2=0x55840992d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x55840992d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097cfe4640 1 -- 172.21.15.1:0/980863477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558409915580 con 0x558409915d40 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.825+0000 7f097d7e5640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 0x55840992dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f097cfe4640 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0968012670 tx=0x7f0968017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facb0a49e4f8aac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0962ffd640 1 -- 172.21.15.1:0/980863477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09680036b0 con 0x558409915d40 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0962ffd640 1 -- 172.21.15.1:0/980863477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0968016070 con 0x558409915d40 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0962ffd640 1 -- 172.21.15.1:0/980863477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096802f630 con 0x558409915d40 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 -- 172.21.15.1:0/980863477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 msgr2=0x55840990ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0968012670 tx=0x7f0968017040 comp rx=0 tx=0).stop 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 -- 172.21.15.1:0/980863477 shutdown_connections 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558409915d40 0x55840990ff90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990b480 0x55840992dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 --2- 172.21.15.1:0/980863477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55840990ab60 0x55840992d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 -- 172.21.15.1:0/980863477 >> 172.21.15.1:0/980863477 conn(0x5584099070f0 msgr2=0x558409914c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.826+0000 7f0981e22740 1 -- 172.21.15.1:0/980863477 shutdown_connections 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 -- 172.21.15.1:0/980863477 wait complete. 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 -- start start 2024-09-12T02:32:56.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 Processor -- start 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840991e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558409915d40 0x55840991b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f09781b0c60 con 0x55840990b480 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09781b0590 con 0x558409915d40 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.827+0000 7f0981e22740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09781ad7d0 con 0x55840990ab60 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f0981e22740 10 client.0 _ll_register_callbacks cb 0x7f097400a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47658/0 (socket says 172.21.15.1:47658) 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 -- 172.21.15.1:0/25495669 learned_addr learned my addr 172.21.15.1:0/25495669 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097cfe4640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558409915d40 0x55840991b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097cfe4640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840991e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 -- 172.21.15.1:0/25495669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 msgr2=0x55840991e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840991e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 -- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558409915d40 msgr2=0x55840991b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558409915d40 0x55840991b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 -- 172.21.15.1:0/25495669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840991b8c0 con 0x55840990b480 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097cfe4640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840991e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f097d7e5640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0974015040 tx=0x7f097400a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13505a8bb39025ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f0960ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097400e7c0 con 0x55840990b480 2024-09-12T02:32:56.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0974012020 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.828+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0968016070 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0974012220 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 10 client.16065 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558409991650 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0968016070 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0974011440 con 0x55840990b480 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 10 client.16065 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 20 client.16065 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409991dd0 0x5584099941f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 4 client.16065 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558409877d00 con 0x558409991dd0 2024-09-12T02:32:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.829+0000 7f097cfe4640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409991dd0 0x5584099941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.830+0000 7f097cfe4640 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409991dd0 0x5584099941f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2e99863e0b0299 server_cookie=67080a01e5739c82 in_seq=0 out_seq=0 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.830+0000 7f0960ff9640 10 client.16065 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0960ff9640 1 -- 172.21.15.1:0/25495669 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558409877d00 con 0x558409991dd0 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0960ff9640 10 client.16065 handle_command_reply: tid=0 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 client.16065 shutdown 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 msgr2=0x55840991ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0974015040 tx=0x7f097400a4c0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 shutdown_connections 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55840990b480 0x55840991ace0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558409991dd0 0x5584099941f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558409915d40 0x55840991b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 --2- 172.21.15.1:0/25495669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55840990ab60 0x55840991e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0960ff9640 0 client.16065 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:56.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 >> 172.21.15.1:0/25495669 conn(0x5584099070f0 msgr2=0x55840990c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 shutdown_connections 2024-09-12T02:32:56.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 1 -- 172.21.15.1:0/25495669 wait complete. 2024-09-12T02:32:56.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.831+0000 7f0981e22740 20 client.16065 trim_cache size 0 max 16384 2024-09-12T02:32:56.840 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-12T02:32:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "570e4a5a-041f-4bb4-bf7b-8986c0b81ccb", 2024-09-12T02:32:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-12T02:32:56.840 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 msgr2=0x7f09640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 0x7f09640a50c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f09700bc8a0 tx=0x7f0970049000 comp rx=0 tx=0).stop 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 msgr2=0x7f09780fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0970005cc0 tx=0x7f0970003f90 comp rx=0 tx=0).stop 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 shutdown_connections 2024-09-12T02:32:56.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f09640a2c00 0x7f09640a50c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f09781055b0 0x7f09780fd110 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0978100e30 0x7f09780fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 --2- 172.21.15.1:0/1036886320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0978100480 0x7f09780fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 >> 172.21.15.1:0/1036886320 conn(0x7f0978077210 msgr2=0x7f09780fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 shutdown_connections 2024-09-12T02:32:56.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:56.832+0000 7f097fa49640 1 -- 172.21.15.1:0/1036886320 wait complete. 2024-09-12T02:32:57.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: scrub queued for path: / 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: scrub summary: active paths [/] 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:57.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:57 smithi001 ceph-mon[31252]: scrub summary: idle 2024-09-12T02:32:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: scrub queued for path: / 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: scrub summary: active paths [/] 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:57 smithi134 ceph-mon[35091]: scrub summary: idle 2024-09-12T02:32:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 24 op/s 2024-09-12T02:32:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: scrub queued for path: / 2024-09-12T02:32:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: scrub summary: active paths [/] 2024-09-12T02:32:58.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:32:58.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:57 smithi173 ceph-mon[35036]: scrub summary: idle 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 -- 172.21.15.1:0/245654624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8101df0 msgr2=0x7f57b81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/245654624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8101df0 0x7f57b81021d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009900 tx=0x7f57b402a410 comp rx=0 tx=0).stop 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 -- 172.21.15.1:0/245654624 shutdown_connections 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/245654624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b8106f20 0x7f57b810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/245654624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b81027a0 0x7f57b81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/245654624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8101df0 0x7f57b81021d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 -- 172.21.15.1:0/245654624 >> 172.21.15.1:0/245654624 conn(0x7f57b80fd8b0 msgr2=0x7f57b80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 -- 172.21.15.1:0/245654624 shutdown_connections 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.369+0000 7f57bf6ed640 1 -- 172.21.15.1:0/245654624 wait complete. 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 Processor -- start 2024-09-12T02:32:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 -- start start 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b8101df0 0x7f57b80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b81027a0 0x7f57b8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111f80 con 0x7f57b8106f20 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111e00 con 0x7f57b8101df0 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bf6ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8112100 con 0x7f57b81027a0 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bdc8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bdc8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47674/0 (socket says 172.21.15.1:47674) 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.370+0000 7f57bdc8a640 1 -- 172.21.15.1:0/3779928822 learned_addr learned my addr 172.21.15.1:0/3779928822 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bd489640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b8101df0 0x7f57b80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bcc88640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b81027a0 0x7f57b8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 -- 172.21.15.1:0/3779928822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b81027a0 msgr2=0x7f57b8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b81027a0 0x7f57b8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 -- 172.21.15.1:0/3779928822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b8101df0 msgr2=0x7f57b80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b8101df0 0x7f57b80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 -- 172.21.15.1:0/3779928822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b81a6880 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bdc8a640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f57b000eaa0 tx=0x7f57b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57ae7fc640 1 -- 172.21.15.1:0/3779928822 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b000cdb0 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57ae7fc640 1 -- 172.21.15.1:0/3779928822 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57b0005020 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b81a6b70 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57ae7fc640 1 -- 172.21.15.1:0/3779928822 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b00116b0 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.371+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b81a7100 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57ae7fc640 1 -- 172.21.15.1:0/3779928822 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f57b0005560 con 0x7f57b8106f20 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 Processor -- start 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 -- start start 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf6ff2e0 con 0x55a0bf7994a0 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf6a6ce0 con 0x55a0bf7a4680 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.374+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf6fb2a0 con 0x55a0bf799dc0 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57ae7fc640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 0x7f57a40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47680/0 (socket says 172.21.15.1:47680) 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 -- 172.21.15.1:0/3157698378 learned_addr learned my addr 172.21.15.1:0/3157698378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bdc8a640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 0x7f57a40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bd489640 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57ae7fc640 1 -- 172.21.15.1:0/3779928822 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f57b00cf0f0 con 0x7f57b8106f20 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 -- 172.21.15.1:0/3157698378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 msgr2=0x55a0bf7a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 -- 172.21.15.1:0/3157698378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 msgr2=0x55a0bf7a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 -- 172.21.15.1:0/3157698378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0bf68b440 con 0x55a0bf7994a0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bd489640 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bcc88640 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f57a80058a0 tx=0x7f57a80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27350c17fa867274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57bdc8a640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 0x7f57a40a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f57b0097e40 tx=0x7f57b00c64c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57a37fe640 1 -- 172.21.15.1:0/3157698378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a801b470 con 0x55a0bf7994a0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57a37fe640 1 -- 172.21.15.1:0/3157698378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8016070 con 0x55a0bf7994a0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.375+0000 7f57a37fe640 1 -- 172.21.15.1:0/3157698378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a800f620 con 0x55a0bf7994a0 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- 172.21.15.1:0/3157698378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 msgr2=0x55a0bf799880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f57a80058a0 tx=0x7f57a80127c0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- 172.21.15.1:0/3157698378 shutdown_connections 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/3157698378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7994a0 0x55a0bf799880 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- 172.21.15.1:0/3157698378 >> 172.21.15.1:0/3157698378 conn(0x55a0bf795a30 msgr2=0x55a0bf795e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- 172.21.15.1:0/3157698378 shutdown_connections 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- 172.21.15.1:0/3157698378 wait complete. 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.376+0000 7f57c1ac6740 1 -- start start 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 Processor -- start 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf7a7250 con 0x55a0bf7a4680 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf6ba050 con 0x55a0bf799dc0 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a0bf7a73d0 con 0x55a0bf7994a0 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57c1ac6740 10 client.0 _ll_register_callbacks cb 0x55a0bf6fa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47682/0 (socket says 172.21.15.1:47682) 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 -- 172.21.15.1:0/78614770 learned_addr learned my addr 172.21.15.1:0/78614770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bd489640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 -- 172.21.15.1:0/78614770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 msgr2=0x55a0bf7a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 -- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf799dc0 msgr2=0x55a0bf7a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.377+0000 7f57bcc88640 1 -- 172.21.15.1:0/78614770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0bf4703c0 con 0x55a0bf7a4680 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57bcc88640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57a8010a60 tx=0x7f57a8010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea71a8bff0c04d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8024040 con 0x55a0bf7a4680 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f57a8004050 con 0x55a0bf7a4680 2024-09-12T02:32:58.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a8016070 con 0x55a0bf7a4680 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57a8030050 con 0x55a0bf7a4680 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0bf7b2b90 con 0x55a0bf7a4680 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8016070 con 0x55a0bf7a4680 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57a801b470 con 0x55a0bf7a4680 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 20 client.16077 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.378+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf7b3fa0 0x55a0bf7b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.379+0000 7f57c1ac6740 4 client.16077 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.379+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0bf70c850 con 0x55a0bf7b3fa0 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.379+0000 7f57bd489640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf7b3fa0 0x55a0bf7b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.379+0000 7f57a0ff9640 10 client.16077 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:58.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.379+0000 7f57bd489640 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf7b3fa0 0x55a0bf7b6390 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0051eab6061114 server_cookie=239ce3f313ffe512 in_seq=0 out_seq=0 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57a0ff9640 1 -- 172.21.15.1:0/78614770 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0bf70c850 con 0x55a0bf7b3fa0 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57a0ff9640 10 client.16077 handle_command_reply: tid=0 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 client.16077 shutdown 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 msgr2=0x55a0bf7a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57a8010a60 tx=0x7f57a8010d90 comp rx=0 tx=0).stop 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 shutdown_connections 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a1800 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf7b3fa0 0x55a0bf7b6390 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf799dc0 0x55a0bf7a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/78614770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57a0ff9640 0 client.16077 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 >> 172.21.15.1:0/78614770 conn(0x55a0bf795a30 msgr2=0x55a0bf79b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 shutdown_connections 2024-09-12T02:32:58.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.380+0000 7f57c1ac6740 1 -- 172.21.15.1:0/78614770 wait complete. 2024-09-12T02:32:58.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.381+0000 7f57c1ac6740 20 client.16077 trim_cache size 0 max 16384 2024-09-12T02:32:58.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.398+0000 7f57c1ac6740 1 Processor -- start 2024-09-12T02:32:58.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.398+0000 7f57c1ac6740 1 -- start start 2024-09-12T02:32:58.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.398+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.398+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81af8a0 con 0x55a0bf7a4680 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81b13e0 con 0x55a0bf7994a0 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81aff70 con 0x55a0bf799dc0 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47690/0 (socket says 172.21.15.1:47690) 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 -- 172.21.15.1:0/1845833301 learned_addr learned my addr 172.21.15.1:0/1845833301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bd489640 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 -- 172.21.15.1:0/1845833301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 msgr2=0x55a0bf7bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 -- 172.21.15.1:0/1845833301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7994a0 msgr2=0x55a0bf7a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 -- 172.21.15.1:0/1845833301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0bf7a4360 con 0x55a0bf7a4680 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57bcc88640 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f57a8012380 tx=0x7f57a8012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ec4861bf5a7e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57a2ffd640 1 -- 172.21.15.1:0/1845833301 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a800b390 con 0x55a0bf7a4680 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57a2ffd640 1 -- 172.21.15.1:0/1845833301 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8016040 con 0x55a0bf7a4680 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.399+0000 7f57a2ffd640 1 -- 172.21.15.1:0/1845833301 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a801b6d0 con 0x55a0bf7a4680 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- 172.21.15.1:0/1845833301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 msgr2=0x55a0bf7bbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f57a8012380 tx=0x7f57a8012cc0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- 172.21.15.1:0/1845833301 shutdown_connections 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf7a4680 0x55a0bf7bbfc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf799dc0 0x55a0bf7bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/1845833301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7994a0 0x55a0bf7a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- 172.21.15.1:0/1845833301 >> 172.21.15.1:0/1845833301 conn(0x55a0bf795a30 msgr2=0x55a0bf7a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- 172.21.15.1:0/1845833301 shutdown_connections 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- 172.21.15.1:0/1845833301 wait complete. 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.400+0000 7f57c1ac6740 1 -- start start 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 Processor -- start 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81b0d10 con 0x55a0bf799dc0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81b0640 con 0x55a0bf7a4680 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81ad880 con 0x55a0bf7994a0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57c1ac6740 10 client.0 _ll_register_callbacks cb 0x7f57a800bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57bd489640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57bd489640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47704/0 (socket says 172.21.15.1:47704) 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57bd489640 1 -- 172.21.15.1:0/4077756420 learned_addr learned my addr 172.21.15.1:0/4077756420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57bcc88640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.401+0000 7f57bcc88640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 -- 172.21.15.1:0/4077756420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 msgr2=0x55a0bf7ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 -- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 msgr2=0x55a0bf7a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 -- 172.21.15.1:0/4077756420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0bf7aa780 con 0x55a0bf799dc0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bcc88640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57bd489640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f57b402a930 tx=0x7f57b4031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ec5733def1878a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4035040 con 0x55a0bf799dc0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f57b4004240 con 0x55a0bf799dc0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a8016040 con 0x55a0bf799dc0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57b4053070 con 0x55a0bf799dc0 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57c1ac6740 10 client.16083 fetch_fsmap learned FSMap version 28 2024-09-12T02:32:58.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0bf81e730 con 0x55a0bf799dc0 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.402+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8016040 con 0x55a0bf799dc0 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57b403c560 con 0x55a0bf799dc0 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 20 client.16083 populate_metadata read hostname 'smithi001' 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf81ef00 0x55a0bf821320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 4 client.16083 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0bf706d60 con 0x55a0bf81ef00 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57bcc88640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf81ef00 0x55a0bf821320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57a0ff9640 10 client.16083 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57bcc88640 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf81ef00 0x55a0bf821320 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736e02e7294aca6b server_cookie=a779ef2b4ea4dc68 in_seq=0 out_seq=0 2024-09-12T02:32:58.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57a0ff9640 1 -- 172.21.15.1:0/4077756420 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a0bf706d60 con 0x55a0bf81ef00 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57a0ff9640 10 client.16083 handle_command_reply: tid=0 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.403+0000 7f57c1ac6740 1 client.16083 shutdown 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 msgr2=0x55a0bf7acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f57b402a930 tx=0x7f57b4031850 comp rx=0 tx=0).stop 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 shutdown_connections 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a0bf799dc0 0x55a0bf7acef0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55a0bf81ef00 0x55a0bf821320 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0bf7a4680 0x55a0bf7a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 --2- 172.21.15.1:0/4077756420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a0bf7994a0 0x55a0bf7ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 >> 172.21.15.1:0/4077756420 conn(0x55a0bf795a30 msgr2=0x55a0bf7a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57a0ff9640 0 client.16083 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 shutdown_connections 2024-09-12T02:32:58.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 1 -- 172.21.15.1:0/4077756420 wait complete. 2024-09-12T02:32:58.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57c1ac6740 20 client.16083 trim_cache size 0 max 16384 2024-09-12T02:32:58.414 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:32:58.414 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-12T02:32:58.414 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-12T02:32:58.414 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 msgr2=0x7f57a40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 0x7f57a40a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f57b0097e40 tx=0x7f57b00c64c0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 msgr2=0x7f57b8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f57b000eaa0 tx=0x7f57b000ef60 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 shutdown_connections 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f57a40a2c00 0x7f57a40a50c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b8106f20 0x7f57b8074f70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57b81027a0 0x7f57b8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 --2- 172.21.15.1:0/3779928822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57b8101df0 0x7f57b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.404+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 >> 172.21.15.1:0/3779928822 conn(0x7f57b80fd8b0 msgr2=0x7f57b80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:58.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.405+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 shutdown_connections 2024-09-12T02:32:58.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:58.405+0000 7f57bf6ed640 1 -- 172.21.15.1:0/3779928822 wait complete. 2024-09-12T02:32:59.228 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:32:59.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:32:59.493 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:59.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:32:59 smithi001 ceph-mon[31252]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/1007753716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0103ff0 msgr2=0x7f9cf01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/1007753716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0103ff0 0x7f9cf01043d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009900 tx=0x7f9ce002a410 comp rx=0 tx=0).stop 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/1007753716 shutdown_connections 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/1007753716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf0109120 0x7f9cf0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/1007753716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf01049a0 0x7f9cf01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/1007753716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0103ff0 0x7f9cf01043d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/1007753716 >> 172.21.15.1:0/1007753716 conn(0x7f9cf00ffa90 msgr2=0x7f9cf0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:59.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/1007753716 shutdown_connections 2024-09-12T02:32:59.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.997+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/1007753716 wait complete. 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 Processor -- start 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 -- start start 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 0x7f9cf019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 0x7f9cf019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0114120 con 0x7f9cf0109120 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0113fa0 con 0x7f9cf01049a0 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cf4fe8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01142a0 con 0x7f9cf0103ff0 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9ceed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:00.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9ceed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47734/0 (socket says 172.21.15.1:47734) 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 0x7f9cf019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9ceed9d640 1 -- 172.21.15.1:0/3879271229 learned_addr learned my addr 172.21.15.1:0/3879271229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.998+0000 7f9cedd9b640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 0x7f9cf019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 -- 172.21.15.1:0/3879271229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 msgr2=0x7f9cf019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 0x7f9cf019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 -- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 msgr2=0x7f9cf019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 -- 172.21.15.1:0/3879271229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf019f590 con 0x7f9cf0103ff0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9ceed9d640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cedd9b640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 0x7f9cf019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cee59c640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 0x7f9cf019a5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005940 tx=0x7f9ce00040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce003f030 con 0x7f9cf0103ff0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:32:59.999+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf019f820 con 0x7f9cf0103ff0 2024-09-12T02:33:00.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.000+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf01a7160 con 0x7f9cf0103ff0 2024-09-12T02:33:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.000+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ce00044c0 con 0x7f9cf0103ff0 2024-09-12T02:33:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.000+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0049060 con 0x7f9cf0103ff0 2024-09-12T02:33:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.000+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf01043d0 con 0x7f9cf0103ff0 2024-09-12T02:33:00.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.002+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9ce0042030 con 0x7f9cf0103ff0 2024-09-12T02:33:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.003+0000 7f9cdf7fe640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 0x7f9cd80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.003+0000 7f9cedd9b640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 0x7f9cd80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.003+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9ce00ef240 con 0x7f9cf0103ff0 2024-09-12T02:33:00.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.003+0000 7f9cedd9b640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 0x7f9cd80a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ffeb0 tx=0x7f9ce4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:00.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.006+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ce00bbad0 con 0x7f9cf0103ff0 2024-09-12T02:33:00.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:32:59 smithi134 ceph-mon[35091]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-12T02:33:00.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:32:59 smithi173 ceph-mon[35036]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 31 MiB/s wr, 21 op/s 2024-09-12T02:33:00.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.216+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cf010c300 con 0x7f9cf0103ff0 2024-09-12T02:33:00.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.217+0000 7f9cdf7fe640 1 -- 172.21.15.1:0/3879271229 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f9ce00bfdd0 con 0x7f9cf0103ff0 2024-09-12T02:33:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:00.217 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:33:00.218 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 msgr2=0x7f9cd80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 0x7f9cd80a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ffeb0 tx=0x7f9ce4005f90 comp rx=0 tx=0).stop 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 msgr2=0x7f9cf019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 0x7f9cf019a5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005940 tx=0x7f9ce00040c0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 shutdown_connections 2024-09-12T02:33:00.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9cd80a2b80 0x7f9cd80a5040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cf0109120 0x7f9cf019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9cf01049a0 0x7f9cf019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 --2- 172.21.15.1:0/3879271229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cf0103ff0 0x7f9cf019a5e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 >> 172.21.15.1:0/3879271229 conn(0x7f9cf00ffa90 msgr2=0x7f9cf0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 shutdown_connections 2024-09-12T02:33:00.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:00.219+0000 7f9cf4fe8640 1 -- 172.21.15.1:0/3879271229 wait complete. 2024-09-12T02:33:00.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:00 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3879271229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:00.936 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T02:33:01.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:00 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3879271229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:01.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:00 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3879271229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:01.199 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 -- 172.21.15.1:0/2728876995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 msgr2=0x7f1238101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 --2- 172.21.15.1:0/2728876995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238101200 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1234009900 tx=0x7f123402a480 comp rx=0 tx=0).stop 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 -- 172.21.15.1:0/2728876995 shutdown_connections 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 --2- 172.21.15.1:0/2728876995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102ef0 0x7f123810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 --2- 172.21.15.1:0/2728876995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102570 0x7f12381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 --2- 172.21.15.1:0/2728876995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238101200 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 -- 172.21.15.1:0/2728876995 >> 172.21.15.1:0/2728876995 conn(0x7f12380fc7d0 msgr2=0x7f12380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 -- 172.21.15.1:0/2728876995 shutdown_connections 2024-09-12T02:33:01.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.706+0000 7f12403aa640 1 -- 172.21.15.1:0/2728876995 wait complete. 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 Processor -- start 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 -- start start 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102570 0x7f1238197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 0x7f123819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1238110f80 con 0x7f1238100e20 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1238110e00 con 0x7f1238102570 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f12403aa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1238111100 con 0x7f1238102ef0 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f123e146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f123e146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38914/0 (socket says 172.21.15.1:38914) 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f123e146640 1 -- 172.21.15.1:0/4279390528 learned_addr learned my addr 172.21.15.1:0/4279390528 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f123d945640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102570 0x7f1238197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.707+0000 7f123e947640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 0x7f123819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 -- 172.21.15.1:0/4279390528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 msgr2=0x7f123819bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 0x7f123819bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 -- 172.21.15.1:0/4279390528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102570 msgr2=0x7f1238197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102570 0x7f1238197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 -- 172.21.15.1:0/4279390528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123819c3c0 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e947640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 0x7f123819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f123e146640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1234006010 tx=0x7f1234003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f122f7fe640 1 -- 172.21.15.1:0/4279390528 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123403f070 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f122f7fe640 1 -- 172.21.15.1:0/4279390528 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1234031c30 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123819c650 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f122f7fe640 1 -- 172.21.15.1:0/4279390528 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234035030 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.708+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381a3f90 con 0x7f1238100e20 2024-09-12T02:33:01.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.710+0000 7f122f7fe640 1 -- 172.21.15.1:0/4279390528 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1234042070 con 0x7f1238100e20 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 Processor -- start 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 -- start start 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5602696072f0 con 0x5602696a2b40 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5602695aecf0 con 0x5602696a15d0 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f1242783740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602696032b0 con 0x5602696ae580 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f123e947640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f123e947640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38916/0 (socket says 172.21.15.1:38916) 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f123e947640 1 -- 172.21.15.1:0/1910735640 learned_addr learned my addr 172.21.15.1:0/1910735640 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.711+0000 7f122f7fe640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 0x7f12240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123d945640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e146640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 -- 172.21.15.1:0/1910735640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 msgr2=0x5602696b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 -- 172.21.15.1:0/1910735640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 msgr2=0x5602696a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f122f7fe640 1 -- 172.21.15.1:0/4279390528 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f12340ef8c0 con 0x7f1238100e20 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 -- 172.21.15.1:0/1910735640 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602695933a0 con 0x5602696a2b40 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e146640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123d945640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 0x7f12240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f123e947640 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1230010540 tx=0x7f1230010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcf8262d9b61073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f122cdea640 1 -- 172.21.15.1:0/1910735640 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123001d400 con 0x5602696a2b40 2024-09-12T02:33:01.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f122cdea640 1 -- 172.21.15.1:0/1910735640 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f123001da80 con 0x5602696a2b40 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.712+0000 7f122cdea640 1 -- 172.21.15.1:0/1910735640 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123001c840 con 0x5602696a2b40 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- 172.21.15.1:0/1910735640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 msgr2=0x5602696a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1230010540 tx=0x7f1230010a00 comp rx=0 tx=0).stop 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f123e947640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 0x7f12240a5040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1230021000 tx=0x7f123001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- 172.21.15.1:0/1910735640 shutdown_connections 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 --2- 172.21.15.1:0/1910735640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696a1090 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- 172.21.15.1:0/1910735640 >> 172.21.15.1:0/1910735640 conn(0x56026966a310 msgr2=0x56026969dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- 172.21.15.1:0/1910735640 shutdown_connections 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- 172.21.15.1:0/1910735640 wait complete. 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.713+0000 7f1242783740 1 -- start start 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 Processor -- start 2024-09-12T02:33:01.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 0x5602696ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5602696b1280 con 0x5602696a15d0 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5602695c2060 con 0x5602696a2b40 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602696b1400 con 0x5602696ae580 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f1242783740 10 client.0 _ll_register_callbacks cb 0x5602693158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38926/0 (socket says 172.21.15.1:38926) 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 -- 172.21.15.1:0/817165585 learned_addr learned my addr 172.21.15.1:0/817165585 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123d945640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 0x5602696ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 -- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 msgr2=0x5602696ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e947640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 -- 172.21.15.1:0/817165585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 msgr2=0x5602696ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 0x5602696ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e146640 1 -- 172.21.15.1:0/817165585 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602693783c0 con 0x5602696a15d0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123e947640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.714+0000 7f123d945640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 0x5602696ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f123e146640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f12340ed3a0 tx=0x7f123408b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6f9c22692b3788 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234049070 con 0x5602696a15d0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f12340b8770 con 0x5602696a15d0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f123001da80 con 0x5602696a15d0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12340bc800 con 0x5602696a15d0 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 10 client.16101 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:01.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602696bccc0 con 0x5602696a15d0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f123001da80 con 0x5602696a15d0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f12340bc360 con 0x5602696a15d0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 10 client.16101 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 10 client.16101 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 20 client.16101 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5602696be010 0x5602696c0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 4 client.16101 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.715+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560269614860 con 0x5602696be010 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.716+0000 7f123d945640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5602696be010 0x5602696c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.716+0000 7f123d945640 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5602696be010 0x5602696c0400 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46c312f44717a5b6 server_cookie=3fbb9f496ebf6c6b in_seq=0 out_seq=0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.716+0000 7f1221ffb640 10 client.16101 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1221ffb640 1 -- 172.21.15.1:0/817165585 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560269614860 con 0x5602696be010 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1221ffb640 10 client.16101 handle_command_reply: tid=0 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 client.16101 shutdown 2024-09-12T02:33:01.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 msgr2=0x5602696adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f12340ed3a0 tx=0x7f123408b140 comp rx=0 tx=0).stop 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 shutdown_connections 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x5602696be010 0x5602696c0400 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a2b40 0x5602696ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 --2- 172.21.15.1:0/817165585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a15d0 0x5602696adfa0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 >> 172.21.15.1:0/817165585 conn(0x56026966a310 msgr2=0x5602696a3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1221ffb640 0 client.16101 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 shutdown_connections 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 1 -- 172.21.15.1:0/817165585 wait complete. 2024-09-12T02:33:01.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.717+0000 7f1242783740 20 client.16101 trim_cache size 0 max 16384 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 Processor -- start 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 -- start start 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696ba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ab370 con 0x5602696a2b40 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12381aceb0 con 0x5602696a15d0 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f1242783740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12381aba40 con 0x5602696ae580 2024-09-12T02:33:01.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f123d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f123d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38942/0 (socket says 172.21.15.1:38942) 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.730+0000 7f123d945640 1 -- 172.21.15.1:0/3402826559 learned_addr learned my addr 172.21.15.1:0/3402826559 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 -- 172.21.15.1:0/3402826559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 msgr2=0x5602696c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 -- 172.21.15.1:0/3402826559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 msgr2=0x5602696ba520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 -- 172.21.15.1:0/3402826559 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602696ac1f0 con 0x5602696a2b40 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f123d945640 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f12380fff70 tx=0x7f122800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcec26cdf424c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f1223fff640 1 -- 172.21.15.1:0/3402826559 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228003de0 con 0x5602696a2b40 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f1223fff640 1 -- 172.21.15.1:0/3402826559 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1228011920 con 0x5602696a2b40 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.731+0000 7f1223fff640 1 -- 172.21.15.1:0/3402826559 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122801ca60 con 0x5602696a2b40 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- 172.21.15.1:0/3402826559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 msgr2=0x5602696aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f12380fff70 tx=0x7f122800bd60 comp rx=0 tx=0).stop 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- 172.21.15.1:0/3402826559 shutdown_connections 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696aab10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- 172.21.15.1:0/3402826559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696ba520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- 172.21.15.1:0/3402826559 >> 172.21.15.1:0/3402826559 conn(0x56026966a310 msgr2=0x5602696a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- 172.21.15.1:0/3402826559 shutdown_connections 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- 172.21.15.1:0/3402826559 wait complete. 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- start start 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 Processor -- start 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.732+0000 7f1242783740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ac7e0 con 0x5602696a2b40 2024-09-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1242783740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12381ac110 con 0x5602696a15d0 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1242783740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12381a9350 con 0x5602696ae580 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1242783740 10 client.0 _ll_register_callbacks cb 0x7f1234005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38956/0 (socket says 172.21.15.1:38956) 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 -- 172.21.15.1:0/853251283 learned_addr learned my addr 172.21.15.1:0/853251283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123e146640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123e947640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 -- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 msgr2=0x5602696b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 -- 172.21.15.1:0/853251283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 msgr2=0x5602696b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 -- 172.21.15.1:0/853251283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602696b2db0 con 0x5602696a2b40 2024-09-12T02:33:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f123d945640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f122801c510 tx=0x7f122801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72037c26bdc7559 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228011440 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f12280115e0 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.733+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1228011920 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1228036070 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 10 client.16107 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560269728bc0 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1228011920 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1228030500 con 0x5602696a2b40 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 10 client.16107 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 10 client.16107 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 20 client.16107 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560269729370 0x56026972b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 4 client.16107 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56026960ed70 con 0x560269729370 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.734+0000 7f123e146640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560269729370 0x56026972b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1221ffb640 10 client.16107 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f123e146640 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560269729370 0x56026972b790 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=45bf3fdf06f8e19a server_cookie=9379bfe7ee6793e1 in_seq=0 out_seq=0 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1221ffb640 1 -- 172.21.15.1:0/853251283 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56026960ed70 con 0x560269729370 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1221ffb640 10 client.16107 handle_command_reply: tid=0 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 client.16107 shutdown 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 msgr2=0x5602696b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f122801c510 tx=0x7f122801c540 comp rx=0 tx=0).stop 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 shutdown_connections 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x560269729370 0x56026972b790 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5602696a2b40 0x5602696b2040 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602696ae580 0x5602696b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 --2- 172.21.15.1:0/853251283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5602696a15d0 0x5602696b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 >> 172.21.15.1:0/853251283 conn(0x56026966a310 msgr2=0x5602696a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1221ffb640 0 client.16107 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 shutdown_connections 2024-09-12T02:33:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.735+0000 7f1242783740 1 -- 172.21.15.1:0/853251283 wait complete. 2024-09-12T02:33:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f1242783740 20 client.16107 trim_cache size 0 max 16384 2024-09-12T02:33:01.745 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 msgr2=0x7f12240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 0x7f12240a5040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1230021000 tx=0x7f123001e000 comp rx=0 tx=0).stop 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 msgr2=0x7f1238197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1234006010 tx=0x7f1234003c10 comp rx=0 tx=0).stop 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 shutdown_connections 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12240a2b80 0x7f12240a5040 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1238102ef0 0x7f123819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1238102570 0x7f1238197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 --2- 172.21.15.1:0/4279390528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1238100e20 0x7f1238197410 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 >> 172.21.15.1:0/4279390528 conn(0x7f12380fc7d0 msgr2=0x7f12380fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 shutdown_connections 2024-09-12T02:33:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:01.736+0000 7f12403aa640 1 -- 172.21.15.1:0/4279390528 wait complete. 2024-09-12T02:33:01.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:01 smithi001 ceph-mon[31252]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T02:33:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:01 smithi134 ceph-mon[35091]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T02:33:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:01 smithi173 ceph-mon[35036]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 MiB/s wr, 24 op/s 2024-09-12T02:33:02.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T02:33:02.836 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 -- 172.21.15.1:0/4075574494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8101de0 msgr2=0x7f0ea81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 --2- 172.21.15.1:0/4075574494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8101de0 0x7f0ea81021c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c02a410 comp rx=0 tx=0).stop 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 -- 172.21.15.1:0/4075574494 shutdown_connections 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 --2- 172.21.15.1:0/4075574494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8106f10 0x7f0ea810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 --2- 172.21.15.1:0/4075574494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 0x7f0ea81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 --2- 172.21.15.1:0/4075574494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8101de0 0x7f0ea81021c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 -- 172.21.15.1:0/4075574494 >> 172.21.15.1:0/4075574494 conn(0x7f0ea80fd8c0 msgr2=0x7f0ea80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 -- 172.21.15.1:0/4075574494 shutdown_connections 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.342+0000 7f0eaf137640 1 -- 172.21.15.1:0/4075574494 wait complete. 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 Processor -- start 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 -- start start 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 0x7f0ea81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 0x7f0ea8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea8111f70 con 0x7f0ea8106f10 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea8111df0 con 0x7f0ea8102790 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaf137640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81120f0 con 0x7f0ea8101de0 2024-09-12T02:33:03.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0ead6d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaced3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 0x7f0ea81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0ead6d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38974/0 (socket says 172.21.15.1:38974) 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 0x7f0ea8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0eaced3640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 0x7f0ea81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:39364/0 (socket says 172.21.15.1:39364) 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.343+0000 7f0ead6d4640 1 -- 172.21.15.1:0/718654728 learned_addr learned my addr 172.21.15.1:0/718654728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 -- 172.21.15.1:0/718654728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 msgr2=0x7f0ea81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 0x7f0ea81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 -- 172.21.15.1:0/718654728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 msgr2=0x7f0ea8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 0x7f0ea8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 -- 172.21.15.1:0/718654728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea819d380 con 0x7f0ea8106f10 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ead6d4640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000cce0 tx=0x7f0ea000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ea5ffb640 1 -- 172.21.15.1:0/718654728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000f450 con 0x7f0ea8106f10 2024-09-12T02:33:03.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ea5ffb640 1 -- 172.21.15.1:0/718654728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ea000fad0 con 0x7f0ea8106f10 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0ea5ffb640 1 -- 172.21.15.1:0/718654728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0018c10 con 0x7f0ea8106f10 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea819d670 con 0x7f0ea8106f10 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.344+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea81a4f50 con 0x7f0ea8106f10 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.346+0000 7f0ea5ffb640 1 -- 172.21.15.1:0/718654728 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0ea000f5f0 con 0x7f0ea8106f10 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 Processor -- start 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 -- start start 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed23db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5608ed1922f0 con 0x5608ed2309e0 2024-09-12T02:33:03.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5608ed139cf0 con 0x5608ed23b780 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.347+0000 7f0eb1510740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5608ed18e2b0 con 0x5608ed231f50 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ea5ffb640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 0x7f0e980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38986/0 (socket says 172.21.15.1:38986) 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 -- 172.21.15.1:0/3615203247 learned_addr learned my addr 172.21.15.1:0/3615203247 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ead6d4640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 0x7f0e980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ea5ffb640 1 -- 172.21.15.1:0/718654728 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0ea00cf5e0 con 0x7f0ea8106f10 2024-09-12T02:33:03.379 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed23db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 -- 172.21.15.1:0/3615203247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 msgr2=0x5608ed2304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 -- 172.21.15.1:0/3615203247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 msgr2=0x5608ed23db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed23db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 -- 172.21.15.1:0/3615203247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ed11e3a0 con 0x5608ed2309e0 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0eaced3640 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d260b25c4b5c5aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0ead6d4640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 0x7f0e980a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ea009bdb0 tx=0x7f0ea000af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0e92ffd640 1 -- 172.21.15.1:0/3615203247 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c040070 con 0x5608ed2309e0 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0e92ffd640 1 -- 172.21.15.1:0/3615203247 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e9c005020 con 0x5608ed2309e0 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.348+0000 7f0e92ffd640 1 -- 172.21.15.1:0/3615203247 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c035040 con 0x5608ed2309e0 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 -- 172.21.15.1:0/3615203247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 msgr2=0x5608ed230e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c031630 comp rx=0 tx=0).stop 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 -- 172.21.15.1:0/3615203247 shutdown_connections 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed230e20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed23db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 --2- 172.21.15.1:0/3615203247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 -- 172.21.15.1:0/3615203247 >> 172.21.15.1:0/3615203247 conn(0x5608ed1f5310 msgr2=0x5608ed22d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 -- 172.21.15.1:0/3615203247 shutdown_connections 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.349+0000 7f0eb1510740 1 -- 172.21.15.1:0/3615203247 wait complete. 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 -- start start 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 Processor -- start 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2383b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed238930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5608ed23e420 con 0x5608ed2309e0 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5608ed14d060 con 0x5608ed23b780 2024-09-12T02:33:03.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5608ed23e5a0 con 0x5608ed231f50 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eb1510740 10 client.0 _ll_register_callbacks cb 0x5608ecea08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39002/0 (socket says 172.21.15.1:39002) 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0ea7fff640 1 -- 172.21.15.1:0/1966849053 learned_addr learned my addr 172.21.15.1:0/1966849053 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0eaced3640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.350+0000 7f0ea7fff640 1 -- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 msgr2=0x5608ed2383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0ea7fff640 1 -- 172.21.15.1:0/1966849053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 msgr2=0x5608ed238930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed238930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0ea7fff640 1 -- 172.21.15.1:0/1966849053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ecf033c0 con 0x5608ed2309e0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400bfd0 tx=0x7f0e940039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7030dcfe6f37d864 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94005220 con 0x5608ed2309e0 2024-09-12T02:33:03.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e9c005020 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0e940053c0 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e940055c0 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0eb1510740 10 client.16119 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5608ed249eb0 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e9c005020 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.351+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0e94012b90 con 0x5608ed2309e0 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 10 client.16119 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 10 client.16119 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 20 client.16119 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed24b370 0x5608ed24d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 4 client.16119 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608ed19f860 con 0x5608ed24b370 2024-09-12T02:33:03.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eaced3640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed24b370 0x5608ed24d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0eaced3640 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed24b370 0x5608ed24d760 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b15802a6cccefc60 server_cookie=f108e540b9e60f85 in_seq=0 out_seq=0 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.352+0000 7f0e87fff640 10 client.16119 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0e87fff640 1 -- 172.21.15.1:0/1966849053 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608ed19f860 con 0x5608ed24b370 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0e87fff640 10 client.16119 handle_command_reply: tid=0 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 client.16119 shutdown 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 msgr2=0x5608ed23b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400bfd0 tx=0x7f0e940039c0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 shutdown_connections 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed24b370 0x5608ed24d760 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed238930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed2383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0e87fff640 0 client.16119 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 --2- 172.21.15.1:0/1966849053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed2309e0 0x5608ed23b100 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 >> 172.21.15.1:0/1966849053 conn(0x5608ed1f5310 msgr2=0x5608ed232d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.353+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 shutdown_connections 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.354+0000 7f0eb1510740 1 -- 172.21.15.1:0/1966849053 wait complete. 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.354+0000 7f0eb1510740 20 client.16119 trim_cache size 0 max 16384 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.366+0000 7f0eb1510740 1 Processor -- start 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.366+0000 7f0eb1510740 1 -- start start 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed2309e0 0x5608ed2476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed23cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81ab380 con 0x5608ed23b780 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81acec0 con 0x5608ed2309e0 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0eb1510740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81aba50 con 0x5608ed231f50 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39008/0 (socket says 172.21.15.1:39008) 2024-09-12T02:33:03.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 -- 172.21.15.1:0/2339473939 learned_addr learned my addr 172.21.15.1:0/2339473939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 -- 172.21.15.1:0/2339473939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 msgr2=0x5608ed23cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed23cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 -- 172.21.15.1:0/2339473939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed2309e0 msgr2=0x5608ed2476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed2309e0 0x5608ed2476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 -- 172.21.15.1:0/2339473939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ed236900 con 0x5608ed23b780 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0e940126b0 tx=0x7f0e940126e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4ee4a40dd06f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0e927fc640 1 -- 172.21.15.1:0/2339473939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400be30 con 0x5608ed23b780 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0e927fc640 1 -- 172.21.15.1:0/2339473939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e94005850 con 0x5608ed23b780 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.367+0000 7f0e927fc640 1 -- 172.21.15.1:0/2339473939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94004ab0 con 0x5608ed23b780 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- 172.21.15.1:0/2339473939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 msgr2=0x5608ed23d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0e940126b0 tx=0x7f0e940126e0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- 172.21.15.1:0/2339473939 shutdown_connections 2024-09-12T02:33:03.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed23b780 0x5608ed23d0b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed231f50 0x5608ed23cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 --2- 172.21.15.1:0/2339473939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed2309e0 0x5608ed2476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- 172.21.15.1:0/2339473939 >> 172.21.15.1:0/2339473939 conn(0x5608ed1f5310 msgr2=0x5608ed2336e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- 172.21.15.1:0/2339473939 shutdown_connections 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- 172.21.15.1:0/2339473939 wait complete. 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.368+0000 7f0eb1510740 1 -- start start 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 Processor -- start 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 0x5608ed243f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed252e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81ac7f0 con 0x5608ed231f50 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81ac120 con 0x5608ed23b780 2024-09-12T02:33:03.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea81a9360 con 0x5608ed2309e0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eb1510740 10 client.0 _ll_register_callbacks cb 0x7f0e9400bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39010/0 (socket says 172.21.15.1:39010) 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 -- 172.21.15.1:0/4008286820 learned_addr learned my addr 172.21.15.1:0/4008286820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 0x5608ed243f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 -- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 msgr2=0x5608ed243f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 0x5608ed243f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 -- 172.21.15.1:0/4008286820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 msgr2=0x5608ed252e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed252e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0eaced3640 1 -- 172.21.15.1:0/4008286820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ed253600 con 0x5608ed231f50 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.369+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 0x5608ed243f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eaced3640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29de736b6f5e0dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:03.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c040040 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0e9c004020 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e94005850 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e9c035040 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 10 client.16125 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5608ed2b5fe0 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e94005850 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0e9c003680 con 0x5608ed231f50 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 10 client.16125 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 10 client.16125 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 20 client.16125 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed2b62d0 0x5608ed2b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 4 client.16125 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.370+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608ed199d70 con 0x5608ed2b62d0 2024-09-12T02:33:03.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed2b62d0 0x5608ed2b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0ea7fff640 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed2b62d0 0x5608ed2b86f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9105d28b666e9f20 server_cookie=65bfec7d1f8003bf in_seq=0 out_seq=0 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0e87fff640 10 client.16125 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0e87fff640 1 -- 172.21.15.1:0/4008286820 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608ed199d70 con 0x5608ed2b62d0 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0e87fff640 10 client.16125 handle_command_reply: tid=0 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 client.16125 shutdown 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 msgr2=0x5608ed2528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009900 tx=0x7f0e9c005760 comp rx=0 tx=0).stop 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 shutdown_connections 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5608ed2b62d0 0x5608ed2b86f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5608ed231f50 0x5608ed2528c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608ed23b780 0x5608ed252e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 --2- 172.21.15.1:0/4008286820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608ed2309e0 0x5608ed243f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.371+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 >> 172.21.15.1:0/4008286820 conn(0x5608ed1f5310 msgr2=0x5608ed2274e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0e87fff640 0 client.16125 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 shutdown_connections 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eb1510740 1 -- 172.21.15.1:0/4008286820 wait complete. 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eb1510740 20 client.16125 trim_cache size 0 max 16384 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 msgr2=0x7f0e980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 0x7f0e980a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ea009bdb0 tx=0x7f0ea000af30 comp rx=0 tx=0).stop 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 msgr2=0x7f0ea819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000cce0 tx=0x7f0ea000a620 comp rx=0 tx=0).stop 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 shutdown_connections 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0e980a2b80 0x7f0e980a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ea8106f10 0x7f0ea819cca0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ea8102790 0x7f0ea8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 --2- 172.21.15.1:0/718654728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ea8101de0 0x7f0ea81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 >> 172.21.15.1:0/718654728 conn(0x7f0ea80fd8c0 msgr2=0x7f0ea80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 shutdown_connections 2024-09-12T02:33:03.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:03.372+0000 7f0eaf137640 1 -- 172.21.15.1:0/718654728 wait complete. 2024-09-12T02:33:04.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:03 smithi001 ceph-mon[31252]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 20 op/s 2024-09-12T02:33:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:03 smithi134 ceph-mon[35091]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 20 op/s 2024-09-12T02:33:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:03 smithi173 ceph-mon[35036]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 19 MiB/s wr, 20 op/s 2024-09-12T02:33:04.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:33:04.533 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:05.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- 172.21.15.1:0/2145497351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674102dd0 msgr2=0x7fd6741031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 --2- 172.21.15.1:0/2145497351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674102dd0 0x7fd6741031b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd664009cd0 tx=0x7fd66402a8f0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- 172.21.15.1:0/2145497351 shutdown_connections 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 --2- 172.21.15.1:0/2145497351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674108300 0x7fd67410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 --2- 172.21.15.1:0/2145497351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674103780 0x7fd674107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 --2- 172.21.15.1:0/2145497351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674102dd0 0x7fd6741031b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- 172.21.15.1:0/2145497351 >> 172.21.15.1:0/2145497351 conn(0x7fd6740fc7d0 msgr2=0x7fd6740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- 172.21.15.1:0/2145497351 shutdown_connections 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- 172.21.15.1:0/2145497351 wait complete. 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 Processor -- start 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.011+0000 7fd678a68640 1 -- start start 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674102dd0 0x7fd6741985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674103780 0x7fd674198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741120f0 con 0x7fd674108300 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111f70 con 0x7fd674103780 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd678a68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd674112270 con 0x7fd674102dd0 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39026/0 (socket says 172.21.15.1:39026) 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 -- 172.21.15.1:0/4089086605 learned_addr learned my addr 172.21.15.1:0/4089086605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674103780 0x7fd674198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd67259c640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674102dd0 0x7fd6741985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 -- 172.21.15.1:0/4089086605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674102dd0 msgr2=0x7fd6741985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674102dd0 0x7fd6741985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 -- 172.21.15.1:0/4089086605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674103780 msgr2=0x7fd674198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674103780 0x7fd674198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 -- 172.21.15.1:0/4089086605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67419d550 con 0x7fd674108300 2024-09-12T02:33:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.012+0000 7fd672d9d640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00c970 tx=0x7fd66c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.013+0000 7fd6637fe640 1 -- 172.21.15.1:0/4089086605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c007bb0 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.013+0000 7fd6637fe640 1 -- 172.21.15.1:0/4089086605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c007d50 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.013+0000 7fd6637fe640 1 -- 172.21.15.1:0/4089086605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c018770 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.013+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67419d840 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.013+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741a5120 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.015+0000 7fd6637fe640 1 -- 172.21.15.1:0/4089086605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd66c00f450 con 0x7fd674108300 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.015+0000 7fd67ae41740 1 Processor -- start 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.015+0000 7fd67ae41740 1 -- start start 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c06a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c13760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598c0b6c2f0 con 0x5598c0c07b40 2024-09-12T02:33:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5598c0b13cf0 con 0x5598c0c11370 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67ae41740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5598c0b682b0 con 0x5598c0c065d0 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39032/0 (socket says 172.21.15.1:39032) 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 -- 172.21.15.1:0/1536527635 learned_addr learned my addr 172.21.15.1:0/1536527635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd6637fe640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 0x7fd65c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd67259c640 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c06a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd672d9d640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 0x7fd65c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c13760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 -- 172.21.15.1:0/1536527635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 msgr2=0x5598c0c06a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c06a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 -- 172.21.15.1:0/1536527635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 msgr2=0x5598c0c13760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c13760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 -- 172.21.15.1:0/1536527635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c0af83a0 con 0x5598c0c07b40 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd6637fe640 1 -- 172.21.15.1:0/4089086605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd66c0cf100 con 0x7fd674108300 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.016+0000 7fd671d9b640 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd668009330 tx=0x7fd668009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71cf3a33f0e642 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd672d9d640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 0x7fd65c0a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0982b0 tx=0x7fd66c06b790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd660ff9640 1 -- 172.21.15.1:0/1536527635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668010e10 con 0x5598c0c07b40 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd660ff9640 1 -- 172.21.15.1:0/1536527635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66801a070 con 0x5598c0c07b40 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd660ff9640 1 -- 172.21.15.1:0/1536527635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668014720 con 0x5598c0c07b40 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 -- 172.21.15.1:0/1536527635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 msgr2=0x5598c0c06090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd668009330 tx=0x7fd668009570 comp rx=0 tx=0).stop 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 -- 172.21.15.1:0/1536527635 shutdown_connections 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c13760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c06a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 --2- 172.21.15.1:0/1536527635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c06090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.017+0000 7fd67ae41740 1 -- 172.21.15.1:0/1536527635 >> 172.21.15.1:0/1536527635 conn(0x5598c0bcf310 msgr2=0x5598c0c02c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- 172.21.15.1:0/1536527635 shutdown_connections 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- 172.21.15.1:0/1536527635 wait complete. 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- start start 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 Processor -- start 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c0df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598c0c14010 con 0x5598c0c11370 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5598c0b27060 con 0x5598c0c07b40 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5598c0c14190 con 0x5598c0c065d0 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd67ae41740 10 client.0 _ll_register_callbacks cb 0x5598c087a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39038/0 (socket says 172.21.15.1:39038) 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.018+0000 7fd671d9b640 1 -- 172.21.15.1:0/4043450204 learned_addr learned my addr 172.21.15.1:0/4043450204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:05.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd67259c640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c0df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 -- 172.21.15.1:0/4043450204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 msgr2=0x5598c0c10cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c10cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 -- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 msgr2=0x5598c0c0df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c0df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 -- 172.21.15.1:0/4043450204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c08dd3c0 con 0x5598c0c11370 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6680091f0 tx=0x7fd668014380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6111202fd2a1986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:05.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668014b50 con 0x5598c0c11370 2024-09-12T02:33:05.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd668014cf0 con 0x5598c0c11370 2024-09-12T02:33:05.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd66801a070 con 0x5598c0c11370 2024-09-12T02:33:05.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd668015420 con 0x5598c0c11370 2024-09-12T02:33:05.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd67ae41740 10 client.16137 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:05.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.019+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598c0c1fa00 con 0x5598c0c11370 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66801a070 con 0x5598c0c11370 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd66801f760 con 0x5598c0c11370 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 10 client.16137 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 10 client.16137 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 20 client.16137 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c20d50 0x5598c0c23140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 4 client.16137 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598c0b79860 con 0x5598c0c20d50 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67259c640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c20d50 0x5598c0c23140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd67259c640 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c20d50 0x5598c0c23140 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34b24d34f90d29ac server_cookie=6792403bc726b62e in_seq=0 out_seq=0 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.020+0000 7fd659ffb640 10 client.16137 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd659ffb640 1 -- 172.21.15.1:0/4043450204 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598c0b79860 con 0x5598c0c20d50 2024-09-12T02:33:05.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd659ffb640 10 client.16137 handle_command_reply: tid=0 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 client.16137 shutdown 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 msgr2=0x5598c0c0e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6680091f0 tx=0x7fd668014380 comp rx=0 tx=0).stop 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 shutdown_connections 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c0e4d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c20d50 0x5598c0c23140 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c0df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4043450204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c10cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd659ffb640 0 client.16137 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 >> 172.21.15.1:0/4043450204 conn(0x5598c0bcf310 msgr2=0x5598c0c08960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.021+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 shutdown_connections 2024-09-12T02:33:05.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.022+0000 7fd67ae41740 1 -- 172.21.15.1:0/4043450204 wait complete. 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.022+0000 7fd67ae41740 20 client.16137 trim_cache size 0 max 16384 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.034+0000 7fd67ae41740 1 Processor -- start 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 -- start start 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c1d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c09660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ad5b0 con 0x5598c0c07b40 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741af0f0 con 0x5598c0c11370 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67ae41740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741adc80 con 0x5598c0c065d0 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39054/0 (socket says 172.21.15.1:39054) 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 -- 172.21.15.1:0/4045334300 learned_addr learned my addr 172.21.15.1:0/4045334300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c1d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 -- 172.21.15.1:0/4045334300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 msgr2=0x5598c0c1d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c1d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 -- 172.21.15.1:0/4045334300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 msgr2=0x5598c0c09660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c09660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 -- 172.21.15.1:0/4045334300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c0c0c4c0 con 0x5598c0c07b40 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd671d9b640 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c1d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.035+0000 7fd67259c640 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd6640096c0 tx=0x7fd664030680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b3988a96fbafb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.036+0000 7fd65bfff640 1 -- 172.21.15.1:0/4045334300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664003970 con 0x5598c0c07b40 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.036+0000 7fd65bfff640 1 -- 172.21.15.1:0/4045334300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd664036040 con 0x5598c0c07b40 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.036+0000 7fd65bfff640 1 -- 172.21.15.1:0/4045334300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664004400 con 0x5598c0c07b40 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 -- 172.21.15.1:0/4045334300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 msgr2=0x5598c0c09120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd6640096c0 tx=0x7fd664030680 comp rx=0 tx=0).stop 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 -- 172.21.15.1:0/4045334300 shutdown_connections 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c07b40 0x5598c0c09120 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c11370 0x5598c0c09660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 --2- 172.21.15.1:0/4045334300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c1d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 -- 172.21.15.1:0/4045334300 >> 172.21.15.1:0/4045334300 conn(0x5598c0bcf310 msgr2=0x5598c0c0d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 -- 172.21.15.1:0/4045334300 shutdown_connections 2024-09-12T02:33:05.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.037+0000 7fd67ae41740 1 -- 172.21.15.1:0/4045334300 wait complete. 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 -- start start 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 Processor -- start 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c19890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c14c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741aea20 con 0x5598c0c11370 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ae350 con 0x5598c0c07b40 2024-09-12T02:33:05.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ab590 con 0x5598c0c065d0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67ae41740 10 client.0 _ll_register_callbacks cb 0x7fd668009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39062/0 (socket says 172.21.15.1:39062) 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 -- 172.21.15.1:0/2068448062 learned_addr learned my addr 172.21.15.1:0/2068448062 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd67259c640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c14c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c19890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 -- 172.21.15.1:0/2068448062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 msgr2=0x5598c0c19890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c19890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 -- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 msgr2=0x5598c0c14c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c14c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.038+0000 7fd671d9b640 1 -- 172.21.15.1:0/2068448062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c0c15690 con 0x5598c0c11370 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd671d9b640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd668006a70 tx=0x7fd668000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3f3d87dac52476 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6680143f0 con 0x5598c0c11370 2024-09-12T02:33:05.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd664036040 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd66801f400 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd668010a50 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd67ae41740 10 client.16143 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5598c0c8f7d0 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd664036040 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.039+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd6680155c0 con 0x5598c0c11370 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 10 client.16143 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 10 client.16143 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 20 client.16143 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c8fe40 0x5598c0c92230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 4 client.16143 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598c0b73d70 con 0x5598c0c8fe40 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67259c640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c8fe40 0x5598c0c92230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:05.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67259c640 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c8fe40 0x5598c0c92230 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa0fbf055750daba server_cookie=8b66bb05dd6bd1c in_seq=0 out_seq=0 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd659ffb640 10 client.16143 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd659ffb640 1 -- 172.21.15.1:0/2068448062 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598c0b73d70 con 0x5598c0c8fe40 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd659ffb640 10 client.16143 handle_command_reply: tid=0 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.040+0000 7fd67ae41740 1 client.16143 shutdown 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 msgr2=0x5598c0c15150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd668006a70 tx=0x7fd668000bc0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 shutdown_connections 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598c0c11370 0x5598c0c15150 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x5598c0c8fe40 0x5598c0c92230 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5598c0c07b40 0x5598c0c14c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 --2- 172.21.15.1:0/2068448062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5598c0c065d0 0x5598c0c19890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 >> 172.21.15.1:0/2068448062 conn(0x5598c0bcf310 msgr2=0x5598c0c0f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd659ffb640 0 client.16143 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:05.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 shutdown_connections 2024-09-12T02:33:05.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 1 -- 172.21.15.1:0/2068448062 wait complete. 2024-09-12T02:33:05.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd67ae41740 20 client.16143 trim_cache size 0 max 16384 2024-09-12T02:33:05.057 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 msgr2=0x7fd65c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 0x7fd65c0a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0982b0 tx=0x7fd66c06b790 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 msgr2=0x7fd67419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00c970 tx=0x7fd66c00cd70 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 shutdown_connections 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fd65c0a2b80 0x7fd65c0a5040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd674108300 0x7fd67419ce70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674103780 0x7fd674198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 --2- 172.21.15.1:0/4089086605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd674102dd0 0x7fd6741985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.041+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 >> 172.21.15.1:0/4089086605 conn(0x7fd6740fc7d0 msgr2=0x7fd674105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.042+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 shutdown_connections 2024-09-12T02:33:05.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:05.042+0000 7fd678a68640 1 -- 172.21.15.1:0/4089086605 wait complete. 2024-09-12T02:33:05.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:33:05.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:05 smithi001 ceph-mon[31252]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 19 op/s 2024-09-12T02:33:05.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:33:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:05 smithi134 ceph-mon[35091]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 19 op/s 2024-09-12T02:33:06.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:05 smithi173 ceph-mon[35036]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 19 op/s 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 -- 172.21.15.1:0/839277318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc774101440 msgr2=0x7fc77410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 --2- 172.21.15.1:0/839277318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc774101440 0x7fc77410df30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc764009900 tx=0x7fc76402a410 comp rx=0 tx=0).stop 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 -- 172.21.15.1:0/839277318 shutdown_connections 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 --2- 172.21.15.1:0/839277318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc774101440 0x7fc77410df30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 --2- 172.21.15.1:0/839277318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc77410e500 0x7fc774110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 --2- 172.21.15.1:0/839277318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774100b20 0x7fc774100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.510+0000 7fc77afce640 1 -- 172.21.15.1:0/839277318 >> 172.21.15.1:0/839277318 conn(0x7fc7740fc7d0 msgr2=0x7fc7740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- 172.21.15.1:0/839277318 shutdown_connections 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- 172.21.15.1:0/839277318 wait complete. 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 Processor -- start 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- start start 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 0x7fc7741a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774101440 0x7fc7741a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc774114270 con 0x7fc77410e500 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741140f0 con 0x7fc774101440 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.511+0000 7fc77afce640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741143f0 con 0x7fc774100b20 2024-09-12T02:33:06.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc778d6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 0x7fc7741a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39088/0 (socket says 172.21.15.1:39088) 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc778d6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 0x7fc7741a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:39450/0 (socket says 172.21.15.1:39450) 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc773fff640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774101440 0x7fc7741a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 -- 172.21.15.1:0/3650504991 learned_addr learned my addr 172.21.15.1:0/3650504991 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 -- 172.21.15.1:0/3650504991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 msgr2=0x7fc7741a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 0x7fc7741a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 -- 172.21.15.1:0/3650504991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774101440 msgr2=0x7fc7741a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774101440 0x7fc7741a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 -- 172.21.15.1:0/3650504991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77419acc0 con 0x7fc77410e500 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77956b640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00e9d0 tx=0x7fc76c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00cd80 con 0x7fc77410e500 2024-09-12T02:33:06.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77419afb0 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc76c005020 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.512+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0116d0 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.513+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a72a0 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.514+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc774100f00 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.515+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc76c0051d0 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.516+0000 7fc771ffb640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 0x7fc7600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.516+0000 7fc778d6a640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 0x7fc7600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.516+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc76c0cf490 con 0x7fc77410e500 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.516+0000 7fc778d6a640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 0x7fc7600a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc75c005d00 tx=0x7fc75c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:06.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.523+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc76c016030 con 0x7fc77410e500 2024-09-12T02:33:06.586 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:06.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.747+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc77419bac0 con 0x7fc77410e500 2024-09-12T02:33:06.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.748+0000 7fc771ffb640 1 -- 172.21.15.1:0/3650504991 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7fc77419bac0 con 0x7fc77410e500 2024-09-12T02:33:06.748 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:06.748 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:33:06.749 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:33:06.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 msgr2=0x7fc7600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:06.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 0x7fc7600a5040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc75c005d00 tx=0x7fc75c00b410 comp rx=0 tx=0).stop 2024-09-12T02:33:06.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 msgr2=0x7fc77419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:06.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00e9d0 tx=0x7fc76c00ee90 comp rx=0 tx=0).stop 2024-09-12T02:33:06.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 shutdown_connections 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc7600a2b80 0x7fc7600a5040 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc77410e500 0x7fc77419a590 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc774101440 0x7fc7741a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 --2- 172.21.15.1:0/3650504991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc774100b20 0x7fc7741a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 >> 172.21.15.1:0/3650504991 conn(0x7fc7740fc7d0 msgr2=0x7fc7740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 shutdown_connections 2024-09-12T02:33:06.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:06.750+0000 7fc77afce640 1 -- 172.21.15.1:0/3650504991 wait complete. 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:06.864 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:06 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3650504991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:06 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3650504991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:06 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3650504991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:07.567 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --set-id 4e6740dc --release --await' 2024-09-12T02:33:07.568 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --set-id 4e6740dc --release --await 2024-09-12T02:33:07.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:07 smithi001 ceph-mon[31252]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-12T02:33:07.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:07.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:07.819 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:07.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 -- 172.21.15.1:0/3620795551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30102db0 msgr2=0x7efd30103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 --2- 172.21.15.1:0/3620795551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30102db0 0x7efd30103190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009930 tx=0x7efd2c02a420 comp rx=0 tx=0).stop 2024-09-12T02:33:07.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 -- 172.21.15.1:0/3620795551 shutdown_connections 2024-09-12T02:33:07.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 --2- 172.21.15.1:0/3620795551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 0x7efd3010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 --2- 172.21.15.1:0/3620795551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30103760 0x7efd30107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 --2- 172.21.15.1:0/3620795551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30102db0 0x7efd30103190 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 -- 172.21.15.1:0/3620795551 >> 172.21.15.1:0/3620795551 conn(0x7efd300fc7d0 msgr2=0x7efd300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 -- 172.21.15.1:0/3620795551 shutdown_connections 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.818+0000 7efd3843a640 1 -- 172.21.15.1:0/3620795551 wait complete. 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 Processor -- start 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 -- start start 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 0x7efd3019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 0x7efd3019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd30112090 con 0x7efd30103760 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd30111f10 con 0x7efd301082e0 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd3843a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd30112210 con 0x7efd30102db0 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd359d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd359d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39104/0 (socket says 172.21.15.1:39104) 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd359d5640 1 -- 172.21.15.1:0/4065780497 learned_addr learned my addr 172.21.15.1:0/4065780497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd361d6640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 0x7efd3019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.819+0000 7efd369d7640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 0x7efd3019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 -- 172.21.15.1:0/4065780497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 msgr2=0x7efd3019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 0x7efd3019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 -- 172.21.15.1:0/4065780497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 msgr2=0x7efd3019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 0x7efd3019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 -- 172.21.15.1:0/4065780497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3019f6e0 con 0x7efd30103760 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd361d6640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 0x7efd3019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd359d5640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c8c0 tx=0x7efd2000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd277fe640 1 -- 172.21.15.1:0/4065780497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20007bb0 con 0x7efd30103760 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3019f9d0 con 0x7efd30103760 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd277fe640 1 -- 172.21.15.1:0/4065780497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd20007d50 con 0x7efd30103760 2024-09-12T02:33:07.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd277fe640 1 -- 172.21.15.1:0/4065780497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20018830 con 0x7efd30103760 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.820+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd301a72b0 con 0x7efd30103760 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.822+0000 7efd277fe640 1 -- 172.21.15.1:0/4065780497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7efd20018a10 con 0x7efd30103760 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 Processor -- start 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 -- start start 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd277fe640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 0x7efd1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557dd26362f0 con 0x557dd26db370 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557dd25ddcf0 con 0x557dd26d05d0 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd3a813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557dd26322b0 con 0x557dd26d1b40 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39120/0 (socket says 172.21.15.1:39120) 2024-09-12T02:33:07.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd369d7640 1 -- 172.21.15.1:0/1202967265 learned_addr learned my addr 172.21.15.1:0/1202967265 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd361d6640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 0x7efd1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd277fe640 1 -- 172.21.15.1:0/4065780497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7efd200cf2a0 con 0x7efd30103760 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd369d7640 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.823+0000 7efd359d5640 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 -- 172.21.15.1:0/1202967265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 msgr2=0x557dd26d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 -- 172.21.15.1:0/1202967265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 msgr2=0x557dd26d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 -- 172.21.15.1:0/1202967265 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd25c23a0 con 0x557dd26db370 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd361d6640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 0x7efd1c0a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd369d7640 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efd28012950 tx=0x7efd28009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c06b01c0758ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd24dea640 1 -- 172.21.15.1:0/1202967265 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28010770 con 0x557dd26db370 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd24dea640 1 -- 172.21.15.1:0/1202967265 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd28010df0 con 0x557dd26db370 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.824+0000 7efd24dea640 1 -- 172.21.15.1:0/1202967265 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2801ed40 con 0x557dd26db370 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- 172.21.15.1:0/1202967265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 msgr2=0x557dd26dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efd28012950 tx=0x7efd28009710 comp rx=0 tx=0).stop 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- 172.21.15.1:0/1202967265 shutdown_connections 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26dd760 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 --2- 172.21.15.1:0/1202967265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- 172.21.15.1:0/1202967265 >> 172.21.15.1:0/1202967265 conn(0x557dd2699310 msgr2=0x557dd26ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- 172.21.15.1:0/1202967265 shutdown_connections 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- 172.21.15.1:0/1202967265 wait complete. 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.825+0000 7efd3a813740 1 -- start start 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 Processor -- start 2024-09-12T02:33:07.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557dd26de070 con 0x557dd26db370 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557dd25f1060 con 0x557dd26d05d0 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557dd26de1f0 con 0x557dd26d1b40 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd3a813740 10 client.0 _ll_register_callbacks cb 0x557dd23448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39124/0 (socket says 172.21.15.1:39124) 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 -- 172.21.15.1:0/2489752131 learned_addr learned my addr 172.21.15.1:0/2489752131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd361d6640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd359d5640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 -- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 msgr2=0x557dd26d7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 -- 172.21.15.1:0/2489752131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 msgr2=0x557dd26dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.826+0000 7efd369d7640 1 -- 172.21.15.1:0/2489752131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dd23a73c0 con 0x557dd26db370 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd369d7640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd28002230 tx=0x7efd2801e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3600501845146b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2801ed90 con 0x557dd26db370 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7efd28004a40 con 0x557dd26db370 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd28010df0 con 0x557dd26db370 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd28004c80 con 0x557dd26db370 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 10 client.16161 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:07.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dd26e9ae0 con 0x557dd26db370 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd28010df0 con 0x557dd26db370 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd2800c070 con 0x557dd26db370 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 10 client.16161 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 10 client.16161 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 20 client.16161 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd26ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 4 client.16161 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.827+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dd2643860 con 0x557dd26eae30 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.828+0000 7efd361d6640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd26ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.828+0000 7efd19ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.828+0000 7efd361d6640 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd26ed220 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77769c46ba43444f server_cookie=92b67593c6eb1ad1 in_seq=0 out_seq=0 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd19ffb640 1 -- 172.21.15.1:0/2489752131 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dd2643860 con 0x557dd26eae30 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd19ffb640 10 client.16161 handle_command_reply: tid=0 2024-09-12T02:33:07.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 client.16161 shutdown 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 msgr2=0x557dd26d85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd28002230 tx=0x7efd2801e680 comp rx=0 tx=0).stop 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 shutdown_connections 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd26ed220 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd19ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d85e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26d7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 --2- 172.21.15.1:0/2489752131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 >> 172.21.15.1:0/2489752131 conn(0x557dd2699310 msgr2=0x557dd26d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 shutdown_connections 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 1 -- 172.21.15.1:0/2489752131 wait complete. 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.829+0000 7efd3a813740 20 client.16161 trim_cache size 0 max 16384 2024-09-12T02:33:07.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 Processor -- start 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 -- start start 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26f2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd301af890 con 0x557dd26db370 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd301b13d0 con 0x557dd26d05d0 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd3a813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd301aff60 con 0x557dd26d1b40 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39126/0 (socket says 172.21.15.1:39126) 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.842+0000 7efd369d7640 1 -- 172.21.15.1:0/1805579170 learned_addr learned my addr 172.21.15.1:0/1805579170 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 -- 172.21.15.1:0/1805579170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 msgr2=0x557dd26f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd359d5640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd361d6640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 -- 172.21.15.1:0/1805579170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 msgr2=0x557dd26e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 -- 172.21.15.1:0/1805579170 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd26db0b0 con 0x557dd26db370 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd361d6640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd369d7640 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efd28005c50 tx=0x7efd28005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f398b55d8ef71188 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd1bfff640 1 -- 172.21.15.1:0/1805579170 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28009b10 con 0x557dd26db370 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd1bfff640 1 -- 172.21.15.1:0/1805579170 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd28005a10 con 0x557dd26db370 2024-09-12T02:33:07.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.843+0000 7efd1bfff640 1 -- 172.21.15.1:0/1805579170 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2801ed90 con 0x557dd26db370 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- 172.21.15.1:0/1805579170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 msgr2=0x557dd26f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efd28005c50 tx=0x7efd28005850 comp rx=0 tx=0).stop 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- 172.21.15.1:0/1805579170 shutdown_connections 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26f2e50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d1b40 0x557dd26f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 --2- 172.21.15.1:0/1805579170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d05d0 0x557dd26e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- 172.21.15.1:0/1805579170 >> 172.21.15.1:0/1805579170 conn(0x557dd2699310 msgr2=0x557dd26d70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- 172.21.15.1:0/1805579170 shutdown_connections 2024-09-12T02:33:07.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- 172.21.15.1:0/1805579170 wait complete. 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 -- start start 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.844+0000 7efd3a813740 1 Processor -- start 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 0x557dd26e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 0x557dd26d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd301b0d00 con 0x557dd26db370 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd301b0630 con 0x557dd26d1b40 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd301ad870 con 0x557dd26d05d0 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 10 client.0 _ll_register_callbacks cb 0x7efd2000a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39140/0 (socket says 172.21.15.1:39140) 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd361d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 0x557dd26e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 -- 172.21.15.1:0/2640706332 learned_addr learned my addr 172.21.15.1:0/2640706332 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd359d5640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 0x557dd26d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 -- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 msgr2=0x557dd26e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 0x557dd26e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 -- 172.21.15.1:0/2640706332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 msgr2=0x557dd26d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 0x557dd26d4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 -- 172.21.15.1:0/2640706332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dd26d56e0 con 0x557dd26db370 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd359d5640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 0x557dd26d4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd361d6640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 0x557dd26e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd369d7640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efd28002230 tx=0x7efd28012840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36c76863e03898e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28036030 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7efd28017070 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.845+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557dd263dd70 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd28041070 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 10 client.16167 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dd2755700 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557dd263dd70 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd2800c070 con 0x557dd26db370 2024-09-12T02:33:07.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 10 client.16167 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 20 client.16167 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd2757cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 4 client.16167 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dd25ba170 con 0x557dd26eae30 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.846+0000 7efd361d6640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd2757cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd361d6640 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd2757cc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3a20857371da32f server_cookie=1d35697ac66d1d1 in_seq=0 out_seq=0 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd19ffb640 10 client.16167 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd19ffb640 1 -- 172.21.15.1:0/2640706332 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557dd25ba170 con 0x557dd26eae30 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd19ffb640 10 client.16167 handle_command_reply: tid=0 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 client.16167 shutdown 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 msgr2=0x557dd26d5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efd28002230 tx=0x7efd28012840 comp rx=0 tx=0).stop 2024-09-12T02:33:07.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 shutdown_connections 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x557dd26eae30 0x557dd2757cc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557dd26db370 0x557dd26d5070 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557dd26d1b40 0x557dd26d4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 --2- 172.21.15.1:0/2640706332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557dd26d05d0 0x557dd26e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd19ffb640 0 client.16167 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 >> 172.21.15.1:0/2640706332 conn(0x557dd2699310 msgr2=0x557dd26d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 shutdown_connections 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 1 -- 172.21.15.1:0/2640706332 wait complete. 2024-09-12T02:33:07.893 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.847+0000 7efd3a813740 20 client.16167 trim_cache size 0 max 16384 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 msgr2=0x7efd1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 0x7efd1c0a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c005a20 comp rx=0 tx=0).stop 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 msgr2=0x7efd3019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c8c0 tx=0x7efd2000cd80 comp rx=0 tx=0).stop 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 shutdown_connections 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7efd1c0a2b80 0x7efd1c0a5040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd30103760 0x7efd3019ac70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd301082e0 0x7efd3019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 --2- 172.21.15.1:0/4065780497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd30102db0 0x7efd3019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 >> 172.21.15.1:0/4065780497 conn(0x7efd300fc7d0 msgr2=0x7efd30100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 shutdown_connections 2024-09-12T02:33:07.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:07.848+0000 7efd3843a640 1 -- 172.21.15.1:0/4065780497 wait complete. 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 -- 172.21.15.1:0/3292138967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 msgr2=0x7ff7701049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 --2- 172.21.15.1:0/3292138967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff7701049b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009900 tx=0x7ff76c02a410 comp rx=0 tx=0).stop 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 -- 172.21.15.1:0/3292138967 shutdown_connections 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 --2- 172.21.15.1:0/3292138967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 0x7ff770109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 --2- 172.21.15.1:0/3292138967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 0x7ff7701072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 --2- 172.21.15.1:0/3292138967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff7701049b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 -- 172.21.15.1:0/3292138967 >> 172.21.15.1:0/3292138967 conn(0x7ff7700fc1e0 msgr2=0x7ff7700fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 -- 172.21.15.1:0/3292138967 shutdown_connections 2024-09-12T02:33:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.967+0000 7ff77771a640 1 -- 172.21.15.1:0/3292138967 wait complete. 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 Processor -- start 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 -- start start 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 0x7ff7701982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 0x7ff77019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff77010d850 con 0x7ff7701025c0 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff77010d6d0 con 0x7ff770104ef0 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff77771a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff77010d9d0 con 0x7ff770107820 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39156/0 (socket says 172.21.15.1:39156) 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 -- 172.21.15.1:0/2871672968 learned_addr learned my addr 172.21.15.1:0/2871672968 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff774cb5640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 0x7ff7701982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff775cb7640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 0x7ff77019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 -- 172.21.15.1:0/2871672968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 msgr2=0x7ff77019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 0x7ff77019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 -- 172.21.15.1:0/2871672968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 msgr2=0x7ff7701982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 0x7ff7701982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.968+0000 7ff7754b6640 1 -- 172.21.15.1:0/2871672968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77019f9c0 con 0x7ff7701025c0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff7754b6640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff76c031440 tx=0x7ff76c032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff7667fc640 1 -- 172.21.15.1:0/2871672968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c03f030 con 0x7ff7701025c0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77019fc50 con 0x7ff7701025c0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff7667fc640 1 -- 172.21.15.1:0/2871672968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76c003ce0 con 0x7ff7701025c0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff7667fc640 1 -- 172.21.15.1:0/2871672968 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c035070 con 0x7ff7701025c0 2024-09-12T02:33:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.969+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701a0190 con 0x7ff7701025c0 2024-09-12T02:33:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.971+0000 7ff7667fc640 1 -- 172.21.15.1:0/2871672968 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff76c042030 con 0x7ff7701025c0 2024-09-12T02:33:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.971+0000 7ff77a4af740 1 Processor -- start 2024-09-12T02:33:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 -- start start 2024-09-12T02:33:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 0x55dc91878830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dc917d42f0 con 0x55dc918712e0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dc9177c270 con 0x55dc91876370 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff77a4af740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dc917d02b0 con 0x55dc918709a0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39164/0 (socket says 172.21.15.1:39164) 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7754b6640 1 -- 172.21.15.1:0/3321310205 learned_addr learned my addr 172.21.15.1:0/3321310205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 0x55dc91878830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7667fc640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 0x7ff75c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff775cb7640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff775cb7640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 0x7ff75c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7667fc640 1 -- 172.21.15.1:0/2871672968 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff76c0ef470 con 0x7ff7701025c0 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 -- 172.21.15.1:0/3321310205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 msgr2=0x55dc91870da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 -- 172.21.15.1:0/3321310205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 msgr2=0x55dc91875da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff774cb5640 1 -- 172.21.15.1:0/3321310205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9177b340 con 0x55dc91876370 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.972+0000 7ff7754b6640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 0x55dc91878830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff76000bbc0 tx=0x7ff7600107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f62f5b416577a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff775cb7640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 0x7ff75c0a50f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff77006a980 tx=0x7ff768004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff75b7fe640 1 -- 172.21.15.1:0/3321310205 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760004030 con 0x55dc91876370 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff75b7fe640 1 -- 172.21.15.1:0/3321310205 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7600041d0 con 0x55dc91876370 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff75b7fe640 1 -- 172.21.15.1:0/3321310205 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7600116a0 con 0x55dc91876370 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff77a4af740 1 -- 172.21.15.1:0/3321310205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 msgr2=0x55dc91878830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 0x55dc91878830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff76000bbc0 tx=0x7ff7600107a0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff77a4af740 1 -- 172.21.15.1:0/3321310205 shutdown_connections 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc91875da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.973+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc91876370 0x55dc91878830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3321310205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- 172.21.15.1:0/3321310205 >> 172.21.15.1:0/3321310205 conn(0x55dc9186c010 msgr2=0x55dc9186c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- 172.21.15.1:0/3321310205 shutdown_connections 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- 172.21.15.1:0/3321310205 wait complete. 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- start start 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 Processor -- start 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dc91879340 con 0x55dc91876370 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dc9175d290 con 0x55dc918709a0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dc918794c0 con 0x55dc918712e0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff77a4af740 10 client.0 _ll_register_callbacks cb 0x55dc9178e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.974+0000 7ff775cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:39540/0 (socket says 172.21.15.1:39540) 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff775cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39180/0 (socket says 172.21.15.1:39180) 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 -- 172.21.15.1:0/3154635669 learned_addr learned my addr 172.21.15.1:0/3154635669 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 -- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 msgr2=0x55dc9187ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 -- 172.21.15.1:0/3154635669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 msgr2=0x55dc91882110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 -- 172.21.15.1:0/3154635669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc914e7210 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff775cb7640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff774cb5640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff760011010 tx=0x7ff76000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396679a207ddcd01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff758ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76002a060 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7600041d0 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff7600035f0 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7600037f0 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff77a4af740 10 client.25582 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.975+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc915b3620 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7600041d0 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff760004850 con 0x55dc918712e0 2024-09-12T02:33:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 10 client.25582 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 10 client.25582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 20 client.25582 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc91886520 0x55dc91888910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 4 client.25582 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc917e1a20 con 0x55dc91886520 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff7754b6640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc91886520 0x55dc91888910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff7754b6640 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc91886520 0x55dc91888910 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5a07f168170fdae server_cookie=3c3418b50fb4c605 in_seq=0 out_seq=0 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.976+0000 7ff758ff9640 10 client.25582 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff758ff9640 1 -- 172.21.15.1:0/3154635669 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc917e1a20 con 0x55dc91886520 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff758ff9640 10 client.25582 handle_command_reply: tid=0 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 client.25582 shutdown 2024-09-12T02:33:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 msgr2=0x55dc9187b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff760011010 tx=0x7ff76000bfa0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 shutdown_connections 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc91882110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc91886520 0x55dc91888910 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918712e0 0x55dc9187b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 --2- 172.21.15.1:0/3154635669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff758ff9640 0 client.25582 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 >> 172.21.15.1:0/3154635669 conn(0x55dc9186c010 msgr2=0x55dc9186d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 shutdown_connections 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.977+0000 7ff77a4af740 1 -- 172.21.15.1:0/3154635669 wait complete. 2024-09-12T02:33:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.978+0000 7ff77a4af740 20 client.25582 trim_cache size 0 max 16384 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 Processor -- start 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 -- start start 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 0x55dc918820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701a8fb0 con 0x55dc91876370 2024-09-12T02:33:07.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701aaaf0 con 0x55dc918712e0 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff77a4af740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701a9680 con 0x55dc918709a0 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff775cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff774cb5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 0x55dc918820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff775cb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39186/0 (socket says 172.21.15.1:39186) 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff775cb7640 1 -- 172.21.15.1:0/1130942145 learned_addr learned my addr 172.21.15.1:0/1130942145 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.994+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.1:39556/0 (socket says 172.21.15.1:39556) 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 -- 172.21.15.1:0/1130942145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 msgr2=0x55dc91870d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 -- 172.21.15.1:0/1130942145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 msgr2=0x55dc918820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 0x55dc918820d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 -- 172.21.15.1:0/1130942145 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc91888c80 con 0x55dc91876370 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff7754b6640 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff774cb5640 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 0x55dc918820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff775cb7640 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff768010ce0 tx=0x7ff768007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779a818622f3074f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff75affd640 1 -- 172.21.15.1:0/1130942145 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768018040 con 0x55dc91876370 2024-09-12T02:33:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff75affd640 1 -- 172.21.15.1:0/1130942145 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff768025030 con 0x55dc91876370 2024-09-12T02:33:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.995+0000 7ff75affd640 1 -- 172.21.15.1:0/1130942145 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7680113e0 con 0x55dc91876370 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- 172.21.15.1:0/1130942145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 msgr2=0x55dc9186b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff768010ce0 tx=0x7ff768007780 comp rx=0 tx=0).stop 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- 172.21.15.1:0/1130942145 shutdown_connections 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc91876370 0x55dc9186b0b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918712e0 0x55dc918820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 --2- 172.21.15.1:0/1130942145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc918709a0 0x55dc91870d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- 172.21.15.1:0/1130942145 >> 172.21.15.1:0/1130942145 conn(0x55dc9186c010 msgr2=0x55dc9186a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- 172.21.15.1:0/1130942145 shutdown_connections 2024-09-12T02:33:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- 172.21.15.1:0/1130942145 wait complete. 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 -- start start 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.996+0000 7ff77a4af740 1 Processor -- start 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc9187db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc91876370 0x55dc91880b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701aa420 con 0x55dc918712e0 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701a9d50 con 0x55dc918709a0 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff7701a6f90 con 0x55dc91876370 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff77a4af740 10 client.0 _ll_register_callbacks cb 0x7ff76c0b7ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc9187db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff7754b6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:43716/0 (socket says 172.21.15.1:43716) 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff7754b6640 1 -- 172.21.15.1:0/2268213223 learned_addr learned my addr 172.21.15.1:0/2268213223 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:08.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff775cb7640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc91876370 0x55dc91880b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 -- 172.21.15.1:0/2268213223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc91876370 msgr2=0x55dc91880b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc91876370 0x55dc91880b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 -- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 msgr2=0x55dc9187d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.997+0000 7ff774cb5640 1 -- 172.21.15.1:0/2268213223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc91881190 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff774cb5640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc9187db60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff760001eb0 tx=0x7ff76000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ddaa1db6214033 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76002a040 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff7600035f0 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff768025030 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff76003e070 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 10 client.16185 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc918f54f0 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff768025030 con 0x55dc918712e0 2024-09-12T02:33:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff7600050f0 con 0x55dc918712e0 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 10 client.16185 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 20 client.16185 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc918f5d30 0x55dc918f8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 4 client.16185 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc917dbd70 con 0x55dc918f5d30 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.998+0000 7ff7754b6640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc918f5d30 0x55dc918f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.999+0000 7ff758ff9640 10 client.16185 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:07.999+0000 7ff7754b6640 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc918f5d30 0x55dc918f8150 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe7812ec80a391d server_cookie=50b68700bbd9a108 in_seq=0 out_seq=0 2024-09-12T02:33:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff758ff9640 1 -- 172.21.15.1:0/2268213223 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc917dbd70 con 0x55dc918f5d30 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff758ff9640 10 client.16185 handle_command_reply: tid=0 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 client.16185 shutdown 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 msgr2=0x55dc9187db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc9187db60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff760001eb0 tx=0x7ff76000b7b0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 shutdown_connections 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dc918712e0 0x55dc9187db60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55dc918f5d30 0x55dc918f8150 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dc91876370 0x55dc91880b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 --2- 172.21.15.1:0/2268213223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc918709a0 0x55dc9187d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff758ff9640 0 client.16185 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 >> 172.21.15.1:0/2268213223 conn(0x55dc9186c010 msgr2=0x55dc9186b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 shutdown_connections 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 1 -- 172.21.15.1:0/2268213223 wait complete. 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.007+0000 7ff77a4af740 20 client.16185 trim_cache size 0 max 16384 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-12T02:33:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 msgr2=0x7ff75c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 0x7ff75c0a50f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff77006a980 tx=0x7ff768004ab0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 msgr2=0x7ff770197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff76c031440 tx=0x7ff76c032e20 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 shutdown_connections 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff75c0a2c30 0x7ff75c0a50f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff770107820 0x7ff77019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff770104ef0 0x7ff7701982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 --2- 172.21.15.1:0/2871672968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7701025c0 0x7ff770197db0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 >> 172.21.15.1:0/2871672968 conn(0x7ff7700fc1e0 msgr2=0x7ff770102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 shutdown_connections 2024-09-12T02:33:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-12T02:33:08.008+0000 7ff77771a640 1 -- 172.21.15.1:0/2871672968 wait complete. 2024-09-12T02:33:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:07 smithi134 ceph-mon[35091]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-12T02:33:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:08.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:07 smithi173 ceph-mon[35036]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 20 op/s 2024-09-12T02:33:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:33:08.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:33:08.790 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:09.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 -- 172.21.15.1:0/2763186870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 msgr2=0x7fc6cc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 --2- 172.21.15.1:0/2763186870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc10bb50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009900 tx=0x7fc6c002a480 comp rx=0 tx=0).stop 2024-09-12T02:33:09.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 -- 172.21.15.1:0/2763186870 shutdown_connections 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 --2- 172.21.15.1:0/2763186870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc10bb50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 --2- 172.21.15.1:0/2763186870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc10c170 0x7fc6cc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 --2- 172.21.15.1:0/2763186870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc102d40 0x7fc6cc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 -- 172.21.15.1:0/2763186870 >> 172.21.15.1:0/2763186870 conn(0x7fc6cc0fc7a0 msgr2=0x7fc6cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 -- 172.21.15.1:0/2763186870 shutdown_connections 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.374+0000 7fc6d2077640 1 -- 172.21.15.1:0/2763186870 wait complete. 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 Processor -- start 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 -- start start 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc102d40 0x7fc6cc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 0x7fc6cc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc112030 con 0x7fc6cc103660 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc111eb0 con 0x7fc6cc10c170 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.375+0000 7fc6d2077640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1121b0 con 0x7fc6cc102d40 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39220/0 (socket says 172.21.15.1:39220) 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 -- 172.21.15.1:0/3463807120 learned_addr learned my addr 172.21.15.1:0/3463807120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc102d40 0x7fc6cc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 0x7fc6cc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 -- 172.21.15.1:0/3463807120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc102d40 msgr2=0x7fc6cc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc102d40 0x7fc6cc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 -- 172.21.15.1:0/3463807120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 msgr2=0x7fc6cc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 0x7fc6cc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 -- 172.21.15.1:0/3463807120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc19d600 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 0x7fc6cc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0005ab0 tx=0x7fc6c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6c8ff9640 1 -- 172.21.15.1:0/3463807120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c003f030 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6cc19d890 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6c8ff9640 1 -- 172.21.15.1:0/3463807120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c0003ce0 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6c8ff9640 1 -- 172.21.15.1:0/3463807120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0035070 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.376+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6cc1a51d0 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6c8ff9640 1 -- 172.21.15.1:0/3463807120 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc6c0042030 con 0x7fc6cc103660 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 Processor -- start 2024-09-12T02:33:09.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 -- start start 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f060 0x55621229f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.379+0000 7fc6d4450740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556212204620 con 0x5562122aa240 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6d4450740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5562121abe50 con 0x55621229f980 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6d4450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5562122005e0 con 0x55621229f060 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39232/0 (socket says 172.21.15.1:39232) 2024-09-12T02:33:09.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6cbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f060 0x55621229f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 -- 172.21.15.1:0/2917008957 learned_addr learned my addr 172.21.15.1:0/2917008957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6c8ff9640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 0x7fc6b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 0x7fc6b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6c8ff9640 1 -- 172.21.15.1:0/3463807120 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc6c00ef640 con 0x7fc6cc103660 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 -- 172.21.15.1:0/2917008957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f060 msgr2=0x55621229f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f060 0x55621229f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 -- 172.21.15.1:0/2917008957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 msgr2=0x5562122a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 -- 172.21.15.1:0/2917008957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621219cd40 con 0x5562122aa240 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6caffd640 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b87f0 tx=0x7fc6c002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3613519604561220 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6b1ffb640 1 -- 172.21.15.1:0/2917008957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0049070 con 0x5562122aa240 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.380+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 0x7fc6b40a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4013870 tx=0x7fc6c4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6b1ffb640 1 -- 172.21.15.1:0/2917008957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c00bc520 con 0x5562122aa240 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6b1ffb640 1 -- 172.21.15.1:0/2917008957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00c4a90 con 0x5562122aa240 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 -- 172.21.15.1:0/2917008957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 msgr2=0x5562122ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b87f0 tx=0x7fc6c002a480 comp rx=0 tx=0).stop 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 -- 172.21.15.1:0/2917008957 shutdown_connections 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5562122aa240 0x5562122ac630 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 --2- 172.21.15.1:0/2917008957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f060 0x55621229f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 -- 172.21.15.1:0/2917008957 >> 172.21.15.1:0/2917008957 conn(0x55621229b5f0 msgr2=0x55621229b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 -- 172.21.15.1:0/2917008957 shutdown_connections 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.381+0000 7fc6d4450740 1 -- 172.21.15.1:0/2917008957 wait complete. 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 -- start start 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 Processor -- start 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 0x5562122a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562122aa240 0x5562122a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556212204620 con 0x55621229f060 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55621218cf10 con 0x5562122aa240 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5562122acbd0 con 0x55621229f980 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6d4450740 10 client.0 _ll_register_callbacks cb 0x5562121b0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39242/0 (socket says 172.21.15.1:39242) 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.382+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4142799635 learned_addr learned my addr 172.21.15.1:0/4142799635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562122aa240 0x5562122a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 0x5562122a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4142799635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 msgr2=0x5562122a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 0x5562122a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562122aa240 msgr2=0x5562122a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562122aa240 0x5562122a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4142799635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556211f13580 con 0x55621229f060 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 0x5562122a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0104d0 tx=0x7fc6bc010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798ef77ccbfa4611 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc01a020 con 0x55621229f060 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc6bc016690 con 0x55621229f060 2024-09-12T02:33:09.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c00bc520 con 0x55621229f060 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc025050 con 0x55621229f060 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6d4450740 10 client.16197 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556211fdd960 con 0x55621229f060 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.383+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c00bc520 con 0x55621229f060 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6bc014ab0 con 0x55621229f060 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 10 client.16197 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 20 client.16197 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562122bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 4 client.16197 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556212211b90 con 0x5562122b9a10 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562122bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6aaffd640 10 client.16197 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.384+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562122bbeb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd8a3f168845686 server_cookie=bd34564e794ded75 in_seq=0 out_seq=0 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.385+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4142799635 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556212211b90 con 0x5562122b9a10 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.385+0000 7fc6aaffd640 10 client.16197 handle_command_reply: tid=0 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.385+0000 7fc6d4450740 1 client.16197 shutdown 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.385+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 msgr2=0x5562122a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.385+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0104d0 tx=0x7fc6bc010990 comp rx=0 tx=0).stop 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 shutdown_connections 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562122bbeb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562122aa240 0x5562122a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6aaffd640 0 client.16197 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55621229f980 0x5562122a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4142799635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122a71b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 >> 172.21.15.1:0/4142799635 conn(0x55621229b5f0 msgr2=0x5562122a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 shutdown_connections 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 1 -- 172.21.15.1:0/4142799635 wait complete. 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.386+0000 7fc6d4450740 20 client.16197 trim_cache size 0 max 16384 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 Processor -- start 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 -- start start 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f060 0x5562122c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x5562122a4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1ad780 con 0x55621229f980 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1af2c0 con 0x55621229f060 2024-09-12T02:33:09.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6d4450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1ade50 con 0x5562122aa240 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39246/0 (socket says 172.21.15.1:39246) 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 -- 172.21.15.1:0/3563880587 learned_addr learned my addr 172.21.15.1:0/3563880587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f060 0x5562122c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 -- 172.21.15.1:0/3563880587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 msgr2=0x5562122a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x5562122a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 -- 172.21.15.1:0/3563880587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f060 msgr2=0x5562122c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f060 0x5562122c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 -- 172.21.15.1:0/3563880587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621229ee90 con 0x55621229f980 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.403+0000 7fc6caffd640 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b8280 tx=0x7fc6c003b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5178e04067b6008 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6b17fa640 1 -- 172.21.15.1:0/3563880587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0049040 con 0x55621229f980 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6b17fa640 1 -- 172.21.15.1:0/3563880587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c00bc520 con 0x55621229f980 2024-09-12T02:33:09.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6b17fa640 1 -- 172.21.15.1:0/3563880587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c003bd00 con 0x55621229f980 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 -- 172.21.15.1:0/3563880587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 msgr2=0x5562122c1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00b8280 tx=0x7fc6c003b720 comp rx=0 tx=0).stop 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 -- 172.21.15.1:0/3563880587 shutdown_connections 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f980 0x5562122c1cc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x5562122a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 --2- 172.21.15.1:0/3563880587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f060 0x5562122c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 -- 172.21.15.1:0/3563880587 >> 172.21.15.1:0/3563880587 conn(0x55621229b5f0 msgr2=0x5562122a0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 -- 172.21.15.1:0/3563880587 shutdown_connections 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.404+0000 7fc6d4450740 1 -- 172.21.15.1:0/3563880587 wait complete. 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 -- start start 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 Processor -- start 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x556212323750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1aebf0 con 0x55621229f060 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1ae520 con 0x55621229f980 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1ab760 con 0x5562122aa240 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6d4450740 10 client.0 _ll_register_callbacks cb 0x7fc6bc00bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6cb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39250/0 (socket says 172.21.15.1:39250) 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4113551943 learned_addr learned my addr 172.21.15.1:0/4113551943 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.405+0000 7fc6cbfff640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x556212323750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4113551943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 msgr2=0x556212323750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x556212323750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 msgr2=0x5562122ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 -- 172.21.15.1:0/4113551943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556212323d90 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6cb7fe640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc008010 tx=0x7fc6bc0178b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00eb732ac033200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02d070 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc6bc017cb0 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c00bc520 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc039050 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6d4450740 10 client.16203 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556212325110 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.406+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c00bc520 con 0x55621229f060 2024-09-12T02:33:09.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6bc012530 con 0x55621229f060 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 10 client.16203 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 10 client.16203 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 20 client.16203 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562123278a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 4 client.16203 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4e6740dc", "release": true, "await": true}] 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4e6740dc", "release": true, "await": true}) -- 0x55621220c0a0 con 0x5562122b9a10 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562123278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6aaffd640 10 client.16203 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.407+0000 7fc6caffd640 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562123278a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c8f356109b77694 server_cookie=bf4cdafa20484d54 in_seq=0 out_seq=0 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6aaffd640 1 -- 172.21.15.1:0/4113551943 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55621220c0a0 con 0x5562122b9a10 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6aaffd640 10 client.16203 handle_command_reply: tid=0 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 client.16203 shutdown 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 msgr2=0x5562122ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc008010 tx=0x7fc6bc0178b0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 shutdown_connections 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5562122b9a10 0x5562123278a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562122aa240 0x556212323750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621229f980 0x5562122ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 --2- 172.21.15.1:0/4113551943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55621229f060 0x5562122ae300 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 >> 172.21.15.1:0/4113551943 conn(0x55621229b5f0 msgr2=0x556212299f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6aaffd640 0 client.16203 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 shutdown_connections 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.410+0000 7fc6d4450740 1 -- 172.21.15.1:0/4113551943 wait complete. 2024-09-12T02:33:09.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.411+0000 7fc6d4450740 20 client.16203 trim_cache size 0 max 16384 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24494, 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 8, 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "4e6740dc": { 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 8, 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:33:09.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 133.4, 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:09.432 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 msgr2=0x7fc6b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 0x7fc6b40a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4013870 tx=0x7fc6c4004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 msgr2=0x7fc6cc198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0005ab0 tx=0x7fc6c00042f0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 shutdown_connections 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fc6b40a2b80 0x7fc6b40a5040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6cc103660 0x7fc6cc198b90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6cc10c170 0x7fc6cc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 --2- 172.21.15.1:0/3463807120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6cc102d40 0x7fc6cc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.412+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 >> 172.21.15.1:0/3463807120 conn(0x7fc6cc0fc7a0 msgr2=0x7fc6cc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.413+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 shutdown_connections 2024-09-12T02:33:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:09.415+0000 7fc6d2077640 1 -- 172.21.15.1:0/3463807120 wait complete. 2024-09-12T02:33:09.686 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:09 smithi001 ceph-mon[31252]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 600 KiB/s wr, 13 op/s 2024-09-12T02:33:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:09 smithi134 ceph-mon[35091]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 600 KiB/s wr, 13 op/s 2024-09-12T02:33:10.183 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4e6740dc', total seconds elapsed: 18.0 2024-09-12T02:33:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:09 smithi173 ceph-mon[35036]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 600 KiB/s wr, 13 op/s 2024-09-12T02:33:10.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- 172.21.15.1:0/1764219775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 msgr2=0x7f48601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 --2- 172.21.15.1:0/1764219775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f48601067e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f484c009900 tx=0x7f484c02a410 comp rx=0 tx=0).stop 2024-09-12T02:33:10.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- 172.21.15.1:0/1764219775 shutdown_connections 2024-09-12T02:33:10.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 --2- 172.21.15.1:0/1764219775 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f48601067e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 --2- 172.21.15.1:0/1764219775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860106f10 0x7f486010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 --2- 172.21.15.1:0/1764219775 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860101de0 0x7f48601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- 172.21.15.1:0/1764219775 >> 172.21.15.1:0/1764219775 conn(0x7f48600fd880 msgr2=0x7f48600ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- 172.21.15.1:0/1764219775 shutdown_connections 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- 172.21.15.1:0/1764219775 wait complete. 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 Processor -- start 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.721+0000 7f4866c61640 1 -- start start 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 0x7f486019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860106f10 0x7f486019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4860111f90 con 0x7f4860102790 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4860111e10 con 0x7f4860101de0 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f4866c61640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4860112110 con 0x7f4860106f10 2024-09-12T02:33:10.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39268/0 (socket says 172.21.15.1:39268) 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 -- 172.21.15.1:0/4247920438 learned_addr learned my addr 172.21.15.1:0/4247920438 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f48651fe640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860106f10 0x7f486019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f48649fd640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 0x7f486019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 -- 172.21.15.1:0/4247920438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860106f10 msgr2=0x7f486019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860106f10 0x7f486019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 -- 172.21.15.1:0/4247920438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 msgr2=0x7f486019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 0x7f486019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f485ffff640 1 -- 172.21.15.1:0/4247920438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486019f640 con 0x7f4860102790 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.722+0000 7f48649fd640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 0x7f486019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f485ffff640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f484c005ab0 tx=0x7f484c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f485dffb640 1 -- 172.21.15.1:0/4247920438 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c03f030 con 0x7f4860102790 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486019f8d0 con 0x7f4860102790 2024-09-12T02:33:10.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f485dffb640 1 -- 172.21.15.1:0/4247920438 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f484c003ce0 con 0x7f4860102790 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f485dffb640 1 -- 172.21.15.1:0/4247920438 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c035070 con 0x7f4860102790 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.723+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48601a7210 con 0x7f4860102790 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 Processor -- start 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 -- start start 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b960cca2f0 con 0x55b960d645d0 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b960c71cf0 con 0x55b960d65b40 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f486903a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b960cc62b0 con 0x55b960d6f370 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39284/0 (socket says 172.21.15.1:39284) 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f48649fd640 1 -- 172.21.15.1:0/4155323644 learned_addr learned my addr 172.21.15.1:0/4155323644 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:10.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.726+0000 7f48651fe640 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f485dffb640 1 -- 172.21.15.1:0/4247920438 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f484c042030 con 0x7f4860102790 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 -- 172.21.15.1:0/4155323644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 msgr2=0x55b960d71760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d71760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 -- 172.21.15.1:0/4155323644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 msgr2=0x55b960d64090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d64090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 -- 172.21.15.1:0/4155323644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b960c563a0 con 0x55b960d645d0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48651fe640 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f48649fd640 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4854007850 tx=0x7f4854007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666d11eaebb4203d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f484affd640 1 -- 172.21.15.1:0/4155323644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400d950 con 0x55b960d645d0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f484affd640 1 -- 172.21.15.1:0/4155323644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854018070 con 0x55b960d645d0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f484affd640 1 -- 172.21.15.1:0/4155323644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540123e0 con 0x55b960d645d0 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.727+0000 7f485dffb640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 0x7f48500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f48651fe640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 0x7f48500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f485dffb640 1 -- 172.21.15.1:0/4247920438 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f484c0ef930 con 0x7f4860102790 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 -- 172.21.15.1:0/4155323644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 msgr2=0x55b960d64a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4854007850 tx=0x7f4854007d10 comp rx=0 tx=0).stop 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 -- 172.21.15.1:0/4155323644 shutdown_connections 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d64a10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d71760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 --2- 172.21.15.1:0/4155323644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 -- 172.21.15.1:0/4155323644 >> 172.21.15.1:0/4155323644 conn(0x55b960d2d310 msgr2=0x55b960d60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 -- 172.21.15.1:0/4155323644 shutdown_connections 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f48651fe640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 0x7f48500a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485800aeb0 tx=0x7f485800a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.728+0000 7f486903a740 1 -- 172.21.15.1:0/4155323644 wait complete. 2024-09-12T02:33:10.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.729+0000 7f486903a740 1 -- start start 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.729+0000 7f486903a740 1 Processor -- start 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d6bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d6c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b960d72070 con 0x55b960d645d0 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b960c85060 con 0x55b960d65b40 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b960d721f0 con 0x55b960d6f370 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39292/0 (socket says 172.21.15.1:39292) 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 -- 172.21.15.1:0/1810484059 learned_addr learned my addr 172.21.15.1:0/1810484059 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f485ffff640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d6bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f486903a740 10 client.0 _ll_register_callbacks cb 0x55b9609d88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:10.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48651fe640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d6c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 -- 172.21.15.1:0/1810484059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 msgr2=0x55b960d6c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d6c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 -- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 msgr2=0x55b960d6bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d6bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f48649fd640 1 -- 172.21.15.1:0/1810484059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b960a3b3c0 con 0x55b960d645d0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.730+0000 7f485ffff640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d6bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f48649fd640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4854006f40 tx=0x7f4854013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd5324d98608fee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f483ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400de20 con 0x55b960d645d0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f485401c3f0 con 0x55b960d645d0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4854018070 con 0x55b960d645d0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f485401c5f0 con 0x55b960d645d0 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f486903a740 10 client.16215 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:10.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b960d7da80 con 0x55b960d645d0 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.731+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854018070 con 0x55b960d645d0 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f485402e930 con 0x55b960d645d0 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 10 client.16215 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 20 client.16215 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960d7ee90 0x55b960d81280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 4 client.16215 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b960cd7860 con 0x55b960d7ee90 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.732+0000 7f485ffff640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960d7ee90 0x55b960d81280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.733+0000 7f483ffff640 10 client.16215 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:10.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.733+0000 7f485ffff640 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960d7ee90 0x55b960d81280 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2fc36b8ccec47db server_cookie=57c2462c48126efb in_seq=0 out_seq=0 2024-09-12T02:33:10.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.733+0000 7f483ffff640 1 -- 172.21.15.1:0/1810484059 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b960cd7860 con 0x55b960d7ee90 2024-09-12T02:33:10.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.733+0000 7f483ffff640 10 client.16215 handle_command_reply: tid=0 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.733+0000 7f486903a740 1 client.16215 shutdown 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 msgr2=0x55b960d6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4854006f40 tx=0x7f4854013730 comp rx=0 tx=0).stop 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 shutdown_connections 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960d7ee90 0x55b960d81280 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d6c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d6bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 --2- 172.21.15.1:0/1810484059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d6ed40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f483ffff640 0 client.16215 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 >> 172.21.15.1:0/1810484059 conn(0x55b960d2d310 msgr2=0x55b960d66930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 shutdown_connections 2024-09-12T02:33:10.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 1 -- 172.21.15.1:0/1810484059 wait complete. 2024-09-12T02:33:10.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.734+0000 7f486903a740 20 client.16215 trim_cache size 0 max 16384 2024-09-12T02:33:10.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.762+0000 7f486903a740 1 Processor -- start 2024-09-12T02:33:10.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.762+0000 7f486903a740 1 -- start start 2024-09-12T02:33:10.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 0x55b960d60e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48601af7f0 con 0x55b960d65b40 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48601b1330 con 0x55b960d645d0 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f486903a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f48601afec0 con 0x55b960d6f370 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39296/0 (socket says 172.21.15.1:39296) 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 -- 172.21.15.1:0/2616614141 learned_addr learned my addr 172.21.15.1:0/2616614141 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f48649fd640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 0x55b960d60e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 -- 172.21.15.1:0/2616614141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 msgr2=0x55b960d868e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f48651fe640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d868e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 -- 172.21.15.1:0/2616614141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 msgr2=0x55b960d60e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 0x55b960d60e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 -- 172.21.15.1:0/2616614141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b960d61960 con 0x55b960d65b40 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f48651fe640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d868e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f48649fd640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 0x55b960d60e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.763+0000 7f485ffff640 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f484c0b8b40 tx=0x7f484c0ed2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f542cf0c154c2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.764+0000 7f484a7fc640 1 -- 172.21.15.1:0/2616614141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c049040 con 0x55b960d65b40 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.764+0000 7f484a7fc640 1 -- 172.21.15.1:0/2616614141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f484c0bc170 con 0x55b960d65b40 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.764+0000 7f484a7fc640 1 -- 172.21.15.1:0/2616614141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0b87e0 con 0x55b960d65b40 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.764+0000 7f486903a740 1 -- 172.21.15.1:0/2616614141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 msgr2=0x55b960d7b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.764+0000 7f486903a740 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f484c0b8b40 tx=0x7f484c0ed2e0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 -- 172.21.15.1:0/2616614141 shutdown_connections 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d65b40 0x55b960d7b340 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d868e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 --2- 172.21.15.1:0/2616614141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d645d0 0x55b960d60e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 -- 172.21.15.1:0/2616614141 >> 172.21.15.1:0/2616614141 conn(0x55b960d2d310 msgr2=0x55b960d60700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 -- 172.21.15.1:0/2616614141 shutdown_connections 2024-09-12T02:33:10.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 -- 172.21.15.1:0/2616614141 wait complete. 2024-09-12T02:33:10.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 -- start start 2024-09-12T02:33:10.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.765+0000 7f486903a740 1 Processor -- start 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d68280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48601b0c60 con 0x55b960d645d0 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48601b0590 con 0x55b960d65b40 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f48601ad7d0 con 0x55b960d6f370 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f486903a740 10 client.0 _ll_register_callbacks cb 0x7f48540076d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39304/0 (socket says 172.21.15.1:39304) 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 -- 172.21.15.1:0/4253520762 learned_addr learned my addr 172.21.15.1:0/4253520762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f485ffff640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48651fe640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d68280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 -- 172.21.15.1:0/4253520762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 msgr2=0x55b960d68280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d68280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 -- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 msgr2=0x55b960d779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d779f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.766+0000 7f48649fd640 1 -- 172.21.15.1:0/4253520762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b960d69e90 con 0x55b960d645d0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f48649fd640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4854004810 tx=0x7f485401cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845c84b09aa6ffd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f483ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540137a0 con 0x55b960d645d0 2024-09-12T02:33:10.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f485402e430 con 0x55b960d645d0 2024-09-12T02:33:10.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f484c0bc170 con 0x55b960d645d0 2024-09-12T02:33:10.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f485402e630 con 0x55b960d645d0 2024-09-12T02:33:10.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f486903a740 10 client.16221 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:10.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b960de8c00 con 0x55b960d645d0 2024-09-12T02:33:10.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.767+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854018040 con 0x55b960d645d0 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f485403a850 con 0x55b960d645d0 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 10 client.16221 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 20 client.16221 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960de9350 0x55b960deb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:10.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 4 client.16221 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:10.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f484c0bc170 con 0x55b960de9350 2024-09-12T02:33:10.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f485ffff640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960de9350 0x55b960deb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f485ffff640 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960de9350 0x55b960deb770 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0eb6552f8fe89a server_cookie=861de4f810d3bbb in_seq=0 out_seq=0 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f483ffff640 10 client.16221 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f483ffff640 1 -- 172.21.15.1:0/4253520762 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f484c0bc170 con 0x55b960de9350 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f483ffff640 10 client.16221 handle_command_reply: tid=0 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.768+0000 7f486903a740 1 client.16221 shutdown 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 msgr2=0x55b960d774b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4854004810 tx=0x7f485401cef0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 shutdown_connections 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55b960de9350 0x55b960deb770 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b960d6f370 0x55b960d68280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b960d65b40 0x55b960d779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 --2- 172.21.15.1:0/4253520762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b960d645d0 0x55b960d774b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f483ffff640 0 client.16221 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 >> 172.21.15.1:0/4253520762 conn(0x55b960d2d310 msgr2=0x55b960d66110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 shutdown_connections 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 1 -- 172.21.15.1:0/4253520762 wait complete. 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.769+0000 7f486903a740 20 client.16221 trim_cache size 0 max 16384 2024-09-12T02:33:10.777 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 msgr2=0x7f48500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 0x7f48500a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f485800aeb0 tx=0x7f485800a4d0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 msgr2=0x7f486019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f484c005ab0 tx=0x7f484c0042f0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 shutdown_connections 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f48500a2b80 0x7f48500a5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4860102790 0x7f486019abd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860106f10 0x7f486019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 --2- 172.21.15.1:0/4247920438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4860101de0 0x7f486019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:10.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 >> 172.21.15.1:0/4247920438 conn(0x7f48600fd880 msgr2=0x7f48600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:10.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 shutdown_connections 2024-09-12T02:33:10.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:10.770+0000 7f4866c61640 1 -- 172.21.15.1:0/4247920438 wait complete. 2024-09-12T02:33:12.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:11 smithi001 ceph-mon[31252]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T02:33:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:11 smithi134 ceph-mon[35091]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T02:33:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:11 smithi173 ceph-mon[35036]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T02:33:12.521 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T02:33:12.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T02:33:12.795 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 -- 172.21.15.1:0/3342178250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930102ef0 msgr2=0x7f293010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 --2- 172.21.15.1:0/3342178250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930102ef0 0x7f293010da40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2928009ca0 tx=0x7f292802a950 comp rx=0 tx=0).stop 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 -- 172.21.15.1:0/3342178250 shutdown_connections 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 --2- 172.21.15.1:0/3342178250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930102ef0 0x7f293010da40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 --2- 172.21.15.1:0/3342178250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 0x7f29301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 --2- 172.21.15.1:0/3342178250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930100e20 0x7f2930101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 -- 172.21.15.1:0/3342178250 >> 172.21.15.1:0/3342178250 conn(0x7f29300fc7d0 msgr2=0x7f29300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 -- 172.21.15.1:0/3342178250 shutdown_connections 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.308+0000 7f2937729640 1 -- 172.21.15.1:0/3342178250 wait complete. 2024-09-12T02:33:13.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 Processor -- start 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 -- start start 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 0x7f2930199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 0x7f29301a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2930110f80 con 0x7f2930100e20 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2930110e00 con 0x7f2930102570 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2937729640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2930111100 con 0x7f2930102ef0 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f29354c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f29354c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59680/0 (socket says 172.21.15.1:59680) 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f29354c5640 1 -- 172.21.15.1:0/429560500 learned_addr learned my addr 172.21.15.1:0/429560500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2934cc4640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 0x7f2930199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f2935cc6640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 0x7f29301a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f29354c5640 1 -- 172.21.15.1:0/429560500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 msgr2=0x7f29301a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.309+0000 7f29354c5640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 0x7f29301a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29354c5640 1 -- 172.21.15.1:0/429560500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 msgr2=0x7f2930199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29354c5640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 0x7f2930199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29354c5640 1 -- 172.21.15.1:0/429560500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29301a4880 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f2935cc6640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 0x7f29301a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29354c5640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c970 tx=0x7f292c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29267fc640 1 -- 172.21.15.1:0/429560500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c007bb0 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29267fc640 1 -- 172.21.15.1:0/429560500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f292c007d50 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301a4a50 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f29267fc640 1 -- 172.21.15.1:0/429560500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c00f450 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.310+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301a4f10 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.312+0000 7f29267fc640 1 -- 172.21.15.1:0/429560500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f292c005020 con 0x7f2930100e20 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 Processor -- start 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 -- start start 2024-09-12T02:33:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55872e71f280 con 0x55872e7c9150 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55872e6c6b10 con 0x55872e7b9a40 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f2939b02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55872e71b240 con 0x55872e7ba360 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.313+0000 7f29267fc640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 0x7f291c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2935cc6640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 0x7f291c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59694/0 (socket says 172.21.15.1:59694) 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 -- 172.21.15.1:0/2755635329 learned_addr learned my addr 172.21.15.1:0/2755635329 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f29267fc640 1 -- 172.21.15.1:0/429560500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f292c0cee50 con 0x7f2930100e20 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2935cc6640 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f29354c5640 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 -- 172.21.15.1:0/2755635329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 msgr2=0x55872e7c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 -- 172.21.15.1:0/2755635329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 msgr2=0x55872e7b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 -- 172.21.15.1:0/2755635329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872e6d31f0 con 0x55872e7c9150 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2935cc6640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 0x7f291c0a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2928006010 tx=0x7f2928009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f2934cc4640 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f292000ab70 tx=0x7f292000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a681f0e79fd8d167 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f291b7fe640 1 -- 172.21.15.1:0/2755635329 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292001d070 con 0x55872e7c9150 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f291b7fe640 1 -- 172.21.15.1:0/2755635329 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2920018920 con 0x55872e7c9150 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.314+0000 7f291b7fe640 1 -- 172.21.15.1:0/2755635329 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200108f0 con 0x55872e7c9150 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 -- 172.21.15.1:0/2755635329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 msgr2=0x55872e7cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f292000ab70 tx=0x7f292000af70 comp rx=0 tx=0).stop 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 -- 172.21.15.1:0/2755635329 shutdown_connections 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7cb540 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 --2- 172.21.15.1:0/2755635329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 -- 172.21.15.1:0/2755635329 >> 172.21.15.1:0/2755635329 conn(0x55872e7b60f0 msgr2=0x55872e7b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 -- 172.21.15.1:0/2755635329 shutdown_connections 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.315+0000 7f2939b02740 1 -- 172.21.15.1:0/2755635329 wait complete. 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 -- start start 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 Processor -- start 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7c9150 0x55872e7c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55872e7cbd20 con 0x55872e7b9a40 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55872e6d9f10 con 0x55872e7c9150 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55872e7cbea0 con 0x55872e7ba360 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2939b02740 10 client.0 _ll_register_callbacks cb 0x55872e6a2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f29354c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f29354c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59696/0 (socket says 172.21.15.1:59696) 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f29354c5640 1 -- 172.21.15.1:0/760736255 learned_addr learned my addr 172.21.15.1:0/760736255 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.316+0000 7f2934cc4640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2935cc6640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7c9150 0x55872e7c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 -- 172.21.15.1:0/760736255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 msgr2=0x55872e7c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 -- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7c9150 msgr2=0x55872e7c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7c9150 0x55872e7c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 -- 172.21.15.1:0/760736255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872e4906a0 con 0x55872e7b9a40 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2934cc4640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f29354c5640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f292c0058c0 tx=0x7f292c09aff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f1211c33a58c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c01d040 con 0x55872e7b9a40 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f292c099990 con 0x55872e7b9a40 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2920018920 con 0x55872e7b9a40 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f292c0860c0 con 0x55872e7b9a40 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2939b02740 10 client.16233 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55872e7d79d0 con 0x55872e7b9a40 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.317+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2920018920 con 0x55872e7b9a40 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f292c0ab590 con 0x55872e7b9a40 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 10 client.16233 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 20 client.16233 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e7d8e30 0x55872e7db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 4 client.16233 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55872e72c7f0 con 0x55872e7d8e30 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.318+0000 7f2934cc4640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e7d8e30 0x55872e7db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2918ff9640 10 client.16233 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2934cc4640 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e7d8e30 0x55872e7db2a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82c54eaec479709 server_cookie=cdd89fc2da625b01 in_seq=0 out_seq=0 2024-09-12T02:33:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2918ff9640 1 -- 172.21.15.1:0/760736255 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55872e72c7f0 con 0x55872e7d8e30 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2918ff9640 10 client.16233 handle_command_reply: tid=0 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2939b02740 1 client.16233 shutdown 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 msgr2=0x55872e7c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f292c0058c0 tx=0x7f292c09aff0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 shutdown_connections 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.319+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e7d8e30 0x55872e7db2a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2918ff9640 0 client.16233 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7c9150 0x55872e7c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7ba360 0x55872e7c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 --2- 172.21.15.1:0/760736255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7b9a40 0x55872e7c6040 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 >> 172.21.15.1:0/760736255 conn(0x55872e7b60f0 msgr2=0x55872e7bbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 shutdown_connections 2024-09-12T02:33:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 1 -- 172.21.15.1:0/760736255 wait complete. 2024-09-12T02:33:13.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.320+0000 7f2939b02740 20 client.16233 trim_cache size 0 max 16384 2024-09-12T02:33:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 Processor -- start 2024-09-12T02:33:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 -- start start 2024-09-12T02:33:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7b9a40 0x55872e7e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7ba360 0x55872e7e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f29301ab380 con 0x55872e7c9150 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29301acec0 con 0x55872e7ba360 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.338+0000 7f2939b02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29301aba50 con 0x55872e7b9a40 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59712/0 (socket says 172.21.15.1:59712) 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 -- 172.21.15.1:0/3860965131 learned_addr learned my addr 172.21.15.1:0/3860965131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f29354c5640 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7b9a40 0x55872e7e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2934cc4640 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7ba360 0x55872e7e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 -- 172.21.15.1:0/3860965131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7b9a40 msgr2=0x55872e7e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7b9a40 0x55872e7e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 -- 172.21.15.1:0/3860965131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7ba360 msgr2=0x55872e7e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7ba360 0x55872e7e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 -- 172.21.15.1:0/3860965131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872e7ba880 con 0x55872e7c9150 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f2935cc6640 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f292802fd80 tx=0x7f292802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52eb969f062e429d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f291affd640 1 -- 172.21.15.1:0/3860965131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928034040 con 0x55872e7c9150 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f291affd640 1 -- 172.21.15.1:0/3860965131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2928003e50 con 0x55872e7c9150 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.339+0000 7f291affd640 1 -- 172.21.15.1:0/3860965131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2928004860 con 0x55872e7c9150 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 -- 172.21.15.1:0/3860965131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 msgr2=0x55872e7c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f292802fd80 tx=0x7f292802a950 comp rx=0 tx=0).stop 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 -- 172.21.15.1:0/3860965131 shutdown_connections 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7c9150 0x55872e7c32c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7ba360 0x55872e7e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 --2- 172.21.15.1:0/3860965131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7b9a40 0x55872e7e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 -- 172.21.15.1:0/3860965131 >> 172.21.15.1:0/3860965131 conn(0x55872e7b60f0 msgr2=0x55872e7b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 -- 172.21.15.1:0/3860965131 shutdown_connections 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.340+0000 7f2939b02740 1 -- 172.21.15.1:0/3860965131 wait complete. 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 -- start start 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 Processor -- start 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7c9150 0x55872e7ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f29301ac7f0 con 0x55872e7ba360 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29301ac120 con 0x55872e7b9a40 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29301a9360 con 0x55872e7c9150 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2939b02740 10 client.0 _ll_register_callbacks cb 0x7f292c00c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2934cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2934cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59728/0 (socket says 172.21.15.1:59728) 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.341+0000 7f2934cc4640 1 -- 172.21.15.1:0/1606749624 learned_addr learned my addr 172.21.15.1:0/1606749624 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f29354c5640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2935cc6640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7c9150 0x55872e7ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 -- 172.21.15.1:0/1606749624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7c9150 msgr2=0x55872e7ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7c9150 0x55872e7ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 -- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 msgr2=0x55872e7d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 -- 172.21.15.1:0/1606749624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872e7b5f20 con 0x55872e7ba360 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2934cc4640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f292000ab70 tx=0x7f29200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eebd1985c6c636c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920031030 con 0x55872e7ba360 2024-09-12T02:33:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2928003e50 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.342+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2920018b50 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f292001d040 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 10 client.16239 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55872e844300 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2928003e50 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29200053d0 con 0x55872e7ba360 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 10 client.16239 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 20 client.16239 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e8447a0 0x55872e846b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 4 client.16239 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55872e726d00 con 0x55872e8447a0 2024-09-12T02:33:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.343+0000 7f29354c5640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e8447a0 0x55872e846b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.344+0000 7f29354c5640 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e8447a0 0x55872e846b90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9ef83602f78d540 server_cookie=1b7baa0ab9c32606 in_seq=0 out_seq=0 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.344+0000 7f2918ff9640 10 client.16239 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2918ff9640 1 -- 172.21.15.1:0/1606749624 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55872e726d00 con 0x55872e8447a0 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2918ff9640 10 client.16239 handle_command_reply: tid=0 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 client.16239 shutdown 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 msgr2=0x55872e7d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f292000ab70 tx=0x7f29200058a0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 shutdown_connections 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55872e7ba360 0x55872e7d1850 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x55872e8447a0 0x55872e846b90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55872e7c9150 0x55872e7ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 --2- 172.21.15.1:0/1606749624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55872e7b9a40 0x55872e7d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2918ff9640 0 client.16239 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 >> 172.21.15.1:0/1606749624 conn(0x55872e7b60f0 msgr2=0x55872e7d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 shutdown_connections 2024-09-12T02:33:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 1 -- 172.21.15.1:0/1606749624 wait complete. 2024-09-12T02:33:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.345+0000 7f2939b02740 20 client.16239 trim_cache size 0 max 16384 2024-09-12T02:33:13.356 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:13.356 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-12T02:33:13.357 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "56d55ba6-e7aa-4c66-8060-acceb9aa2abe", 2024-09-12T02:33:13.357 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-12T02:33:13.357 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 msgr2=0x7f291c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 0x7f291c0a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2928006010 tx=0x7f2928009880 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 msgr2=0x7f29301992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c970 tx=0x7f292c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 shutdown_connections 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f291c0a2b80 0x7f291c0a5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2930102ef0 0x7f29301a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2930102570 0x7f2930199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 --2- 172.21.15.1:0/429560500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2930100e20 0x7f29301992c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 >> 172.21.15.1:0/429560500 conn(0x7f29300fc7d0 msgr2=0x7f2930105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 shutdown_connections 2024-09-12T02:33:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:13.346+0000 7f2937729640 1 -- 172.21.15.1:0/429560500 wait complete. 2024-09-12T02:33:14.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:13 smithi001 ceph-mon[31252]: pgmap v411: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-12T02:33:14.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:13 smithi134 ceph-mon[35091]: pgmap v411: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-12T02:33:14.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:13 smithi173 ceph-mon[35036]: pgmap v411: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-12T02:33:14.314 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:33:14.589 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:15.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:14 smithi001 ceph-mon[31252]: scrub queued for path: / 2024-09-12T02:33:15.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:14 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:14 smithi001 ceph-mon[31252]: scrub summary: active paths [/] 2024-09-12T02:33:15.011 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:14 smithi001 ceph-mon[31252]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 -- 172.21.15.1:0/2113484656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 msgr2=0x7f5f50103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 --2- 172.21.15.1:0/2113484656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f50103110 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009930 tx=0x7f5f4002a420 comp rx=0 tx=0).stop 2024-09-12T02:33:15.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 -- 172.21.15.1:0/2113484656 shutdown_connections 2024-09-12T02:33:15.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 --2- 172.21.15.1:0/2113484656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 0x7f5f5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 --2- 172.21.15.1:0/2113484656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 0x7f5f50107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 --2- 172.21.15.1:0/2113484656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f50103110 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 -- 172.21.15.1:0/2113484656 >> 172.21.15.1:0/2113484656 conn(0x7f5f500fc7d0 msgr2=0x7f5f500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 -- 172.21.15.1:0/2113484656 shutdown_connections 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.100+0000 7f5f54a04640 1 -- 172.21.15.1:0/2113484656 wait complete. 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 Processor -- start 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 -- start start 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 0x7f5f50198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 0x7f5f5019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501120a0 con 0x7f5f50102d30 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50111f20 con 0x7f5f501036e0 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f54a04640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50112220 con 0x7f5f501082a0 2024-09-12T02:33:15.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59734/0 (socket says 172.21.15.1:59734) 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f4e59c640 1 -- 172.21.15.1:0/299531932 learned_addr learned my addr 172.21.15.1:0/299531932 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.101+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 0x7f5f50198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 0x7f5f5019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 -- 172.21.15.1:0/299531932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 msgr2=0x7f5f5019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 0x7f5f5019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 -- 172.21.15.1:0/299531932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 msgr2=0x7f5f50198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 0x7f5f50198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 -- 172.21.15.1:0/299531932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5019d570 con 0x7f5f50102d30 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009230 tx=0x7f5f40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f477fe640 1 -- 172.21.15.1:0/299531932 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4003f030 con 0x7f5f50102d30 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f477fe640 1 -- 172.21.15.1:0/299531932 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f40003ad0 con 0x7f5f50102d30 2024-09-12T02:33:15.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5019d800 con 0x7f5f50102d30 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f477fe640 1 -- 172.21.15.1:0/299531932 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40035070 con 0x7f5f50102d30 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.102+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f501a5140 con 0x7f5f50102d30 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f477fe640 1 -- 172.21.15.1:0/299531932 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5f40042030 con 0x7f5f50102d30 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 Processor -- start 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 -- start start 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b316fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b316542e0 con 0x559b316ee4a0 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559b315fbce0 con 0x559b316eedc0 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b316502a0 con 0x559b316f9680 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.105+0000 7f5f477fe640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 0x7f5f3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59746/0 (socket says 172.21.15.1:59746) 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/2473431547 learned_addr learned my addr 172.21.15.1:0/2473431547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 0x7f5f3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b316fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f477fe640 1 -- 172.21.15.1:0/299531932 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5f400ef550 con 0x7f5f50102d30 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/2473431547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 msgr2=0x559b316fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b316fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/2473431547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 msgr2=0x559b316f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/2473431547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b315e0440 con 0x559b316ee4a0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5f48012c50 tx=0x7f5f48010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5b9f427524ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 0x7f5f3c0a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f48010c40 tx=0x7f5f48017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.106+0000 7f5f44ff9640 1 -- 172.21.15.1:0/2473431547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48012e00 con 0x559b316ee4a0 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f44ff9640 1 -- 172.21.15.1:0/2473431547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f48009be0 con 0x559b316ee4a0 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f44ff9640 1 -- 172.21.15.1:0/2473431547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48005390 con 0x559b316ee4a0 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 -- 172.21.15.1:0/2473431547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 msgr2=0x559b316ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5f48012c50 tx=0x7f5f48010740 comp rx=0 tx=0).stop 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 -- 172.21.15.1:0/2473431547 shutdown_connections 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b316fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/2473431547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b316ee880 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 -- 172.21.15.1:0/2473431547 >> 172.21.15.1:0/2473431547 conn(0x559b316eaa30 msgr2=0x559b316eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 -- 172.21.15.1:0/2473431547 shutdown_connections 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.107+0000 7f5f56ddd740 1 -- 172.21.15.1:0/2473431547 wait complete. 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 -- start start 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 Processor -- start 2024-09-12T02:33:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316f9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b316fc250 con 0x559b316f9680 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559b3160f050 con 0x559b316eedc0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b316fc3d0 con 0x559b316ee4a0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f56ddd740 10 client.0 _ll_register_callbacks cb 0x559b3164f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59748/0 (socket says 172.21.15.1:59748) 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/997855208 learned_addr learned my addr 172.21.15.1:0/997855208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.108+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/997855208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 msgr2=0x559b316f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 msgr2=0x559b316f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 -- 172.21.15.1:0/997855208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b313c53c0 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800ce70 tx=0x7f5f48009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19da567e3360183d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4802b030 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5f480049e0 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f48009be0 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f48036070 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f56ddd740 10 client.16251 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.109+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b31707c40 con 0x559b316f9680 2024-09-12T02:33:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f48009be0 con 0x559b316f9680 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f480324d0 con 0x559b316f9680 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 10 client.16251 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 20 client.16251 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b3170b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 4 client.16251 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b31661850 con 0x559b31709050 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.110+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b3170b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f35ffb640 10 client.16251 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b3170b440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48996e5cffd4cef3 server_cookie=150f8d318bbf7c10 in_seq=0 out_seq=0 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f35ffb640 1 -- 172.21.15.1:0/997855208 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b31661850 con 0x559b31709050 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f35ffb640 10 client.16251 handle_command_reply: tid=0 2024-09-12T02:33:15.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f56ddd740 1 client.16251 shutdown 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 msgr2=0x559b316f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.111+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800ce70 tx=0x7f5f48009d90 comp rx=0 tx=0).stop 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 shutdown_connections 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316f6840 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b3170b440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f35ffb640 0 client.16251 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/997855208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 >> 172.21.15.1:0/997855208 conn(0x559b316eaa30 msgr2=0x559b316e9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 shutdown_connections 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 1 -- 172.21.15.1:0/997855208 wait complete. 2024-09-12T02:33:15.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.112+0000 7f5f56ddd740 20 client.16251 trim_cache size 0 max 16384 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.149+0000 7f5f56ddd740 1 Processor -- start 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.149+0000 7f5f56ddd740 1 -- start start 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b31710aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b31710fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501ad720 con 0x559b316ee4a0 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501af260 con 0x559b316eedc0 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501addf0 con 0x559b316f9680 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59752/0 (socket says 172.21.15.1:59752) 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 -- 172.21.15.1:0/1407878787 learned_addr learned my addr 172.21.15.1:0/1407878787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b31710aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b31710fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 -- 172.21.15.1:0/1407878787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 msgr2=0x559b31710fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b31710fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 -- 172.21.15.1:0/1407878787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 msgr2=0x559b31710aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b31710aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4e59c640 1 -- 172.21.15.1:0/1407878787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b316f9380 con 0x559b316ee4a0 2024-09-12T02:33:15.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.150+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b31710aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.151+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009a50 tx=0x7f5f40086a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fa93a15bfc0623 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.151+0000 7f5f37fff640 1 -- 172.21.15.1:0/1407878787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40049040 con 0x559b316ee4a0 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.151+0000 7f5f37fff640 1 -- 172.21.15.1:0/1407878787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f400bc490 con 0x559b316ee4a0 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.151+0000 7f5f37fff640 1 -- 172.21.15.1:0/1407878787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4003b460 con 0x559b316ee4a0 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- 172.21.15.1:0/1407878787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 msgr2=0x559b317054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009a50 tx=0x7f5f40086a10 comp rx=0 tx=0).stop 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- 172.21.15.1:0/1407878787 shutdown_connections 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316f9680 0x559b31710fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b31710aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/1407878787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316ee4a0 0x559b317054b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- 172.21.15.1:0/1407878787 >> 172.21.15.1:0/1407878787 conn(0x559b316eaa30 msgr2=0x559b316f53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- 172.21.15.1:0/1407878787 shutdown_connections 2024-09-12T02:33:15.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- 172.21.15.1:0/1407878787 wait complete. 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 -- start start 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.152+0000 7f5f56ddd740 1 Processor -- start 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316fd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501aeb90 con 0x559b316f9680 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501ae4c0 con 0x559b316eedc0 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501ab700 con 0x559b316ee4a0 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f56ddd740 10 client.0 _ll_register_callbacks cb 0x7f5f400b8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.1:48350/0 (socket says 172.21.15.1:48350) 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4dd9b640 1 -- 172.21.15.1:0/4046316712 learned_addr learned my addr 172.21.15.1:0/4046316712 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 -- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 msgr2=0x559b316fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 -- 172.21.15.1:0/4046316712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 msgr2=0x559b316fdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316fdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4e59c640 1 -- 172.21.15.1:0/4046316712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b31772bd0 con 0x559b316ee4a0 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:15.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.153+0000 7f5f4ed9d640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316fdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f4e59c640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316fd520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f400bbf50 tx=0x7f5f400bbd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7753e7566ddee05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40049040 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f5f4003b460 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f400bc490 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f400c4a00 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 10 client.25636 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b31773ea0 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f400bc490 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f40031bd0 con 0x559b316ee4a0 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 10 client.25636 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 20 client.25636 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:15.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b31776340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 4 client.25636 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.154+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b3165bd60 con 0x559b31709050 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.155+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b31776340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.155+0000 7f5f35ffb640 10 client.25636 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.155+0000 7f5f4dd9b640 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b31776340 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f33a5387279e05a6 server_cookie=bb429f3938c088b in_seq=0 out_seq=0 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.155+0000 7f5f35ffb640 1 -- 172.21.15.1:0/4046316712 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559b3165bd60 con 0x559b31709050 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.155+0000 7f5f35ffb640 10 client.25636 handle_command_reply: tid=0 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 client.25636 shutdown 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 msgr2=0x559b316fd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316fd520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f400bbf50 tx=0x7f5f400bbd90 comp rx=0 tx=0).stop 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 shutdown_connections 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b316f9680 0x559b316fdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x559b31709050 0x559b31776340 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559b316eedc0 0x559b316fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f35ffb640 0 client.25636 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 --2- 172.21.15.1:0/4046316712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b316ee4a0 0x559b316fd520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 >> 172.21.15.1:0/4046316712 conn(0x559b316eaa30 msgr2=0x559b316f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 shutdown_connections 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 1 -- 172.21.15.1:0/4046316712 wait complete. 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.156+0000 7f5f56ddd740 20 client.25636 trim_cache size 0 max 16384 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "56d55ba6-e7aa-4c66-8060-acceb9aa2abe": { 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "56d55ba6-e7aa-4c66-8060-acceb9aa2abe", 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:15.162 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:33:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:14 smithi134 ceph-mon[35091]: scrub queued for path: / 2024-09-12T02:33:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:14 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:14 smithi134 ceph-mon[35091]: scrub summary: active paths [/] 2024-09-12T02:33:15.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:14 smithi134 ceph-mon[35091]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 msgr2=0x7f5f3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 0x7f5f3c0a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f48010c40 tx=0x7f5f48017000 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 msgr2=0x7f5f501985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009230 tx=0x7f5f40004270 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 shutdown_connections 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f5f3c0a2b80 0x7f5f3c0a5040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f501082a0 0x7f5f5019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f501036e0 0x7f5f50198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 --2- 172.21.15.1:0/299531932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f50102d30 0x7f5f501985c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 >> 172.21.15.1:0/299531932 conn(0x7f5f500fc7d0 msgr2=0x7f5f50105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 shutdown_connections 2024-09-12T02:33:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:15.157+0000 7f5f54a04640 1 -- 172.21.15.1:0/299531932 wait complete. 2024-09-12T02:33:15.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:14 smithi173 ceph-mon[35036]: scrub queued for path: / 2024-09-12T02:33:15.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:14 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:14 smithi173 ceph-mon[35036]: scrub summary: active paths [/] 2024-09-12T02:33:15.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:14 smithi173 ceph-mon[35036]: scrub summary: idle+waiting paths [/] 2024-09-12T02:33:15.910 INFO:tasks.cephfs.filesystem:scrub status for tag:56d55ba6-e7aa-4c66-8060-acceb9aa2abe - {'path': '/', 'tag': '56d55ba6-e7aa-4c66-8060-acceb9aa2abe', 'options': 'recursive,force'} 2024-09-12T02:33:16.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:15 smithi001 ceph-mon[31252]: pgmap v412: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 13 op/s 2024-09-12T02:33:16.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:15 smithi134 ceph-mon[35091]: pgmap v412: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 13 op/s 2024-09-12T02:33:16.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:15 smithi173 ceph-mon[35036]: pgmap v412: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 13 op/s 2024-09-12T02:33:16.449 INFO:tasks.workunit.client.0.smithi001.stdout:setting up random write file 2024-09-12T02:33:16.449 INFO:tasks.workunit.client.0.smithi001.stdout:done setting up random write file 2024-09-12T02:33:16.449 INFO:tasks.workunit.client.0.smithi001.stdout:starting fsync run 2024-09-12T02:33:16.449 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0074s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0048s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0039s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0061s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0043s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-12T02:33:16.450 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0045s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0048s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0040s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0039s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-12T02:33:16.451 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0061s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0048s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0003s fsync time: 0.0053s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 13.2571s fsync time: 0.0056s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.452 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:write time: 0.0002s fsync time: 0.0041s 2024-09-12T02:33:16.453 INFO:tasks.workunit.client.0.smithi001.stdout:run done 48 fsyncs total, killing random writer 2024-09-12T02:33:16.456 INFO:tasks.workunit.client.0.smithi001.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T02:33:16.457 INFO:tasks.workunit.client.0.smithi001.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T02:33:16.457 INFO:tasks.workunit.client.0.smithi001.stderr:+ whereis lsof 2024-09-12T02:33:16.501 INFO:tasks.workunit.client.0.smithi001.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-12T02:33:16.501 INFO:tasks.workunit.client.0.smithi001.stderr:+ lsof 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3eac0a170ec7f1154d4131a3a29869a126ac0dcdce1578a83affa6669ac44d58/merged 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d711ad58cd80ea7f0c8c2a88ae85b3682b61accd4ba964e1680afb298cf67922/merged 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/132b429ba2006be94d5b2864a4982eeb7b6352937de487f1dd70cc525d6e1e08/merged 2024-09-12T02:33:16.517 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a33d5db6c98c6ac8dab5e10e9e93c3c458834d50a07a12a940ce9fcdf9d63e95/merged 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/4f3cc111a21a4bdf78dca1ca28cd7d4a1c1068f8a3713e6ecee13fe5fe929abf/merged 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3431e203ee7236d39d1c32ba5f925951466dd7e20aad000714946b08384a8852/merged 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/9e15b8ef979f317092d58815163a0231e8de8424995e397066af99220d1c2f75/merged 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/632365bcb811aa44b2fa287d7adb5e8bcb585f2f8f8c15cf13a743c9c0679eb4/merged 2024-09-12T02:33:16.523 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.524 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/85017547f2667589eabe009f8021486174c26768d13fca5081d97d3f734d6a78/merged 2024-09-12T02:33:16.524 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.524 INFO:tasks.workunit.client.0.smithi001.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a0f0f03d5a1e64e65aae8718e0d12443c80d0333d55b001cf766abed72205669/merged 2024-09-12T02:33:16.524 INFO:tasks.workunit.client.0.smithi001.stderr: Output information may be incomplete. 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-12T02:33:16.576 INFO:tasks.workunit.client.0.smithi001.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-12T02:33:16.577 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-12T02:33:16.578 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-12T02:33:16.579 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-12T02:33:16.580 INFO:tasks.workunit.client.0.smithi001.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-12T02:33:16.581 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-12T02:33:16.582 INFO:tasks.workunit.client.0.smithi001.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-12T02:33:16.583 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-12T02:33:16.584 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-12T02:33:16.585 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-12T02:33:16.586 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-12T02:33:16.587 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-12T02:33:16.588 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-12T02:33:16.589 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-12T02:33:16.590 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-12T02:33:16.591 INFO:tasks.workunit.client.0.smithi001.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-12T02:33:16.592 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-12T02:33:16.593 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-12T02:33:16.594 INFO:tasks.workunit.client.0.smithi001.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-12T02:33:16.595 INFO:tasks.workunit.client.0.smithi001.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-12T02:33:16.596 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-12T02:33:16.597 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:watchdogd 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:watchdogd 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:watchdogd 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:watchdogd 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-12T02:33:16.598 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kswapd0 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kswapd0 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kswapd0 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kswapd0 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 102 root cwd unknown /proc/102/cwd (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 102 root rtd unknown /proc/102/root (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 102 root txt unknown /proc/102/exe (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 102 root NOFD /proc/102/fd (opendir: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-12T02:33:16.599 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-12T02:33:16.600 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 117 root cwd unknown /proc/117/cwd (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 117 root rtd unknown /proc/117/root (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 117 root txt unknown /proc/117/exe (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 117 root NOFD /proc/117/fd (opendir: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 126 root cwd unknown /proc/126/cwd (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 126 root rtd unknown /proc/126/root (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 126 root txt unknown /proc/126/exe (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 126 root NOFD /proc/126/fd (opendir: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-09-12T02:33:16.601 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 240 root cwd unknown /proc/240/cwd (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 240 root rtd unknown /proc/240/root (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 240 root txt unknown /proc/240/exe (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 240 root NOFD /proc/240/fd (opendir: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 279 root cwd unknown /proc/279/cwd (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 279 root rtd unknown /proc/279/root (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 279 root txt unknown /proc/279/exe (readlink: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 279 root NOFD /proc/279/fd (opendir: Permission denied) 2024-09-12T02:33:16.602 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 285 root cwd unknown /proc/285/cwd (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 285 root rtd unknown /proc/285/root (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 285 root txt unknown /proc/285/exe (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 285 root NOFD /proc/285/fd (opendir: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 291 root cwd unknown /proc/291/cwd (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 291 root rtd unknown /proc/291/root (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 291 root txt unknown /proc/291/exe (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 291 root NOFD /proc/291/fd (opendir: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 296 root cwd unknown /proc/296/cwd (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 296 root rtd unknown /proc/296/root (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 296 root txt unknown /proc/296/exe (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 296 root NOFD /proc/296/fd (opendir: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 359 root cwd unknown /proc/359/cwd (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 359 root rtd unknown /proc/359/root (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 359 root txt unknown /proc/359/exe (readlink: Permission denied) 2024-09-12T02:33:16.603 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 359 root NOFD /proc/359/fd (opendir: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 421 root cwd unknown /proc/421/cwd (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 421 root rtd unknown /proc/421/root (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 421 root txt unknown /proc/421/exe (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 421 root NOFD /proc/421/fd (opendir: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 422 root cwd unknown /proc/422/cwd (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 422 root rtd unknown /proc/422/root (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 422 root txt unknown /proc/422/exe (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 422 root NOFD /proc/422/fd (opendir: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 423 root cwd unknown /proc/423/cwd (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 423 root rtd unknown /proc/423/root (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 423 root txt unknown /proc/423/exe (readlink: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 423 root NOFD /proc/423/fd (opendir: Permission denied) 2024-09-12T02:33:16.604 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 424 root cwd unknown /proc/424/cwd (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 424 root rtd unknown /proc/424/root (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 424 root txt unknown /proc/424/exe (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 424 root NOFD /proc/424/fd (opendir: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 425 root cwd unknown /proc/425/cwd (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 425 root rtd unknown /proc/425/root (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 425 root txt unknown /proc/425/exe (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 425 root NOFD /proc/425/fd (opendir: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_0 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-09-12T02:33:16.605 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_0 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_0 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_0 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_1 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_1 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_1 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_1 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-12T02:33:16.606 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_2 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_2 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_2 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_2 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_3 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_3 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_3 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_3 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-12T02:33:16.607 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_4 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_4 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_4 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_4 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_5 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_5 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_5 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-12T02:33:16.608 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_5 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_6 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_6 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_6 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_6 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-12T02:33:16.609 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_7 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_7 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_7 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_7 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_8 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_8 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_8 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_8 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-12T02:33:16.610 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_9 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_9 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_9 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:scsi_eh_9 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-09-12T02:33:16.611 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:jbd2/sda1 500 root cwd unknown /proc/500/cwd (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:jbd2/sda1 500 root rtd unknown /proc/500/root (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:jbd2/sda1 500 root txt unknown /proc/500/exe (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:jbd2/sda1 500 root NOFD /proc/500/fd (opendir: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 501 root cwd unknown /proc/501/cwd (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 501 root rtd unknown /proc/501/root (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 501 root txt unknown /proc/501/exe (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 501 root NOFD /proc/501/fd (opendir: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-j 578 root cwd unknown /proc/578/cwd (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-j 578 root rtd unknown /proc/578/root (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-j 578 root txt unknown /proc/578/exe (readlink: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-j 578 root NOFD /proc/578/fd (opendir: Permission denied) 2024-09-12T02:33:16.612 INFO:tasks.workunit.client.0.smithi001.stdout:ext4lazyi 584 root cwd unknown /proc/584/cwd (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:ext4lazyi 584 root rtd unknown /proc/584/root (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:ext4lazyi 584 root txt unknown /proc/584/exe (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:ext4lazyi 584 root NOFD /proc/584/fd (opendir: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 589 root cwd unknown /proc/589/cwd (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 589 root rtd unknown /proc/589/root (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 589 root txt unknown /proc/589/exe (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 589 root NOFD /proc/589/fd (opendir: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-u 599 root cwd unknown /proc/599/cwd (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-u 599 root rtd unknown /proc/599/root (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-u 599 root txt unknown /proc/599/exe (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-u 599 root NOFD /proc/599/fd (opendir: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 600 root cwd unknown /proc/600/cwd (readlink: Permission denied) 2024-09-12T02:33:16.613 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 600 root rtd unknown /proc/600/root (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 600 root txt unknown /proc/600/exe (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 600 root NOFD /proc/600/fd (opendir: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 649 root cwd unknown /proc/649/cwd (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 649 root rtd unknown /proc/649/root (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 649 root txt unknown /proc/649/exe (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 649 root NOFD /proc/649/fd (opendir: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kipmi0 658 root cwd unknown /proc/658/cwd (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kipmi0 658 root rtd unknown /proc/658/root (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kipmi0 658 root txt unknown /proc/658/exe (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kipmi0 658 root NOFD /proc/658/fd (opendir: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:rpcbind 672 rpc cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:rpcbind 672 rpc rtd unknown /proc/672/root (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:rpcbind 672 rpc txt unknown /proc/672/exe (readlink: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:rpcbind 672 rpc NOFD /proc/672/fd (opendir: Permission denied) 2024-09-12T02:33:16.614 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 677 root cwd unknown /proc/677/cwd (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 677 root rtd unknown /proc/677/root (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 677 root txt unknown /proc/677/exe (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 677 root NOFD /proc/677/fd (opendir: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 678 root cwd unknown /proc/678/cwd (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 678 root rtd unknown /proc/678/root (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 678 root txt unknown /proc/678/exe (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 678 root NOFD /proc/678/fd (opendir: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 root cwd unknown /proc/679/cwd (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 root rtd unknown /proc/679/root (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 root txt unknown /proc/679/exe (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 root NOFD /proc/679/fd (opendir: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 680 auditd root cwd unknown /proc/679/task/680/cwd (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 680 auditd root rtd unknown /proc/679/task/680/root (readlink: Permission denied) 2024-09-12T02:33:16.615 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 680 auditd root txt unknown /proc/679/task/680/exe (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 680 auditd root NOFD /proc/679/task/680/fd (opendir: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 682 auditd root cwd unknown /proc/679/task/682/cwd (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 682 auditd root rtd unknown /proc/679/task/682/root (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 682 auditd root txt unknown /proc/679/task/682/exe (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:auditd 679 682 auditd root NOFD /proc/679/task/682/fd (opendir: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:sedispatc 681 root cwd unknown /proc/681/cwd (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:sedispatc 681 root rtd unknown /proc/681/root (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:sedispatc 681 root txt unknown /proc/681/exe (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:sedispatc 681 root NOFD /proc/681/fd (opendir: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 725 dbus cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 725 dbus rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 725 dbus txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-12T02:33:16.616 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 725 dbus NOFD /proc/725/fd (opendir: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 726 dbus cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 726 dbus rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 726 dbus txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:dbus-brok 726 dbus NOFD /proc/726/fd (opendir: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 root cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 root rtd unknown /proc/727/root (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 root txt unknown /proc/727/exe (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 root NOFD /proc/727/fd (opendir: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 744 gmain root cwd unknown /proc/727/task/744/cwd (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 744 gmain root rtd unknown /proc/727/task/744/root (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 744 gmain root txt unknown /proc/727/task/744/exe (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 744 gmain root NOFD /proc/727/task/744/fd (opendir: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 745 gdbus root cwd unknown /proc/727/task/745/cwd (readlink: Permission denied) 2024-09-12T02:33:16.617 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 745 gdbus root rtd unknown /proc/727/task/745/root (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 745 gdbus root txt unknown /proc/727/task/745/exe (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:NetworkMa 727 745 gdbus root NOFD /proc/727/task/745/fd (opendir: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 737 gmain root cwd unknown /proc/730/task/737/cwd (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 737 gmain root rtd unknown /proc/730/task/737/root (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 737 gmain root txt unknown /proc/730/task/737/exe (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:irqbalanc 730 737 gmain root NOFD /proc/730/task/737/fd (opendir: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:lsmd 731 libstoragemgmt cwd unknown /proc/731/cwd (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:lsmd 731 libstoragemgmt rtd unknown /proc/731/root (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:lsmd 731 libstoragemgmt txt unknown /proc/731/exe (readlink: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:lsmd 731 libstoragemgmt NOFD /proc/731/fd (opendir: Permission denied) 2024-09-12T02:33:16.618 INFO:tasks.workunit.client.0.smithi001.stdout:mcelog 732 root cwd unknown /proc/732/cwd (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:mcelog 732 root rtd unknown /proc/732/root (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:mcelog 732 root txt unknown /proc/732/exe (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:mcelog 732 root NOFD /proc/732/fd (opendir: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:smartd 733 root cwd unknown /proc/733/cwd (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:smartd 733 root rtd unknown /proc/733/root (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:smartd 733 root txt unknown /proc/733/exe (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:smartd 733 root NOFD /proc/733/fd (opendir: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-l 735 root cwd unknown /proc/735/cwd (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-l 735 root rtd unknown /proc/735/root (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-l 735 root txt unknown /proc/735/exe (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:systemd-l 735 root NOFD /proc/735/fd (opendir: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 768 root cwd unknown /proc/768/cwd (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 768 root rtd unknown /proc/768/root (readlink: Permission denied) 2024-09-12T02:33:16.619 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 768 root txt unknown /proc/768/exe (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 768 root NOFD /proc/768/fd (opendir: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 root cwd unknown /proc/783/cwd (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 root rtd unknown /proc/783/root (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 root txt unknown /proc/783/exe (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 root NOFD /proc/783/fd (opendir: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 784 gssproxy root cwd unknown /proc/783/task/784/cwd (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 784 gssproxy root rtd unknown /proc/783/task/784/root (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 784 gssproxy root txt unknown /proc/783/task/784/exe (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 784 gssproxy root NOFD /proc/783/task/784/fd (opendir: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 785 gssproxy root cwd unknown /proc/783/task/785/cwd (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 785 gssproxy root rtd unknown /proc/783/task/785/root (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 785 gssproxy root txt unknown /proc/783/task/785/exe (readlink: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 785 gssproxy root NOFD /proc/783/task/785/fd (opendir: Permission denied) 2024-09-12T02:33:16.620 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 786 gssproxy root cwd unknown /proc/783/task/786/cwd (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 786 gssproxy root rtd unknown /proc/783/task/786/root (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 786 gssproxy root txt unknown /proc/783/task/786/exe (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 786 gssproxy root NOFD /proc/783/task/786/fd (opendir: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 787 gssproxy root cwd unknown /proc/783/task/787/cwd (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 787 gssproxy root rtd unknown /proc/783/task/787/root (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 787 gssproxy root txt unknown /proc/783/task/787/exe (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 787 gssproxy root NOFD /proc/783/task/787/fd (opendir: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 788 gssproxy root cwd unknown /proc/783/task/788/cwd (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 788 gssproxy root rtd unknown /proc/783/task/788/root (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 788 gssproxy root txt unknown /proc/783/task/788/exe (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:gssproxy 783 788 gssproxy root NOFD /proc/783/task/788/fd (opendir: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:atd 790 root cwd unknown /proc/790/cwd (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:atd 790 root rtd unknown /proc/790/root (readlink: Permission denied) 2024-09-12T02:33:16.621 INFO:tasks.workunit.client.0.smithi001.stdout:atd 790 root txt unknown /proc/790/exe (readlink: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:atd 790 root NOFD /proc/790/fd (opendir: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:crond 792 root cwd unknown /proc/792/cwd (readlink: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:crond 792 root rtd unknown /proc/792/root (readlink: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:crond 792 root txt unknown /proc/792/exe (readlink: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:crond 792 root NOFD /proc/792/fd (opendir: Permission denied) 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu cwd DIR 8,1 4096 2 / 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-12T02:33:16.622 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-12T02:33:16.623 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 1u unix 0x0000000000000000 0t0 19859 type=STREAM (CONNECTED) 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 2u unix 0x0000000000000000 0t0 19859 type=STREAM (CONNECTED) 2024-09-12T02:33:16.624 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 3u unix 0x0000000000000000 0t0 19887 type=DGRAM (CONNECTED) 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 4u a_inode 0,14 0 1085 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 5u a_inode 0,14 0 1085 [signalfd] 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 6r a_inode 0,14 0 1085 inotify 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 7r DIR 0,25 0 3047 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 8u a_inode 0,14 0 1085 [timerfd] 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 9u a_inode 0,14 0 1085 [eventpoll:10,13] 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 10r REG 0,20 0 19876 /proc/820/mountinfo 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 11r a_inode 0,14 0 1085 inotify 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 12u unix 0x0000000000000000 0t0 19909 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 13r a_inode 0,14 0 1085 inotify 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 15u netlink 0t0 19891 KOBJECT_UEVENT 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 16u unix 0x0000000000000000 0t0 19896 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-12T02:33:16.625 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 17u unix 0x0000000000000000 0t0 19897 type=DGRAM (CONNECTED) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 18u unix 0x0000000000000000 0t0 19898 type=DGRAM (CONNECTED) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 19u unix 0x0000000000000000 0t0 19899 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 20u unix 0x0000000000000000 0t0 19901 type=STREAM (CONNECTED) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 820 ubuntu 21u a_inode 0,14 0 1085 [timerfd] 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 822 ubuntu cwd unknown /proc/822/cwd (readlink: Permission denied) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 822 ubuntu rtd unknown /proc/822/root (readlink: Permission denied) 2024-09-12T02:33:16.626 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 822 ubuntu txt unknown /proc/822/exe (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 822 ubuntu NOFD /proc/822/fd (opendir: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:nrpe 1027 nrpe cwd unknown /proc/1027/cwd (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:nrpe 1027 nrpe rtd unknown /proc/1027/root (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:nrpe 1027 nrpe txt unknown /proc/1027/exe (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:nrpe 1027 nrpe NOFD /proc/1027/fd (opendir: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 root cwd unknown /proc/1318/cwd (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 root rtd unknown /proc/1318/root (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 root txt unknown /proc/1318/exe (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 root NOFD /proc/1318/fd (opendir: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1327 in:imjour root cwd unknown /proc/1318/task/1327/cwd (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1327 in:imjour root rtd unknown /proc/1318/task/1327/root (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1327 in:imjour root txt unknown /proc/1318/task/1327/exe (readlink: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1327 in:imjour root NOFD /proc/1318/task/1327/fd (opendir: Permission denied) 2024-09-12T02:33:16.627 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1328 rs:main root cwd unknown /proc/1318/task/1328/cwd (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1328 rs:main root rtd unknown /proc/1318/task/1328/root (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1328 rs:main root txt unknown /proc/1318/task/1328/exe (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:rsyslogd 1318 1328 rs:main root NOFD /proc/1318/task/1328/fd (opendir: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1491 root cwd unknown /proc/1491/cwd (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1491 root rtd unknown /proc/1491/root (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1491 root txt unknown /proc/1491/exe (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1491 root NOFD /proc/1491/fd (opendir: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1492 root cwd unknown /proc/1492/cwd (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1492 root rtd unknown /proc/1492/root (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1492 root txt unknown /proc/1492/exe (readlink: Permission denied) 2024-09-12T02:33:16.628 INFO:tasks.workunit.client.0.smithi001.stdout:agetty 1492 root NOFD /proc/1492/fd (opendir: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 18679 root cwd unknown /proc/18679/cwd (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 18679 root rtd unknown /proc/18679/root (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 18679 root txt unknown /proc/18679/exe (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 18679 root NOFD /proc/18679/fd (opendir: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 polkitd cwd unknown /proc/19242/cwd (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 polkitd rtd unknown /proc/19242/root (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 polkitd txt unknown /proc/19242/exe (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 polkitd NOFD /proc/19242/fd (opendir: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19244 gmain polkitd cwd unknown /proc/19242/task/19244/cwd (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19244 gmain polkitd rtd unknown /proc/19242/task/19244/root (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19244 gmain polkitd txt unknown /proc/19242/task/19244/exe (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19244 gmain polkitd NOFD /proc/19242/task/19244/fd (opendir: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19245 gdbus polkitd cwd unknown /proc/19242/task/19245/cwd (readlink: Permission denied) 2024-09-12T02:33:16.629 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19245 gdbus polkitd rtd unknown /proc/19242/task/19245/root (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19245 gdbus polkitd txt unknown /proc/19242/task/19245/exe (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19245 gdbus polkitd NOFD /proc/19242/task/19245/fd (opendir: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19246 JS\x20Hel polkitd cwd unknown /proc/19242/task/19246/cwd (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19246 JS\x20Hel polkitd rtd unknown /proc/19242/task/19246/root (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19246 JS\x20Hel polkitd txt unknown /proc/19242/task/19246/exe (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19246 JS\x20Hel polkitd NOFD /proc/19242/task/19246/fd (opendir: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19247 JS\x20Hel polkitd cwd unknown /proc/19242/task/19247/cwd (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19247 JS\x20Hel polkitd rtd unknown /proc/19242/task/19247/root (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19247 JS\x20Hel polkitd txt unknown /proc/19242/task/19247/exe (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19247 JS\x20Hel polkitd NOFD /proc/19242/task/19247/fd (opendir: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19248 JS\x20Hel polkitd cwd unknown /proc/19242/task/19248/cwd (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19248 JS\x20Hel polkitd rtd unknown /proc/19242/task/19248/root (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19248 JS\x20Hel polkitd txt unknown /proc/19242/task/19248/exe (readlink: Permission denied) 2024-09-12T02:33:16.630 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19248 JS\x20Hel polkitd NOFD /proc/19242/task/19248/fd (opendir: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19249 JS\x20Hel polkitd cwd unknown /proc/19242/task/19249/cwd (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19249 JS\x20Hel polkitd rtd unknown /proc/19242/task/19249/root (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19249 JS\x20Hel polkitd txt unknown /proc/19242/task/19249/exe (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19249 JS\x20Hel polkitd NOFD /proc/19242/task/19249/fd (opendir: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19250 JS\x20Hel polkitd cwd unknown /proc/19242/task/19250/cwd (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19250 JS\x20Hel polkitd rtd unknown /proc/19242/task/19250/root (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19250 JS\x20Hel polkitd txt unknown /proc/19242/task/19250/exe (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19250 JS\x20Hel polkitd NOFD /proc/19242/task/19250/fd (opendir: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19251 JS\x20Hel polkitd cwd unknown /proc/19242/task/19251/cwd (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19251 JS\x20Hel polkitd rtd unknown /proc/19242/task/19251/root (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19251 JS\x20Hel polkitd txt unknown /proc/19242/task/19251/exe (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19251 JS\x20Hel polkitd NOFD /proc/19242/task/19251/fd (opendir: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19252 JS\x20Hel polkitd cwd unknown /proc/19242/task/19252/cwd (readlink: Permission denied) 2024-09-12T02:33:16.631 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19252 JS\x20Hel polkitd rtd unknown /proc/19242/task/19252/root (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19252 JS\x20Hel polkitd txt unknown /proc/19242/task/19252/exe (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19252 JS\x20Hel polkitd NOFD /proc/19242/task/19252/fd (opendir: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19253 JS\x20Hel polkitd cwd unknown /proc/19242/task/19253/cwd (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19253 JS\x20Hel polkitd rtd unknown /proc/19242/task/19253/root (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19253 JS\x20Hel polkitd txt unknown /proc/19242/task/19253/exe (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19253 JS\x20Hel polkitd NOFD /proc/19242/task/19253/fd (opendir: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19254 polkitd polkitd cwd unknown /proc/19242/task/19254/cwd (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19254 polkitd polkitd rtd unknown /proc/19242/task/19254/root (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19254 polkitd polkitd txt unknown /proc/19242/task/19254/exe (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:polkitd 19242 19254 polkitd polkitd NOFD /proc/19242/task/19254/fd (opendir: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21149 root cwd unknown /proc/21149/cwd (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21149 root rtd unknown /proc/21149/root (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21149 root txt unknown /proc/21149/exe (readlink: Permission denied) 2024-09-12T02:33:16.632 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21149 root NOFD /proc/21149/fd (opendir: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21178 root cwd unknown /proc/21178/cwd (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21178 root rtd unknown /proc/21178/root (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21178 root txt unknown /proc/21178/exe (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21178 root NOFD /proc/21178/fd (opendir: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21207 root cwd unknown /proc/21207/cwd (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21207 root rtd unknown /proc/21207/root (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21207 root txt unknown /proc/21207/exe (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21207 root NOFD /proc/21207/fd (opendir: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21236 root cwd unknown /proc/21236/cwd (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21236 root rtd unknown /proc/21236/root (readlink: Permission denied) 2024-09-12T02:33:16.633 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21236 root txt unknown /proc/21236/exe (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21236 root NOFD /proc/21236/fd (opendir: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21265 root cwd unknown /proc/21265/cwd (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21265 root rtd unknown /proc/21265/root (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21265 root txt unknown /proc/21265/exe (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21265 root NOFD /proc/21265/fd (opendir: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21429 root cwd unknown /proc/21429/cwd (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21429 root rtd unknown /proc/21429/root (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21429 root txt unknown /proc/21429/exe (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21429 root NOFD /proc/21429/fd (opendir: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21430 root cwd unknown /proc/21430/cwd (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21430 root rtd unknown /proc/21430/root (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21430 root txt unknown /proc/21430/exe (readlink: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21430 root NOFD /proc/21430/fd (opendir: Permission denied) 2024-09-12T02:33:16.634 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21431 root cwd unknown /proc/21431/cwd (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21431 root rtd unknown /proc/21431/root (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21431 root txt unknown /proc/21431/exe (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21431 root NOFD /proc/21431/fd (opendir: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21432 root cwd unknown /proc/21432/cwd (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21432 root rtd unknown /proc/21432/root (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21432 root txt unknown /proc/21432/exe (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21432 root NOFD /proc/21432/fd (opendir: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21433 root cwd unknown /proc/21433/cwd (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21433 root rtd unknown /proc/21433/root (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21433 root txt unknown /proc/21433/exe (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21433 root NOFD /proc/21433/fd (opendir: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21434 root cwd unknown /proc/21434/cwd (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21434 root rtd unknown /proc/21434/root (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21434 root txt unknown /proc/21434/exe (readlink: Permission denied) 2024-09-12T02:33:16.635 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21434 root NOFD /proc/21434/fd (opendir: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21435 root cwd unknown /proc/21435/cwd (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21435 root rtd unknown /proc/21435/root (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21435 root txt unknown /proc/21435/exe (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21435 root NOFD /proc/21435/fd (opendir: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21436 root cwd unknown /proc/21436/cwd (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21436 root rtd unknown /proc/21436/root (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21436 root txt unknown /proc/21436/exe (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21436 root NOFD /proc/21436/fd (opendir: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21437 root cwd unknown /proc/21437/cwd (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21437 root rtd unknown /proc/21437/root (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21437 root txt unknown /proc/21437/exe (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 21437 root NOFD /proc/21437/fd (opendir: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:xfsaild/d 21438 root cwd unknown /proc/21438/cwd (readlink: Permission denied) 2024-09-12T02:33:16.636 INFO:tasks.workunit.client.0.smithi001.stdout:xfsaild/d 21438 root rtd unknown /proc/21438/root (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:xfsaild/d 21438 root txt unknown /proc/21438/exe (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:xfsaild/d 21438 root NOFD /proc/21438/fd (opendir: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22370 root cwd unknown /proc/22370/cwd (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22370 root rtd unknown /proc/22370/root (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22370 root txt unknown /proc/22370/exe (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22370 root NOFD /proc/22370/fd (opendir: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22373 ubuntu cwd unknown /proc/22373/cwd (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22373 ubuntu rtd unknown /proc/22373/root (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22373 ubuntu txt unknown /proc/22373/exe (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 22373 ubuntu NOFD /proc/22373/fd (opendir: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:chronyd 22433 chrony cwd unknown /proc/22433/cwd (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:chronyd 22433 chrony rtd unknown /proc/22433/root (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:chronyd 22433 chrony txt unknown /proc/22433/exe (readlink: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:chronyd 22433 chrony NOFD /proc/22433/fd (opendir: Permission denied) 2024-09-12T02:33:16.637 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-cras 22738 ceph cwd unknown /proc/22738/cwd (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-cras 22738 ceph rtd unknown /proc/22738/root (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-cras 22738 ceph txt unknown /proc/22738/exe (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-cras 22738 ceph NOFD /proc/22738/fd (opendir: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 23264 root cwd unknown /proc/23264/cwd (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 23264 root rtd unknown /proc/23264/root (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 23264 root txt unknown /proc/23264/exe (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 23264 root NOFD /proc/23264/fd (opendir: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24751 root cwd unknown /proc/24751/cwd (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24751 root rtd unknown /proc/24751/root (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24751 root txt unknown /proc/24751/exe (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24751 root NOFD /proc/24751/fd (opendir: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24752 root cwd unknown /proc/24752/cwd (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24752 root rtd unknown /proc/24752/root (readlink: Permission denied) 2024-09-12T02:33:16.638 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24752 root txt unknown /proc/24752/exe (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 24752 root NOFD /proc/24752/fd (opendir: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26045 root cwd unknown /proc/26045/cwd (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26045 root rtd unknown /proc/26045/root (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26045 root txt unknown /proc/26045/exe (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26045 root NOFD /proc/26045/fd (opendir: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26047 root cwd unknown /proc/26047/cwd (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26047 root rtd unknown /proc/26047/root (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26047 root txt unknown /proc/26047/exe (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 26047 root NOFD /proc/26047/fd (opendir: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 27342 root cwd unknown /proc/27342/cwd (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 27342 root rtd unknown /proc/27342/root (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 27342 root txt unknown /proc/27342/exe (readlink: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 27342 root NOFD /proc/27342/fd (opendir: Permission denied) 2024-09-12T02:33:16.639 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30237 root cwd unknown /proc/30237/cwd (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30237 root rtd unknown /proc/30237/root (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30237 root txt unknown /proc/30237/exe (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30237 root NOFD /proc/30237/fd (opendir: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30254 root cwd unknown /proc/30254/cwd (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30254 root rtd unknown /proc/30254/root (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30254 root txt unknown /proc/30254/exe (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30254 root NOFD /proc/30254/fd (opendir: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30255 root cwd unknown /proc/30255/cwd (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30255 root rtd unknown /proc/30255/root (readlink: Permission denied) 2024-09-12T02:33:16.640 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30255 root txt unknown /proc/30255/exe (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 30255 root NOFD /proc/30255/fd (opendir: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30272 root cwd unknown /proc/30272/cwd (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30272 root rtd unknown /proc/30272/root (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30272 root txt unknown /proc/30272/exe (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 30272 root NOFD /proc/30272/fd (opendir: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 30528 root cwd unknown /proc/30528/cwd (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 30528 root rtd unknown /proc/30528/root (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 30528 root txt unknown /proc/30528/exe (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 30528 root NOFD /proc/30528/fd (opendir: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31248 root cwd unknown /proc/31248/cwd (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31248 root rtd unknown /proc/31248/root (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31248 root txt unknown /proc/31248/exe (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31248 root NOFD /proc/31248/fd (opendir: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31250 root cwd unknown /proc/31250/cwd (readlink: Permission denied) 2024-09-12T02:33:16.641 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31250 root rtd unknown /proc/31250/root (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31250 root txt unknown /proc/31250/exe (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31250 root NOFD /proc/31250/fd (opendir: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 ceph cwd unknown /proc/31252/cwd (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 ceph rtd unknown /proc/31252/root (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 ceph txt unknown /proc/31252/exe (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 ceph NOFD /proc/31252/fd (opendir: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31253 log ceph cwd unknown /proc/31252/task/31253/cwd (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31253 log ceph rtd unknown /proc/31252/task/31253/root (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31253 log ceph txt unknown /proc/31252/task/31253/exe (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31253 log ceph NOFD /proc/31252/task/31253/fd (opendir: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31254 service ceph cwd unknown /proc/31252/task/31254/cwd (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31254 service ceph rtd unknown /proc/31252/task/31254/root (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31254 service ceph txt unknown /proc/31252/task/31254/exe (readlink: Permission denied) 2024-09-12T02:33:16.642 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31254 service ceph NOFD /proc/31252/task/31254/fd (opendir: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31255 admin_soc ceph cwd unknown /proc/31252/task/31255/cwd (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31255 admin_soc ceph rtd unknown /proc/31252/task/31255/root (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31255 admin_soc ceph txt unknown /proc/31252/task/31255/exe (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31255 admin_soc ceph NOFD /proc/31252/task/31255/fd (opendir: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31256 signal_ha ceph cwd unknown /proc/31252/task/31256/cwd (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31256 signal_ha ceph rtd unknown /proc/31252/task/31256/root (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31256 signal_ha ceph txt unknown /proc/31252/task/31256/exe (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31256 signal_ha ceph NOFD /proc/31252/task/31256/fd (opendir: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31257 rocksdb:l ceph cwd unknown /proc/31252/task/31257/cwd (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31257 rocksdb:l ceph rtd unknown /proc/31252/task/31257/root (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31257 rocksdb:l ceph txt unknown /proc/31252/task/31257/exe (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31257 rocksdb:l ceph NOFD /proc/31252/task/31257/fd (opendir: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31258 rocksdb:h ceph cwd unknown /proc/31252/task/31258/cwd (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31258 rocksdb:h ceph rtd unknown /proc/31252/task/31258/root (readlink: Permission denied) 2024-09-12T02:33:16.643 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31258 rocksdb:h ceph txt unknown /proc/31252/task/31258/exe (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31258 rocksdb:h ceph NOFD /proc/31252/task/31258/fd (opendir: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31274 ceph-mon ceph cwd unknown /proc/31252/task/31274/cwd (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31274 ceph-mon ceph rtd unknown /proc/31252/task/31274/root (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31274 ceph-mon ceph txt unknown /proc/31252/task/31274/exe (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31274 ceph-mon ceph NOFD /proc/31252/task/31274/fd (opendir: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31275 fn_monsto ceph cwd unknown /proc/31252/task/31275/cwd (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31275 fn_monsto ceph rtd unknown /proc/31252/task/31275/root (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31275 fn_monsto ceph txt unknown /proc/31252/task/31275/exe (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31275 fn_monsto ceph NOFD /proc/31252/task/31275/fd (opendir: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31276 msgr-work ceph cwd unknown /proc/31252/task/31276/cwd (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31276 msgr-work ceph rtd unknown /proc/31252/task/31276/root (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31276 msgr-work ceph txt unknown /proc/31252/task/31276/exe (readlink: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31276 msgr-work ceph NOFD /proc/31252/task/31276/fd (opendir: Permission denied) 2024-09-12T02:33:16.644 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31277 msgr-work ceph cwd unknown /proc/31252/task/31277/cwd (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31277 msgr-work ceph rtd unknown /proc/31252/task/31277/root (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31277 msgr-work ceph txt unknown /proc/31252/task/31277/exe (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31277 msgr-work ceph NOFD /proc/31252/task/31277/fd (opendir: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31278 msgr-work ceph cwd unknown /proc/31252/task/31278/cwd (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31278 msgr-work ceph rtd unknown /proc/31252/task/31278/root (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31278 msgr-work ceph txt unknown /proc/31252/task/31278/exe (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31278 msgr-work ceph NOFD /proc/31252/task/31278/fd (opendir: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31279 OpHistory ceph cwd unknown /proc/31252/task/31279/cwd (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31279 OpHistory ceph rtd unknown /proc/31252/task/31279/root (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31279 OpHistory ceph txt unknown /proc/31252/task/31279/exe (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31279 OpHistory ceph NOFD /proc/31252/task/31279/fd (opendir: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31280 fin ceph cwd unknown /proc/31252/task/31280/cwd (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31280 fin ceph rtd unknown /proc/31252/task/31280/root (readlink: Permission denied) 2024-09-12T02:33:16.645 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31280 fin ceph txt unknown /proc/31252/task/31280/exe (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31280 fin ceph NOFD /proc/31252/task/31280/fd (opendir: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31281 safe_time ceph cwd unknown /proc/31252/task/31281/cwd (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31281 safe_time ceph rtd unknown /proc/31252/task/31281/root (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31281 safe_time ceph txt unknown /proc/31252/task/31281/exe (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31281 safe_time ceph NOFD /proc/31252/task/31281/fd (opendir: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31282 cpu_tp ceph cwd unknown /proc/31252/task/31282/cwd (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31282 cpu_tp ceph rtd unknown /proc/31252/task/31282/root (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31282 cpu_tp ceph txt unknown /proc/31252/task/31282/exe (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31282 cpu_tp ceph NOFD /proc/31252/task/31282/fd (opendir: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31283 cpu_tp ceph cwd unknown /proc/31252/task/31283/cwd (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31283 cpu_tp ceph rtd unknown /proc/31252/task/31283/root (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31283 cpu_tp ceph txt unknown /proc/31252/task/31283/exe (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31283 cpu_tp ceph NOFD /proc/31252/task/31283/fd (opendir: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31284 cpu_tp ceph cwd unknown /proc/31252/task/31284/cwd (readlink: Permission denied) 2024-09-12T02:33:16.646 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31284 cpu_tp ceph rtd unknown /proc/31252/task/31284/root (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31284 cpu_tp ceph txt unknown /proc/31252/task/31284/exe (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31284 cpu_tp ceph NOFD /proc/31252/task/31284/fd (opendir: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31285 cpu_tp ceph cwd unknown /proc/31252/task/31285/cwd (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31285 cpu_tp ceph rtd unknown /proc/31252/task/31285/root (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31285 cpu_tp ceph txt unknown /proc/31252/task/31285/exe (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31285 cpu_tp ceph NOFD /proc/31252/task/31285/fd (opendir: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31286 ms_dispat ceph cwd unknown /proc/31252/task/31286/cwd (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31286 ms_dispat ceph rtd unknown /proc/31252/task/31286/root (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31286 ms_dispat ceph txt unknown /proc/31252/task/31286/exe (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31286 ms_dispat ceph NOFD /proc/31252/task/31286/fd (opendir: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31287 ms_local ceph cwd unknown /proc/31252/task/31287/cwd (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31287 ms_local ceph rtd unknown /proc/31252/task/31287/root (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31287 ms_local ceph txt unknown /proc/31252/task/31287/exe (readlink: Permission denied) 2024-09-12T02:33:16.647 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31287 ms_local ceph NOFD /proc/31252/task/31287/fd (opendir: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31288 safe_time ceph cwd unknown /proc/31252/task/31288/cwd (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31288 safe_time ceph rtd unknown /proc/31252/task/31288/root (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31288 safe_time ceph txt unknown /proc/31252/task/31288/exe (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31288 safe_time ceph NOFD /proc/31252/task/31288/fd (opendir: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31289 ms_dispat ceph cwd unknown /proc/31252/task/31289/cwd (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31289 ms_dispat ceph rtd unknown /proc/31252/task/31289/root (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31289 ms_dispat ceph txt unknown /proc/31252/task/31289/exe (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31289 ms_dispat ceph NOFD /proc/31252/task/31289/fd (opendir: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31290 ms_local ceph cwd unknown /proc/31252/task/31290/cwd (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31290 ms_local ceph rtd unknown /proc/31252/task/31290/root (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31290 ms_local ceph txt unknown /proc/31252/task/31290/exe (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 31290 ms_local ceph NOFD /proc/31252/task/31290/fd (opendir: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 67145 rstore_co ceph cwd unknown /proc/31252/task/67145/cwd (readlink: Permission denied) 2024-09-12T02:33:16.648 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 67145 rstore_co ceph rtd unknown /proc/31252/task/67145/root (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 67145 rstore_co ceph txt unknown /proc/31252/task/67145/exe (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mon 31252 67145 rstore_co ceph NOFD /proc/31252/task/67145/fd (opendir: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31476 root cwd unknown /proc/31476/cwd (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31476 root rtd unknown /proc/31476/root (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31476 root txt unknown /proc/31476/exe (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 31476 root NOFD /proc/31476/fd (opendir: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31478 root cwd unknown /proc/31478/cwd (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31478 root rtd unknown /proc/31478/root (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31478 root txt unknown /proc/31478/exe (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 31478 root NOFD /proc/31478/fd (opendir: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 ceph cwd unknown /proc/31480/cwd (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 ceph rtd unknown /proc/31480/root (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 ceph txt unknown /proc/31480/exe (readlink: Permission denied) 2024-09-12T02:33:16.649 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 ceph NOFD /proc/31480/fd (opendir: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33562 log ceph cwd unknown /proc/31480/task/33562/cwd (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33562 log ceph rtd unknown /proc/31480/task/33562/root (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33562 log ceph txt unknown /proc/31480/task/33562/exe (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33562 log ceph NOFD /proc/31480/task/33562/fd (opendir: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33564 msgr-work ceph cwd unknown /proc/31480/task/33564/cwd (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33564 msgr-work ceph rtd unknown /proc/31480/task/33564/root (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33564 msgr-work ceph txt unknown /proc/31480/task/33564/exe (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33564 msgr-work ceph NOFD /proc/31480/task/33564/fd (opendir: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33565 msgr-work ceph cwd unknown /proc/31480/task/33565/cwd (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33565 msgr-work ceph rtd unknown /proc/31480/task/33565/root (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33565 msgr-work ceph txt unknown /proc/31480/task/33565/exe (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33565 msgr-work ceph NOFD /proc/31480/task/33565/fd (opendir: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33566 msgr-work ceph cwd unknown /proc/31480/task/33566/cwd (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33566 msgr-work ceph rtd unknown /proc/31480/task/33566/root (readlink: Permission denied) 2024-09-12T02:33:16.650 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33566 msgr-work ceph txt unknown /proc/31480/task/33566/exe (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33566 msgr-work ceph NOFD /proc/31480/task/33566/fd (opendir: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33570 service ceph cwd unknown /proc/31480/task/33570/cwd (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33570 service ceph rtd unknown /proc/31480/task/33570/root (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33570 service ceph txt unknown /proc/31480/task/33570/exe (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33570 service ceph NOFD /proc/31480/task/33570/fd (opendir: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33571 admin_soc ceph cwd unknown /proc/31480/task/33571/cwd (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33571 admin_soc ceph rtd unknown /proc/31480/task/33571/root (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33571 admin_soc ceph txt unknown /proc/31480/task/33571/exe (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33571 admin_soc ceph NOFD /proc/31480/task/33571/fd (opendir: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33572 ceph_time ceph cwd unknown /proc/31480/task/33572/cwd (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33572 ceph_time ceph rtd unknown /proc/31480/task/33572/root (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33572 ceph_time ceph txt unknown /proc/31480/task/33572/exe (readlink: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33572 ceph_time ceph NOFD /proc/31480/task/33572/fd (opendir: Permission denied) 2024-09-12T02:33:16.651 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33573 fn_anonym ceph cwd unknown /proc/31480/task/33573/cwd (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33573 fn_anonym ceph rtd unknown /proc/31480/task/33573/root (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33573 fn_anonym ceph txt unknown /proc/31480/task/33573/exe (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33573 fn_anonym ceph NOFD /proc/31480/task/33573/fd (opendir: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33574 signal_ha ceph cwd unknown /proc/31480/task/33574/cwd (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33574 signal_ha ceph rtd unknown /proc/31480/task/33574/root (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33574 signal_ha ceph txt unknown /proc/31480/task/33574/exe (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33574 signal_ha ceph NOFD /proc/31480/task/33574/fd (opendir: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33575 mgrsb-fin ceph cwd unknown /proc/31480/task/33575/cwd (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33575 mgrsb-fin ceph rtd unknown /proc/31480/task/33575/root (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33575 mgrsb-fin ceph txt unknown /proc/31480/task/33575/exe (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33575 mgrsb-fin ceph NOFD /proc/31480/task/33575/fd (opendir: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33576 ms_dispat ceph cwd unknown /proc/31480/task/33576/cwd (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33576 ms_dispat ceph rtd unknown /proc/31480/task/33576/root (readlink: Permission denied) 2024-09-12T02:33:16.652 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33576 ms_dispat ceph txt unknown /proc/31480/task/33576/exe (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33576 ms_dispat ceph NOFD /proc/31480/task/33576/fd (opendir: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33577 ms_local ceph cwd unknown /proc/31480/task/33577/cwd (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33577 ms_local ceph rtd unknown /proc/31480/task/33577/root (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33577 ms_local ceph txt unknown /proc/31480/task/33577/exe (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33577 ms_local ceph NOFD /proc/31480/task/33577/fd (opendir: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33578 io_contex ceph cwd unknown /proc/31480/task/33578/cwd (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33578 io_contex ceph rtd unknown /proc/31480/task/33578/root (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33578 io_contex ceph txt unknown /proc/31480/task/33578/exe (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33578 io_contex ceph NOFD /proc/31480/task/33578/fd (opendir: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33579 io_contex ceph cwd unknown /proc/31480/task/33579/cwd (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33579 io_contex ceph rtd unknown /proc/31480/task/33579/root (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33579 io_contex ceph txt unknown /proc/31480/task/33579/exe (readlink: Permission denied) 2024-09-12T02:33:16.653 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33579 io_contex ceph NOFD /proc/31480/task/33579/fd (opendir: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33580 safe_time ceph cwd unknown /proc/31480/task/33580/cwd (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33580 safe_time ceph rtd unknown /proc/31480/task/33580/root (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33580 safe_time ceph txt unknown /proc/31480/task/33580/exe (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33580 safe_time ceph NOFD /proc/31480/task/33580/fd (opendir: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33581 safe_time ceph cwd unknown /proc/31480/task/33581/cwd (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33581 safe_time ceph rtd unknown /proc/31480/task/33581/root (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33581 safe_time ceph txt unknown /proc/31480/task/33581/exe (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33581 safe_time ceph NOFD /proc/31480/task/33581/fd (opendir: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33582 safe_time ceph cwd unknown /proc/31480/task/33582/cwd (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33582 safe_time ceph rtd unknown /proc/31480/task/33582/root (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33582 safe_time ceph txt unknown /proc/31480/task/33582/exe (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33582 safe_time ceph NOFD /proc/31480/task/33582/fd (opendir: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33583 fn_anonym ceph cwd unknown /proc/31480/task/33583/cwd (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33583 fn_anonym ceph rtd unknown /proc/31480/task/33583/root (readlink: Permission denied) 2024-09-12T02:33:16.654 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33583 fn_anonym ceph txt unknown /proc/31480/task/33583/exe (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33583 fn_anonym ceph NOFD /proc/31480/task/33583/fd (opendir: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33584 flusher ceph cwd unknown /proc/31480/task/33584/cwd (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33584 flusher ceph rtd unknown /proc/31480/task/33584/root (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33584 flusher ceph txt unknown /proc/31480/task/33584/exe (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33584 flusher ceph NOFD /proc/31480/task/33584/fd (opendir: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33585 safe_time ceph cwd unknown /proc/31480/task/33585/cwd (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33585 safe_time ceph rtd unknown /proc/31480/task/33585/root (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33585 safe_time ceph txt unknown /proc/31480/task/33585/exe (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33585 safe_time ceph NOFD /proc/31480/task/33585/fd (opendir: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33739 OpHistory ceph cwd unknown /proc/31480/task/33739/cwd (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33739 OpHistory ceph rtd unknown /proc/31480/task/33739/root (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33739 OpHistory ceph txt unknown /proc/31480/task/33739/exe (readlink: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33739 OpHistory ceph NOFD /proc/31480/task/33739/fd (opendir: Permission denied) 2024-09-12T02:33:16.655 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33740 mgr-fin ceph cwd unknown /proc/31480/task/33740/cwd (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33740 mgr-fin ceph rtd unknown /proc/31480/task/33740/root (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33740 mgr-fin ceph txt unknown /proc/31480/task/33740/exe (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33740 mgr-fin ceph NOFD /proc/31480/task/33740/fd (opendir: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33741 ms_dispat ceph cwd unknown /proc/31480/task/33741/cwd (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33741 ms_dispat ceph rtd unknown /proc/31480/task/33741/root (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33741 ms_dispat ceph txt unknown /proc/31480/task/33741/exe (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33741 ms_dispat ceph NOFD /proc/31480/task/33741/fd (opendir: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33742 ms_local ceph cwd unknown /proc/31480/task/33742/cwd (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33742 ms_local ceph rtd unknown /proc/31480/task/33742/root (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33742 ms_local ceph txt unknown /proc/31480/task/33742/exe (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33742 ms_local ceph NOFD /proc/31480/task/33742/fd (opendir: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33743 safe_time ceph cwd unknown /proc/31480/task/33743/cwd (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33743 safe_time ceph rtd unknown /proc/31480/task/33743/root (readlink: Permission denied) 2024-09-12T02:33:16.656 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33743 safe_time ceph txt unknown /proc/31480/task/33743/exe (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33743 safe_time ceph NOFD /proc/31480/task/33743/fd (opendir: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33744 cmdfin ceph cwd unknown /proc/31480/task/33744/cwd (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33744 cmdfin ceph rtd unknown /proc/31480/task/33744/root (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33744 cmdfin ceph txt unknown /proc/31480/task/33744/exe (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33744 cmdfin ceph NOFD /proc/31480/task/33744/fd (opendir: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33748 io_contex ceph cwd unknown /proc/31480/task/33748/cwd (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33748 io_contex ceph rtd unknown /proc/31480/task/33748/root (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33748 io_contex ceph txt unknown /proc/31480/task/33748/exe (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33748 io_contex ceph NOFD /proc/31480/task/33748/fd (opendir: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33749 io_contex ceph cwd unknown /proc/31480/task/33749/cwd (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33749 io_contex ceph rtd unknown /proc/31480/task/33749/root (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33749 io_contex ceph txt unknown /proc/31480/task/33749/exe (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33749 io_contex ceph NOFD /proc/31480/task/33749/fd (opendir: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33750 ceph_time ceph cwd unknown /proc/31480/task/33750/cwd (readlink: Permission denied) 2024-09-12T02:33:16.657 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33750 ceph_time ceph rtd unknown /proc/31480/task/33750/root (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33750 ceph_time ceph txt unknown /proc/31480/task/33750/exe (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33750 ceph_time ceph NOFD /proc/31480/task/33750/fd (opendir: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33751 ms_dispat ceph cwd unknown /proc/31480/task/33751/cwd (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33751 ms_dispat ceph rtd unknown /proc/31480/task/33751/root (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33751 ms_dispat ceph txt unknown /proc/31480/task/33751/exe (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33751 ms_dispat ceph NOFD /proc/31480/task/33751/fd (opendir: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33752 ms_local ceph cwd unknown /proc/31480/task/33752/cwd (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33752 ms_local ceph rtd unknown /proc/31480/task/33752/root (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33752 ms_local ceph txt unknown /proc/31480/task/33752/exe (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33752 ms_local ceph NOFD /proc/31480/task/33752/fd (opendir: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33753 safe_time ceph cwd unknown /proc/31480/task/33753/cwd (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33753 safe_time ceph rtd unknown /proc/31480/task/33753/root (readlink: Permission denied) 2024-09-12T02:33:16.658 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33753 safe_time ceph txt unknown /proc/31480/task/33753/exe (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33753 safe_time ceph NOFD /proc/31480/task/33753/fd (opendir: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33754 safe_time ceph cwd unknown /proc/31480/task/33754/cwd (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33754 safe_time ceph rtd unknown /proc/31480/task/33754/root (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33754 safe_time ceph txt unknown /proc/31480/task/33754/exe (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33754 safe_time ceph NOFD /proc/31480/task/33754/fd (opendir: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33755 balancer ceph cwd unknown /proc/31480/task/33755/cwd (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33755 balancer ceph rtd unknown /proc/31480/task/33755/root (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33755 balancer ceph txt unknown /proc/31480/task/33755/exe (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33755 balancer ceph NOFD /proc/31480/task/33755/fd (opendir: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33756 m-fin-bal ceph cwd unknown /proc/31480/task/33756/cwd (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33756 m-fin-bal ceph rtd unknown /proc/31480/task/33756/root (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33756 m-fin-bal ceph txt unknown /proc/31480/task/33756/exe (readlink: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33756 m-fin-bal ceph NOFD /proc/31480/task/33756/fd (opendir: Permission denied) 2024-09-12T02:33:16.659 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33757 mgr-fin ceph cwd unknown /proc/31480/task/33757/cwd (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33757 mgr-fin ceph rtd unknown /proc/31480/task/33757/root (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33757 mgr-fin ceph txt unknown /proc/31480/task/33757/exe (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33757 mgr-fin ceph NOFD /proc/31480/task/33757/fd (opendir: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33758 mgr-fin ceph cwd unknown /proc/31480/task/33758/cwd (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33758 mgr-fin ceph rtd unknown /proc/31480/task/33758/root (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33758 mgr-fin ceph txt unknown /proc/31480/task/33758/exe (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33758 mgr-fin ceph NOFD /proc/31480/task/33758/fd (opendir: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33759 mgr-fin ceph cwd unknown /proc/31480/task/33759/cwd (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33759 mgr-fin ceph rtd unknown /proc/31480/task/33759/root (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33759 mgr-fin ceph txt unknown /proc/31480/task/33759/exe (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33759 mgr-fin ceph NOFD /proc/31480/task/33759/fd (opendir: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33760 mgr-fin ceph cwd unknown /proc/31480/task/33760/cwd (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33760 mgr-fin ceph rtd unknown /proc/31480/task/33760/root (readlink: Permission denied) 2024-09-12T02:33:16.660 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33760 mgr-fin ceph txt unknown /proc/31480/task/33760/exe (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33760 mgr-fin ceph NOFD /proc/31480/task/33760/fd (opendir: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33761 mgr-fin ceph cwd unknown /proc/31480/task/33761/cwd (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33761 mgr-fin ceph rtd unknown /proc/31480/task/33761/root (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33761 mgr-fin ceph txt unknown /proc/31480/task/33761/exe (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33761 mgr-fin ceph NOFD /proc/31480/task/33761/fd (opendir: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33762 mgr-fin ceph cwd unknown /proc/31480/task/33762/cwd (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33762 mgr-fin ceph rtd unknown /proc/31480/task/33762/root (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33762 mgr-fin ceph txt unknown /proc/31480/task/33762/exe (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33762 mgr-fin ceph NOFD /proc/31480/task/33762/fd (opendir: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33763 mgr-fin ceph cwd unknown /proc/31480/task/33763/cwd (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33763 mgr-fin ceph rtd unknown /proc/31480/task/33763/root (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33763 mgr-fin ceph txt unknown /proc/31480/task/33763/exe (readlink: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33763 mgr-fin ceph NOFD /proc/31480/task/33763/fd (opendir: Permission denied) 2024-09-12T02:33:16.661 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33764 mgr-fin ceph cwd unknown /proc/31480/task/33764/cwd (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33764 mgr-fin ceph rtd unknown /proc/31480/task/33764/root (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33764 mgr-fin ceph txt unknown /proc/31480/task/33764/exe (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33764 mgr-fin ceph NOFD /proc/31480/task/33764/fd (opendir: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33765 mgr-fin ceph cwd unknown /proc/31480/task/33765/cwd (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33765 mgr-fin ceph rtd unknown /proc/31480/task/33765/root (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33765 mgr-fin ceph txt unknown /proc/31480/task/33765/exe (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33765 mgr-fin ceph NOFD /proc/31480/task/33765/fd (opendir: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33766 mgr-fin ceph cwd unknown /proc/31480/task/33766/cwd (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33766 mgr-fin ceph rtd unknown /proc/31480/task/33766/root (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33766 mgr-fin ceph txt unknown /proc/31480/task/33766/exe (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33766 mgr-fin ceph NOFD /proc/31480/task/33766/fd (opendir: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33767 mgr-fin ceph cwd unknown /proc/31480/task/33767/cwd (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33767 mgr-fin ceph rtd unknown /proc/31480/task/33767/root (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33767 mgr-fin ceph txt unknown /proc/31480/task/33767/exe (readlink: Permission denied) 2024-09-12T02:33:16.662 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33767 mgr-fin ceph NOFD /proc/31480/task/33767/fd (opendir: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33768 mgr-fin ceph cwd unknown /proc/31480/task/33768/cwd (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33768 mgr-fin ceph rtd unknown /proc/31480/task/33768/root (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33768 mgr-fin ceph txt unknown /proc/31480/task/33768/exe (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33768 mgr-fin ceph NOFD /proc/31480/task/33768/fd (opendir: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33769 mgr-fin ceph cwd unknown /proc/31480/task/33769/cwd (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33769 mgr-fin ceph rtd unknown /proc/31480/task/33769/root (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33769 mgr-fin ceph txt unknown /proc/31480/task/33769/exe (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33769 mgr-fin ceph NOFD /proc/31480/task/33769/fd (opendir: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33770 mgr-fin ceph cwd unknown /proc/31480/task/33770/cwd (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33770 mgr-fin ceph rtd unknown /proc/31480/task/33770/root (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33770 mgr-fin ceph txt unknown /proc/31480/task/33770/exe (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33770 mgr-fin ceph NOFD /proc/31480/task/33770/fd (opendir: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33771 mgr-fin ceph cwd unknown /proc/31480/task/33771/cwd (readlink: Permission denied) 2024-09-12T02:33:16.663 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33771 mgr-fin ceph rtd unknown /proc/31480/task/33771/root (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33771 mgr-fin ceph txt unknown /proc/31480/task/33771/exe (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33771 mgr-fin ceph NOFD /proc/31480/task/33771/fd (opendir: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33772 cephadm ceph cwd unknown /proc/31480/task/33772/cwd (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33772 cephadm ceph rtd unknown /proc/31480/task/33772/root (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33772 cephadm ceph txt unknown /proc/31480/task/33772/exe (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33772 cephadm ceph NOFD /proc/31480/task/33772/fd (opendir: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33773 m-fin-cep ceph cwd unknown /proc/31480/task/33773/cwd (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33773 m-fin-cep ceph rtd unknown /proc/31480/task/33773/root (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33773 m-fin-cep ceph txt unknown /proc/31480/task/33773/exe (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33773 m-fin-cep ceph NOFD /proc/31480/task/33773/fd (opendir: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33774 mgr-fin ceph cwd unknown /proc/31480/task/33774/cwd (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33774 mgr-fin ceph rtd unknown /proc/31480/task/33774/root (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33774 mgr-fin ceph txt unknown /proc/31480/task/33774/exe (readlink: Permission denied) 2024-09-12T02:33:16.664 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33774 mgr-fin ceph NOFD /proc/31480/task/33774/fd (opendir: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33775 mgr-fin ceph cwd unknown /proc/31480/task/33775/cwd (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33775 mgr-fin ceph rtd unknown /proc/31480/task/33775/root (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33775 mgr-fin ceph txt unknown /proc/31480/task/33775/exe (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33775 mgr-fin ceph NOFD /proc/31480/task/33775/fd (opendir: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33776 mgr-fin ceph cwd unknown /proc/31480/task/33776/cwd (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33776 mgr-fin ceph rtd unknown /proc/31480/task/33776/root (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33776 mgr-fin ceph txt unknown /proc/31480/task/33776/exe (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33776 mgr-fin ceph NOFD /proc/31480/task/33776/fd (opendir: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33777 mgr-fin ceph cwd unknown /proc/31480/task/33777/cwd (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33777 mgr-fin ceph rtd unknown /proc/31480/task/33777/root (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33777 mgr-fin ceph txt unknown /proc/31480/task/33777/exe (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33777 mgr-fin ceph NOFD /proc/31480/task/33777/fd (opendir: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33778 cephadm ceph cwd unknown /proc/31480/task/33778/cwd (readlink: Permission denied) 2024-09-12T02:33:16.665 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33778 cephadm ceph rtd unknown /proc/31480/task/33778/root (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33778 cephadm ceph txt unknown /proc/31480/task/33778/exe (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33778 cephadm ceph NOFD /proc/31480/task/33778/fd (opendir: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33779 mgr-fin ceph cwd unknown /proc/31480/task/33779/cwd (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33779 mgr-fin ceph rtd unknown /proc/31480/task/33779/root (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33779 mgr-fin ceph txt unknown /proc/31480/task/33779/exe (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33779 mgr-fin ceph NOFD /proc/31480/task/33779/fd (opendir: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33780 crash ceph cwd unknown /proc/31480/task/33780/cwd (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33780 crash ceph rtd unknown /proc/31480/task/33780/root (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33780 crash ceph txt unknown /proc/31480/task/33780/exe (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33780 crash ceph NOFD /proc/31480/task/33780/fd (opendir: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33781 m-fin-cra ceph cwd unknown /proc/31480/task/33781/cwd (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33781 m-fin-cra ceph rtd unknown /proc/31480/task/33781/root (readlink: Permission denied) 2024-09-12T02:33:16.666 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33781 m-fin-cra ceph txt unknown /proc/31480/task/33781/exe (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33781 m-fin-cra ceph NOFD /proc/31480/task/33781/fd (opendir: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33782 mgr-fin ceph cwd unknown /proc/31480/task/33782/cwd (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33782 mgr-fin ceph rtd unknown /proc/31480/task/33782/root (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33782 mgr-fin ceph txt unknown /proc/31480/task/33782/exe (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33782 mgr-fin ceph NOFD /proc/31480/task/33782/fd (opendir: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33783 mgr-fin ceph cwd unknown /proc/31480/task/33783/cwd (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33783 mgr-fin ceph rtd unknown /proc/31480/task/33783/root (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33783 mgr-fin ceph txt unknown /proc/31480/task/33783/exe (readlink: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33783 mgr-fin ceph NOFD /proc/31480/task/33783/fd (opendir: Permission denied) 2024-09-12T02:33:16.667 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33784 mgr-fin ceph cwd unknown /proc/31480/task/33784/cwd (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33784 mgr-fin ceph rtd unknown /proc/31480/task/33784/root (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33784 mgr-fin ceph txt unknown /proc/31480/task/33784/exe (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33784 mgr-fin ceph NOFD /proc/31480/task/33784/fd (opendir: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33785 dashboard ceph cwd unknown /proc/31480/task/33785/cwd (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33785 dashboard ceph rtd unknown /proc/31480/task/33785/root (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33785 dashboard ceph txt unknown /proc/31480/task/33785/exe (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33785 dashboard ceph NOFD /proc/31480/task/33785/fd (opendir: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33786 m-fin-das ceph cwd unknown /proc/31480/task/33786/cwd (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33786 m-fin-das ceph rtd unknown /proc/31480/task/33786/root (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33786 m-fin-das ceph txt unknown /proc/31480/task/33786/exe (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33786 m-fin-das ceph NOFD /proc/31480/task/33786/fd (opendir: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33787 mgr-fin ceph cwd unknown /proc/31480/task/33787/cwd (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33787 mgr-fin ceph rtd unknown /proc/31480/task/33787/root (readlink: Permission denied) 2024-09-12T02:33:16.668 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33787 mgr-fin ceph txt unknown /proc/31480/task/33787/exe (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33787 mgr-fin ceph NOFD /proc/31480/task/33787/fd (opendir: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33788 devicehea ceph cwd unknown /proc/31480/task/33788/cwd (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33788 devicehea ceph rtd unknown /proc/31480/task/33788/root (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33788 devicehea ceph txt unknown /proc/31480/task/33788/exe (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33788 devicehea ceph NOFD /proc/31480/task/33788/fd (opendir: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33789 m-fin-dev ceph cwd unknown /proc/31480/task/33789/cwd (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33789 m-fin-dev ceph rtd unknown /proc/31480/task/33789/root (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33789 m-fin-dev ceph txt unknown /proc/31480/task/33789/exe (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33789 m-fin-dev ceph NOFD /proc/31480/task/33789/fd (opendir: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33790 mgr-fin ceph cwd unknown /proc/31480/task/33790/cwd (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33790 mgr-fin ceph rtd unknown /proc/31480/task/33790/root (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33790 mgr-fin ceph txt unknown /proc/31480/task/33790/exe (readlink: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33790 mgr-fin ceph NOFD /proc/31480/task/33790/fd (opendir: Permission denied) 2024-09-12T02:33:16.669 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33792 m-fin-ios ceph cwd unknown /proc/31480/task/33792/cwd (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33792 m-fin-ios ceph rtd unknown /proc/31480/task/33792/root (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33792 m-fin-ios ceph txt unknown /proc/31480/task/33792/exe (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33792 m-fin-ios ceph NOFD /proc/31480/task/33792/fd (opendir: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33793 mgr-fin ceph cwd unknown /proc/31480/task/33793/cwd (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33793 mgr-fin ceph rtd unknown /proc/31480/task/33793/root (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33793 mgr-fin ceph txt unknown /proc/31480/task/33793/exe (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33793 mgr-fin ceph NOFD /proc/31480/task/33793/fd (opendir: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33795 m-fin-nfs ceph cwd unknown /proc/31480/task/33795/cwd (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33795 m-fin-nfs ceph rtd unknown /proc/31480/task/33795/root (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33795 m-fin-nfs ceph txt unknown /proc/31480/task/33795/exe (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33795 m-fin-nfs ceph NOFD /proc/31480/task/33795/fd (opendir: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33796 mgr-fin ceph cwd unknown /proc/31480/task/33796/cwd (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33796 mgr-fin ceph rtd unknown /proc/31480/task/33796/root (readlink: Permission denied) 2024-09-12T02:33:16.670 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33796 mgr-fin ceph txt unknown /proc/31480/task/33796/exe (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33796 mgr-fin ceph NOFD /proc/31480/task/33796/fd (opendir: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33798 m-fin-orc ceph cwd unknown /proc/31480/task/33798/cwd (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33798 m-fin-orc ceph rtd unknown /proc/31480/task/33798/root (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33798 m-fin-orc ceph txt unknown /proc/31480/task/33798/exe (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33798 m-fin-orc ceph NOFD /proc/31480/task/33798/fd (opendir: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33799 pg_autosc ceph cwd unknown /proc/31480/task/33799/cwd (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33799 pg_autosc ceph rtd unknown /proc/31480/task/33799/root (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33799 pg_autosc ceph txt unknown /proc/31480/task/33799/exe (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33799 pg_autosc ceph NOFD /proc/31480/task/33799/fd (opendir: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33800 m-fin-pg_ ceph cwd unknown /proc/31480/task/33800/cwd (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33800 m-fin-pg_ ceph rtd unknown /proc/31480/task/33800/root (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33800 m-fin-pg_ ceph txt unknown /proc/31480/task/33800/exe (readlink: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33800 m-fin-pg_ ceph NOFD /proc/31480/task/33800/fd (opendir: Permission denied) 2024-09-12T02:33:16.671 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33801 mgr-fin ceph cwd unknown /proc/31480/task/33801/cwd (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33801 mgr-fin ceph rtd unknown /proc/31480/task/33801/root (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33801 mgr-fin ceph txt unknown /proc/31480/task/33801/exe (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33801 mgr-fin ceph NOFD /proc/31480/task/33801/fd (opendir: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33802 cephadm ceph cwd unknown /proc/31480/task/33802/cwd (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33802 cephadm ceph rtd unknown /proc/31480/task/33802/root (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33802 cephadm ceph txt unknown /proc/31480/task/33802/exe (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33802 cephadm ceph NOFD /proc/31480/task/33802/fd (opendir: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33803 progress ceph cwd unknown /proc/31480/task/33803/cwd (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33803 progress ceph rtd unknown /proc/31480/task/33803/root (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33803 progress ceph txt unknown /proc/31480/task/33803/exe (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33803 progress ceph NOFD /proc/31480/task/33803/fd (opendir: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33804 m-fin-pro ceph cwd unknown /proc/31480/task/33804/cwd (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33804 m-fin-pro ceph rtd unknown /proc/31480/task/33804/root (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33804 m-fin-pro ceph txt unknown /proc/31480/task/33804/exe (readlink: Permission denied) 2024-09-12T02:33:16.672 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33804 m-fin-pro ceph NOFD /proc/31480/task/33804/fd (opendir: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33808 io_contex ceph cwd unknown /proc/31480/task/33808/cwd (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33808 io_contex ceph rtd unknown /proc/31480/task/33808/root (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33808 io_contex ceph txt unknown /proc/31480/task/33808/exe (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33808 io_contex ceph NOFD /proc/31480/task/33808/fd (opendir: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33809 io_contex ceph cwd unknown /proc/31480/task/33809/cwd (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33809 io_contex ceph rtd unknown /proc/31480/task/33809/root (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33809 io_contex ceph txt unknown /proc/31480/task/33809/exe (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33809 io_contex ceph NOFD /proc/31480/task/33809/fd (opendir: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33810 ceph_time ceph cwd unknown /proc/31480/task/33810/cwd (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33810 ceph_time ceph rtd unknown /proc/31480/task/33810/root (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33810 ceph_time ceph txt unknown /proc/31480/task/33810/exe (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33810 ceph_time ceph NOFD /proc/31480/task/33810/fd (opendir: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33811 ms_dispat ceph cwd unknown /proc/31480/task/33811/cwd (readlink: Permission denied) 2024-09-12T02:33:16.673 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33811 ms_dispat ceph rtd unknown /proc/31480/task/33811/root (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33811 ms_dispat ceph txt unknown /proc/31480/task/33811/exe (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33811 ms_dispat ceph NOFD /proc/31480/task/33811/fd (opendir: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33812 ms_local ceph cwd unknown /proc/31480/task/33812/cwd (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33812 ms_local ceph rtd unknown /proc/31480/task/33812/root (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33812 ms_local ceph txt unknown /proc/31480/task/33812/exe (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33812 ms_local ceph NOFD /proc/31480/task/33812/fd (opendir: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33813 safe_time ceph cwd unknown /proc/31480/task/33813/cwd (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33813 safe_time ceph rtd unknown /proc/31480/task/33813/root (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33813 safe_time ceph txt unknown /proc/31480/task/33813/exe (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33813 safe_time ceph NOFD /proc/31480/task/33813/fd (opendir: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33814 safe_time ceph cwd unknown /proc/31480/task/33814/cwd (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33814 safe_time ceph rtd unknown /proc/31480/task/33814/root (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33814 safe_time ceph txt unknown /proc/31480/task/33814/exe (readlink: Permission denied) 2024-09-12T02:33:16.674 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33814 safe_time ceph NOFD /proc/31480/task/33814/fd (opendir: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33815 mgr-fin ceph cwd unknown /proc/31480/task/33815/cwd (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33815 mgr-fin ceph rtd unknown /proc/31480/task/33815/root (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33815 mgr-fin ceph txt unknown /proc/31480/task/33815/exe (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33815 mgr-fin ceph NOFD /proc/31480/task/33815/fd (opendir: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33817 m-fin-rbd ceph cwd unknown /proc/31480/task/33817/cwd (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33817 m-fin-rbd ceph rtd unknown /proc/31480/task/33817/root (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33817 m-fin-rbd ceph txt unknown /proc/31480/task/33817/exe (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33817 m-fin-rbd ceph NOFD /proc/31480/task/33817/fd (opendir: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33818 restful ceph cwd unknown /proc/31480/task/33818/cwd (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33818 restful ceph rtd unknown /proc/31480/task/33818/root (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33818 restful ceph txt unknown /proc/31480/task/33818/exe (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33818 restful ceph NOFD /proc/31480/task/33818/fd (opendir: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33819 m-fin-res ceph cwd unknown /proc/31480/task/33819/cwd (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33819 m-fin-res ceph rtd unknown /proc/31480/task/33819/root (readlink: Permission denied) 2024-09-12T02:33:16.675 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33819 m-fin-res ceph txt unknown /proc/31480/task/33819/exe (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33819 m-fin-res ceph NOFD /proc/31480/task/33819/fd (opendir: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33821 m-fin-sta ceph cwd unknown /proc/31480/task/33821/cwd (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33821 m-fin-sta ceph rtd unknown /proc/31480/task/33821/root (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33821 m-fin-sta ceph txt unknown /proc/31480/task/33821/exe (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33821 m-fin-sta ceph NOFD /proc/31480/task/33821/fd (opendir: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33822 mgr-fin ceph cwd unknown /proc/31480/task/33822/cwd (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33822 mgr-fin ceph rtd unknown /proc/31480/task/33822/root (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33822 mgr-fin ceph txt unknown /proc/31480/task/33822/exe (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33822 mgr-fin ceph NOFD /proc/31480/task/33822/fd (opendir: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33823 telemetry ceph cwd unknown /proc/31480/task/33823/cwd (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33823 telemetry ceph rtd unknown /proc/31480/task/33823/root (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33823 telemetry ceph txt unknown /proc/31480/task/33823/exe (readlink: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33823 telemetry ceph NOFD /proc/31480/task/33823/fd (opendir: Permission denied) 2024-09-12T02:33:16.676 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33824 mgr-fin ceph cwd unknown /proc/31480/task/33824/cwd (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33824 mgr-fin ceph rtd unknown /proc/31480/task/33824/root (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33824 mgr-fin ceph txt unknown /proc/31480/task/33824/exe (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33824 mgr-fin ceph NOFD /proc/31480/task/33824/fd (opendir: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33825 m-fin-tel ceph cwd unknown /proc/31480/task/33825/cwd (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33825 m-fin-tel ceph rtd unknown /proc/31480/task/33825/root (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33825 m-fin-tel ceph txt unknown /proc/31480/task/33825/exe (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33825 m-fin-tel ceph NOFD /proc/31480/task/33825/fd (opendir: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33826 mgr-fin ceph cwd unknown /proc/31480/task/33826/cwd (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33826 mgr-fin ceph rtd unknown /proc/31480/task/33826/root (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33826 mgr-fin ceph txt unknown /proc/31480/task/33826/exe (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33826 mgr-fin ceph NOFD /proc/31480/task/33826/fd (opendir: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33827 mgr-fin ceph cwd unknown /proc/31480/task/33827/cwd (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33827 mgr-fin ceph rtd unknown /proc/31480/task/33827/root (readlink: Permission denied) 2024-09-12T02:33:16.677 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33827 mgr-fin ceph txt unknown /proc/31480/task/33827/exe (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33827 mgr-fin ceph NOFD /proc/31480/task/33827/fd (opendir: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33831 mgr-fin ceph cwd unknown /proc/31480/task/33831/cwd (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33831 mgr-fin ceph rtd unknown /proc/31480/task/33831/root (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33831 mgr-fin ceph txt unknown /proc/31480/task/33831/exe (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33831 mgr-fin ceph NOFD /proc/31480/task/33831/fd (opendir: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33832 io_contex ceph cwd unknown /proc/31480/task/33832/cwd (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33832 io_contex ceph rtd unknown /proc/31480/task/33832/root (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33832 io_contex ceph txt unknown /proc/31480/task/33832/exe (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33832 io_contex ceph NOFD /proc/31480/task/33832/fd (opendir: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33833 io_contex ceph cwd unknown /proc/31480/task/33833/cwd (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33833 io_contex ceph rtd unknown /proc/31480/task/33833/root (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33833 io_contex ceph txt unknown /proc/31480/task/33833/exe (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33833 io_contex ceph NOFD /proc/31480/task/33833/fd (opendir: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33834 ceph_time ceph cwd unknown /proc/31480/task/33834/cwd (readlink: Permission denied) 2024-09-12T02:33:16.678 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33834 ceph_time ceph rtd unknown /proc/31480/task/33834/root (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33834 ceph_time ceph txt unknown /proc/31480/task/33834/exe (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33834 ceph_time ceph NOFD /proc/31480/task/33834/fd (opendir: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33835 ms_dispat ceph cwd unknown /proc/31480/task/33835/cwd (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33835 ms_dispat ceph rtd unknown /proc/31480/task/33835/root (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33835 ms_dispat ceph txt unknown /proc/31480/task/33835/exe (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33835 ms_dispat ceph NOFD /proc/31480/task/33835/fd (opendir: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33836 ms_local ceph cwd unknown /proc/31480/task/33836/cwd (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33836 ms_local ceph rtd unknown /proc/31480/task/33836/root (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33836 ms_local ceph txt unknown /proc/31480/task/33836/exe (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33836 ms_local ceph NOFD /proc/31480/task/33836/fd (opendir: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33837 safe_time ceph cwd unknown /proc/31480/task/33837/cwd (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33837 safe_time ceph rtd unknown /proc/31480/task/33837/root (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33837 safe_time ceph txt unknown /proc/31480/task/33837/exe (readlink: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33837 safe_time ceph NOFD /proc/31480/task/33837/fd (opendir: Permission denied) 2024-09-12T02:33:16.679 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33838 safe_time ceph cwd unknown /proc/31480/task/33838/cwd (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33838 safe_time ceph rtd unknown /proc/31480/task/33838/root (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33838 safe_time ceph txt unknown /proc/31480/task/33838/exe (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33838 safe_time ceph NOFD /proc/31480/task/33838/fd (opendir: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33839 mgr-fin ceph cwd unknown /proc/31480/task/33839/cwd (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33839 mgr-fin ceph rtd unknown /proc/31480/task/33839/root (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33839 mgr-fin ceph txt unknown /proc/31480/task/33839/exe (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33839 mgr-fin ceph NOFD /proc/31480/task/33839/fd (opendir: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33840 mgr-fin ceph cwd unknown /proc/31480/task/33840/cwd (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33840 mgr-fin ceph rtd unknown /proc/31480/task/33840/root (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33840 mgr-fin ceph txt unknown /proc/31480/task/33840/exe (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33840 mgr-fin ceph NOFD /proc/31480/task/33840/fd (opendir: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33841 mgr-fin ceph cwd unknown /proc/31480/task/33841/cwd (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33841 mgr-fin ceph rtd unknown /proc/31480/task/33841/root (readlink: Permission denied) 2024-09-12T02:33:16.680 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33841 mgr-fin ceph txt unknown /proc/31480/task/33841/exe (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33841 mgr-fin ceph NOFD /proc/31480/task/33841/fd (opendir: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33842 mgr-fin ceph cwd unknown /proc/31480/task/33842/cwd (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33842 mgr-fin ceph rtd unknown /proc/31480/task/33842/root (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33842 mgr-fin ceph txt unknown /proc/31480/task/33842/exe (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33842 mgr-fin ceph NOFD /proc/31480/task/33842/fd (opendir: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33843 mgr-fin ceph cwd unknown /proc/31480/task/33843/cwd (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33843 mgr-fin ceph rtd unknown /proc/31480/task/33843/root (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33843 mgr-fin ceph txt unknown /proc/31480/task/33843/exe (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33843 mgr-fin ceph NOFD /proc/31480/task/33843/fd (opendir: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33844 mgr-fin ceph cwd unknown /proc/31480/task/33844/cwd (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33844 mgr-fin ceph rtd unknown /proc/31480/task/33844/root (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33844 mgr-fin ceph txt unknown /proc/31480/task/33844/exe (readlink: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33844 mgr-fin ceph NOFD /proc/31480/task/33844/fd (opendir: Permission denied) 2024-09-12T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33845 mgr-fin ceph cwd unknown /proc/31480/task/33845/cwd (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33845 mgr-fin ceph rtd unknown /proc/31480/task/33845/root (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33845 mgr-fin ceph txt unknown /proc/31480/task/33845/exe (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33845 mgr-fin ceph NOFD /proc/31480/task/33845/fd (opendir: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33846 mgr-fin ceph cwd unknown /proc/31480/task/33846/cwd (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33846 mgr-fin ceph rtd unknown /proc/31480/task/33846/root (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33846 mgr-fin ceph txt unknown /proc/31480/task/33846/exe (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33846 mgr-fin ceph NOFD /proc/31480/task/33846/fd (opendir: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33847 mgr-fin ceph cwd unknown /proc/31480/task/33847/cwd (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33847 mgr-fin ceph rtd unknown /proc/31480/task/33847/root (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33847 mgr-fin ceph txt unknown /proc/31480/task/33847/exe (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33847 mgr-fin ceph NOFD /proc/31480/task/33847/fd (opendir: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33848 mgr-fin ceph cwd unknown /proc/31480/task/33848/cwd (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33848 mgr-fin ceph rtd unknown /proc/31480/task/33848/root (readlink: Permission denied) 2024-09-12T02:33:16.682 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33848 mgr-fin ceph txt unknown /proc/31480/task/33848/exe (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33848 mgr-fin ceph NOFD /proc/31480/task/33848/fd (opendir: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33849 mgr-fin ceph cwd unknown /proc/31480/task/33849/cwd (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33849 mgr-fin ceph rtd unknown /proc/31480/task/33849/root (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33849 mgr-fin ceph txt unknown /proc/31480/task/33849/exe (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33849 mgr-fin ceph NOFD /proc/31480/task/33849/fd (opendir: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33850 mgr-fin ceph cwd unknown /proc/31480/task/33850/cwd (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33850 mgr-fin ceph rtd unknown /proc/31480/task/33850/root (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33850 mgr-fin ceph txt unknown /proc/31480/task/33850/exe (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33850 mgr-fin ceph NOFD /proc/31480/task/33850/fd (opendir: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33852 m-fin-vol ceph cwd unknown /proc/31480/task/33852/cwd (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33852 m-fin-vol ceph rtd unknown /proc/31480/task/33852/root (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33852 m-fin-vol ceph txt unknown /proc/31480/task/33852/exe (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 33852 m-fin-vol ceph NOFD /proc/31480/task/33852/fd (opendir: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34135 mgr-fin ceph cwd unknown /proc/31480/task/34135/cwd (readlink: Permission denied) 2024-09-12T02:33:16.683 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34135 mgr-fin ceph rtd unknown /proc/31480/task/34135/root (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34135 mgr-fin ceph txt unknown /proc/31480/task/34135/exe (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34135 mgr-fin ceph NOFD /proc/31480/task/34135/fd (opendir: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34136 mgr-fin ceph cwd unknown /proc/31480/task/34136/cwd (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34136 mgr-fin ceph rtd unknown /proc/31480/task/34136/root (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34136 mgr-fin ceph txt unknown /proc/31480/task/34136/exe (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34136 mgr-fin ceph NOFD /proc/31480/task/34136/fd (opendir: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34137 mgr-fin ceph cwd unknown /proc/31480/task/34137/cwd (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34137 mgr-fin ceph rtd unknown /proc/31480/task/34137/root (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34137 mgr-fin ceph txt unknown /proc/31480/task/34137/exe (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34137 mgr-fin ceph NOFD /proc/31480/task/34137/fd (opendir: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34138 mgr-fin ceph cwd unknown /proc/31480/task/34138/cwd (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34138 mgr-fin ceph rtd unknown /proc/31480/task/34138/root (readlink: Permission denied) 2024-09-12T02:33:16.684 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34138 mgr-fin ceph txt unknown /proc/31480/task/34138/exe (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34138 mgr-fin ceph NOFD /proc/31480/task/34138/fd (opendir: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34139 mgr-fin ceph cwd unknown /proc/31480/task/34139/cwd (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34139 mgr-fin ceph rtd unknown /proc/31480/task/34139/root (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34139 mgr-fin ceph txt unknown /proc/31480/task/34139/exe (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34139 mgr-fin ceph NOFD /proc/31480/task/34139/fd (opendir: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34140 mgr-fin ceph cwd unknown /proc/31480/task/34140/cwd (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34140 mgr-fin ceph rtd unknown /proc/31480/task/34140/root (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34140 mgr-fin ceph txt unknown /proc/31480/task/34140/exe (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34140 mgr-fin ceph NOFD /proc/31480/task/34140/fd (opendir: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34141 mgr-fin ceph cwd unknown /proc/31480/task/34141/cwd (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34141 mgr-fin ceph rtd unknown /proc/31480/task/34141/root (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34141 mgr-fin ceph txt unknown /proc/31480/task/34141/exe (readlink: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34141 mgr-fin ceph NOFD /proc/31480/task/34141/fd (opendir: Permission denied) 2024-09-12T02:33:16.685 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34142 mgr-fin ceph cwd unknown /proc/31480/task/34142/cwd (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34142 mgr-fin ceph rtd unknown /proc/31480/task/34142/root (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34142 mgr-fin ceph txt unknown /proc/31480/task/34142/exe (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34142 mgr-fin ceph NOFD /proc/31480/task/34142/fd (opendir: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34143 mgr-fin ceph cwd unknown /proc/31480/task/34143/cwd (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34143 mgr-fin ceph rtd unknown /proc/31480/task/34143/root (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34143 mgr-fin ceph txt unknown /proc/31480/task/34143/exe (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34143 mgr-fin ceph NOFD /proc/31480/task/34143/fd (opendir: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34144 mgr-fin ceph cwd unknown /proc/31480/task/34144/cwd (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34144 mgr-fin ceph rtd unknown /proc/31480/task/34144/root (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34144 mgr-fin ceph txt unknown /proc/31480/task/34144/exe (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34144 mgr-fin ceph NOFD /proc/31480/task/34144/fd (opendir: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34145 mgr-fin ceph cwd unknown /proc/31480/task/34145/cwd (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34145 mgr-fin ceph rtd unknown /proc/31480/task/34145/root (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34145 mgr-fin ceph txt unknown /proc/31480/task/34145/exe (readlink: Permission denied) 2024-09-12T02:33:16.686 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34145 mgr-fin ceph NOFD /proc/31480/task/34145/fd (opendir: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34163 mgr-fin ceph cwd unknown /proc/31480/task/34163/cwd (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34163 mgr-fin ceph rtd unknown /proc/31480/task/34163/root (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34163 mgr-fin ceph txt unknown /proc/31480/task/34163/exe (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34163 mgr-fin ceph NOFD /proc/31480/task/34163/fd (opendir: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34164 mgr-fin ceph cwd unknown /proc/31480/task/34164/cwd (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34164 mgr-fin ceph rtd unknown /proc/31480/task/34164/root (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34164 mgr-fin ceph txt unknown /proc/31480/task/34164/exe (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34164 mgr-fin ceph NOFD /proc/31480/task/34164/fd (opendir: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34165 mgr-fin ceph cwd unknown /proc/31480/task/34165/cwd (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34165 mgr-fin ceph rtd unknown /proc/31480/task/34165/root (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34165 mgr-fin ceph txt unknown /proc/31480/task/34165/exe (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34165 mgr-fin ceph NOFD /proc/31480/task/34165/fd (opendir: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34166 mgr-fin ceph cwd unknown /proc/31480/task/34166/cwd (readlink: Permission denied) 2024-09-12T02:33:16.687 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34166 mgr-fin ceph rtd unknown /proc/31480/task/34166/root (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34166 mgr-fin ceph txt unknown /proc/31480/task/34166/exe (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34166 mgr-fin ceph NOFD /proc/31480/task/34166/fd (opendir: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34167 mgr-fin ceph cwd unknown /proc/31480/task/34167/cwd (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34167 mgr-fin ceph rtd unknown /proc/31480/task/34167/root (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34167 mgr-fin ceph txt unknown /proc/31480/task/34167/exe (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34167 mgr-fin ceph NOFD /proc/31480/task/34167/fd (opendir: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34168 mgr-fin ceph cwd unknown /proc/31480/task/34168/cwd (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34168 mgr-fin ceph rtd unknown /proc/31480/task/34168/root (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34168 mgr-fin ceph txt unknown /proc/31480/task/34168/exe (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34168 mgr-fin ceph NOFD /proc/31480/task/34168/fd (opendir: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34169 mgr-fin ceph cwd unknown /proc/31480/task/34169/cwd (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34169 mgr-fin ceph rtd unknown /proc/31480/task/34169/root (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34169 mgr-fin ceph txt unknown /proc/31480/task/34169/exe (readlink: Permission denied) 2024-09-12T02:33:16.688 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34169 mgr-fin ceph NOFD /proc/31480/task/34169/fd (opendir: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34170 mgr-fin ceph cwd unknown /proc/31480/task/34170/cwd (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34170 mgr-fin ceph rtd unknown /proc/31480/task/34170/root (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34170 mgr-fin ceph txt unknown /proc/31480/task/34170/exe (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34170 mgr-fin ceph NOFD /proc/31480/task/34170/fd (opendir: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34171 mgr-fin ceph cwd unknown /proc/31480/task/34171/cwd (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34171 mgr-fin ceph rtd unknown /proc/31480/task/34171/root (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34171 mgr-fin ceph txt unknown /proc/31480/task/34171/exe (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34171 mgr-fin ceph NOFD /proc/31480/task/34171/fd (opendir: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34172 mgr-fin ceph cwd unknown /proc/31480/task/34172/cwd (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34172 mgr-fin ceph rtd unknown /proc/31480/task/34172/root (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34172 mgr-fin ceph txt unknown /proc/31480/task/34172/exe (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34172 mgr-fin ceph NOFD /proc/31480/task/34172/fd (opendir: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34173 mgr-fin ceph cwd unknown /proc/31480/task/34173/cwd (readlink: Permission denied) 2024-09-12T02:33:16.689 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34173 mgr-fin ceph rtd unknown /proc/31480/task/34173/root (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34173 mgr-fin ceph txt unknown /proc/31480/task/34173/exe (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34173 mgr-fin ceph NOFD /proc/31480/task/34173/fd (opendir: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34524 dashboard ceph cwd unknown /proc/31480/task/34524/cwd (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34524 dashboard ceph rtd unknown /proc/31480/task/34524/root (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34524 dashboard ceph txt unknown /proc/31480/task/34524/exe (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34524 dashboard ceph NOFD /proc/31480/task/34524/fd (opendir: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34525 dashboard ceph cwd unknown /proc/31480/task/34525/cwd (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34525 dashboard ceph rtd unknown /proc/31480/task/34525/root (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34525 dashboard ceph txt unknown /proc/31480/task/34525/exe (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34525 dashboard ceph NOFD /proc/31480/task/34525/fd (opendir: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34526 dashboard ceph cwd unknown /proc/31480/task/34526/cwd (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34526 dashboard ceph rtd unknown /proc/31480/task/34526/root (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34526 dashboard ceph txt unknown /proc/31480/task/34526/exe (readlink: Permission denied) 2024-09-12T02:33:16.690 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34526 dashboard ceph NOFD /proc/31480/task/34526/fd (opendir: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34527 dashboard ceph cwd unknown /proc/31480/task/34527/cwd (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34527 dashboard ceph rtd unknown /proc/31480/task/34527/root (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34527 dashboard ceph txt unknown /proc/31480/task/34527/exe (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34527 dashboard ceph NOFD /proc/31480/task/34527/fd (opendir: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34528 dashboard ceph cwd unknown /proc/31480/task/34528/cwd (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34528 dashboard ceph rtd unknown /proc/31480/task/34528/root (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34528 dashboard ceph txt unknown /proc/31480/task/34528/exe (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34528 dashboard ceph NOFD /proc/31480/task/34528/fd (opendir: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34529 dashboard ceph cwd unknown /proc/31480/task/34529/cwd (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34529 dashboard ceph rtd unknown /proc/31480/task/34529/root (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34529 dashboard ceph txt unknown /proc/31480/task/34529/exe (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34529 dashboard ceph NOFD /proc/31480/task/34529/fd (opendir: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34530 dashboard ceph cwd unknown /proc/31480/task/34530/cwd (readlink: Permission denied) 2024-09-12T02:33:16.691 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34530 dashboard ceph rtd unknown /proc/31480/task/34530/root (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34530 dashboard ceph txt unknown /proc/31480/task/34530/exe (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34530 dashboard ceph NOFD /proc/31480/task/34530/fd (opendir: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34531 dashboard ceph cwd unknown /proc/31480/task/34531/cwd (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34531 dashboard ceph rtd unknown /proc/31480/task/34531/root (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34531 dashboard ceph txt unknown /proc/31480/task/34531/exe (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34531 dashboard ceph NOFD /proc/31480/task/34531/fd (opendir: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34532 dashboard ceph cwd unknown /proc/31480/task/34532/cwd (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34532 dashboard ceph rtd unknown /proc/31480/task/34532/root (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34532 dashboard ceph txt unknown /proc/31480/task/34532/exe (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34532 dashboard ceph NOFD /proc/31480/task/34532/fd (opendir: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34533 dashboard ceph cwd unknown /proc/31480/task/34533/cwd (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34533 dashboard ceph rtd unknown /proc/31480/task/34533/root (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34533 dashboard ceph txt unknown /proc/31480/task/34533/exe (readlink: Permission denied) 2024-09-12T02:33:16.692 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34533 dashboard ceph NOFD /proc/31480/task/34533/fd (opendir: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34534 dashboard ceph cwd unknown /proc/31480/task/34534/cwd (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34534 dashboard ceph rtd unknown /proc/31480/task/34534/root (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34534 dashboard ceph txt unknown /proc/31480/task/34534/exe (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34534 dashboard ceph NOFD /proc/31480/task/34534/fd (opendir: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34540 dashboard ceph cwd unknown /proc/31480/task/34540/cwd (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34540 dashboard ceph rtd unknown /proc/31480/task/34540/root (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34540 dashboard ceph txt unknown /proc/31480/task/34540/exe (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 34540 dashboard ceph NOFD /proc/31480/task/34540/fd (opendir: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47775 devicehea ceph cwd unknown /proc/31480/task/47775/cwd (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47775 devicehea ceph rtd unknown /proc/31480/task/47775/root (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47775 devicehea ceph txt unknown /proc/31480/task/47775/exe (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47775 devicehea ceph NOFD /proc/31480/task/47775/fd (opendir: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47779 io_contex ceph cwd unknown /proc/31480/task/47779/cwd (readlink: Permission denied) 2024-09-12T02:33:16.693 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47779 io_contex ceph rtd unknown /proc/31480/task/47779/root (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47779 io_contex ceph txt unknown /proc/31480/task/47779/exe (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47779 io_contex ceph NOFD /proc/31480/task/47779/fd (opendir: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47780 io_contex ceph cwd unknown /proc/31480/task/47780/cwd (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47780 io_contex ceph rtd unknown /proc/31480/task/47780/root (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47780 io_contex ceph txt unknown /proc/31480/task/47780/exe (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47780 io_contex ceph NOFD /proc/31480/task/47780/fd (opendir: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47781 ceph_time ceph cwd unknown /proc/31480/task/47781/cwd (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47781 ceph_time ceph rtd unknown /proc/31480/task/47781/root (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47781 ceph_time ceph txt unknown /proc/31480/task/47781/exe (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47781 ceph_time ceph NOFD /proc/31480/task/47781/fd (opendir: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47782 ms_dispat ceph cwd unknown /proc/31480/task/47782/cwd (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47782 ms_dispat ceph rtd unknown /proc/31480/task/47782/root (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47782 ms_dispat ceph txt unknown /proc/31480/task/47782/exe (readlink: Permission denied) 2024-09-12T02:33:16.694 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47782 ms_dispat ceph NOFD /proc/31480/task/47782/fd (opendir: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47783 ms_local ceph cwd unknown /proc/31480/task/47783/cwd (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47783 ms_local ceph rtd unknown /proc/31480/task/47783/root (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47783 ms_local ceph txt unknown /proc/31480/task/47783/exe (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47783 ms_local ceph NOFD /proc/31480/task/47783/fd (opendir: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47784 safe_time ceph cwd unknown /proc/31480/task/47784/cwd (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47784 safe_time ceph rtd unknown /proc/31480/task/47784/root (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47784 safe_time ceph txt unknown /proc/31480/task/47784/exe (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47784 safe_time ceph NOFD /proc/31480/task/47784/fd (opendir: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47785 safe_time ceph cwd unknown /proc/31480/task/47785/cwd (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47785 safe_time ceph rtd unknown /proc/31480/task/47785/root (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47785 safe_time ceph txt unknown /proc/31480/task/47785/exe (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mgr 31480 47785 safe_time ceph NOFD /proc/31480/task/47785/fd (opendir: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 32446 root cwd unknown /proc/32446/cwd (readlink: Permission denied) 2024-09-12T02:33:16.695 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 32446 root rtd unknown /proc/32446/root (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 32446 root txt unknown /proc/32446/exe (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:systemd 32446 root NOFD /proc/32446/fd (opendir: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 32448 root cwd unknown /proc/32448/cwd (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 32448 root rtd unknown /proc/32448/root (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 32448 root txt unknown /proc/32448/exe (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:(sd-pam) 32448 root NOFD /proc/32448/fd (opendir: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33853 root cwd unknown /proc/33853/cwd (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33853 root rtd unknown /proc/33853/root (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33853 root txt unknown /proc/33853/exe (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33853 root NOFD /proc/33853/fd (opendir: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33856 root cwd unknown /proc/33856/cwd (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33856 root rtd unknown /proc/33856/root (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33856 root txt unknown /proc/33856/exe (readlink: Permission denied) 2024-09-12T02:33:16.696 INFO:tasks.workunit.client.0.smithi001.stdout:sshd 33856 root NOFD /proc/33856/fd (opendir: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34564 root cwd unknown /proc/34564/cwd (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34564 root rtd unknown /proc/34564/root (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34564 root txt unknown /proc/34564/exe (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 34564 root NOFD /proc/34564/fd (opendir: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 38705 root cwd unknown /proc/38705/cwd (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 38705 root rtd unknown /proc/38705/root (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 38705 root txt unknown /proc/38705/exe (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 38705 root NOFD /proc/38705/fd (opendir: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 38985 root cwd unknown /proc/38985/cwd (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 38985 root rtd unknown /proc/38985/root (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 38985 root txt unknown /proc/38985/exe (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 38985 root NOFD /proc/38985/fd (opendir: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 42867 root cwd unknown /proc/42867/cwd (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 42867 root rtd unknown /proc/42867/root (readlink: Permission denied) 2024-09-12T02:33:16.697 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 42867 root txt unknown /proc/42867/exe (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 42867 root NOFD /proc/42867/fd (opendir: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 42869 root cwd unknown /proc/42869/cwd (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 42869 root rtd unknown /proc/42869/root (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 42869 root txt unknown /proc/42869/exe (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 42869 root NOFD /proc/42869/fd (opendir: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 ceph cwd unknown /proc/42871/cwd (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 ceph rtd unknown /proc/42871/root (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 ceph txt unknown /proc/42871/exe (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 ceph NOFD /proc/42871/fd (opendir: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42872 log ceph cwd unknown /proc/42871/task/42872/cwd (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42872 log ceph rtd unknown /proc/42871/task/42872/root (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42872 log ceph txt unknown /proc/42871/task/42872/exe (readlink: Permission denied) 2024-09-12T02:33:16.698 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42872 log ceph NOFD /proc/42871/task/42872/fd (opendir: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42874 msgr-work ceph cwd unknown /proc/42871/task/42874/cwd (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42874 msgr-work ceph rtd unknown /proc/42871/task/42874/root (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42874 msgr-work ceph txt unknown /proc/42871/task/42874/exe (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42874 msgr-work ceph NOFD /proc/42871/task/42874/fd (opendir: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42875 msgr-work ceph cwd unknown /proc/42871/task/42875/cwd (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42875 msgr-work ceph rtd unknown /proc/42871/task/42875/root (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42875 msgr-work ceph txt unknown /proc/42871/task/42875/exe (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42875 msgr-work ceph NOFD /proc/42871/task/42875/fd (opendir: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42876 msgr-work ceph cwd unknown /proc/42871/task/42876/cwd (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42876 msgr-work ceph rtd unknown /proc/42871/task/42876/root (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42876 msgr-work ceph txt unknown /proc/42871/task/42876/exe (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42876 msgr-work ceph NOFD /proc/42871/task/42876/fd (opendir: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42880 service ceph cwd unknown /proc/42871/task/42880/cwd (readlink: Permission denied) 2024-09-12T02:33:16.699 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42880 service ceph rtd unknown /proc/42871/task/42880/root (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42880 service ceph txt unknown /proc/42871/task/42880/exe (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42880 service ceph NOFD /proc/42871/task/42880/fd (opendir: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42881 admin_soc ceph cwd unknown /proc/42871/task/42881/cwd (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42881 admin_soc ceph rtd unknown /proc/42871/task/42881/root (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42881 admin_soc ceph txt unknown /proc/42871/task/42881/exe (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 42881 admin_soc ceph NOFD /proc/42871/task/42881/fd (opendir: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43201 signal_ha ceph cwd unknown /proc/42871/task/43201/cwd (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43201 signal_ha ceph rtd unknown /proc/42871/task/43201/root (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43201 signal_ha ceph txt unknown /proc/42871/task/43201/exe (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43201 signal_ha ceph NOFD /proc/42871/task/43201/fd (opendir: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43202 io_contex ceph cwd unknown /proc/42871/task/43202/cwd (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43202 io_contex ceph rtd unknown /proc/42871/task/43202/root (readlink: Permission denied) 2024-09-12T02:33:16.700 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43202 io_contex ceph txt unknown /proc/42871/task/43202/exe (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43202 io_contex ceph NOFD /proc/42871/task/43202/fd (opendir: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43203 io_contex ceph cwd unknown /proc/42871/task/43203/cwd (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43203 io_contex ceph rtd unknown /proc/42871/task/43203/root (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43203 io_contex ceph txt unknown /proc/42871/task/43203/exe (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43203 io_contex ceph NOFD /proc/42871/task/43203/fd (opendir: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43224 OpHistory ceph cwd unknown /proc/42871/task/43224/cwd (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43224 OpHistory ceph rtd unknown /proc/42871/task/43224/root (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43224 OpHistory ceph txt unknown /proc/42871/task/43224/exe (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43224 OpHistory ceph NOFD /proc/42871/task/43224/fd (opendir: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43225 ceph_time ceph cwd unknown /proc/42871/task/43225/cwd (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43225 ceph_time ceph rtd unknown /proc/42871/task/43225/root (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43225 ceph_time ceph txt unknown /proc/42871/task/43225/exe (readlink: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43225 ceph_time ceph NOFD /proc/42871/task/43225/fd (opendir: Permission denied) 2024-09-12T02:33:16.701 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43235 ceph-osd ceph cwd unknown /proc/42871/task/43235/cwd (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43235 ceph-osd ceph rtd unknown /proc/42871/task/43235/root (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43235 ceph-osd ceph txt unknown /proc/42871/task/43235/exe (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43235 ceph-osd ceph NOFD /proc/42871/task/43235/fd (opendir: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43263 ceph-osd ceph cwd unknown /proc/42871/task/43263/cwd (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43263 ceph-osd ceph rtd unknown /proc/42871/task/43263/root (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43263 ceph-osd ceph txt unknown /proc/42871/task/43263/exe (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43263 ceph-osd ceph NOFD /proc/42871/task/43263/fd (opendir: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43322 ceph-osd ceph cwd unknown /proc/42871/task/43322/cwd (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43322 ceph-osd ceph rtd unknown /proc/42871/task/43322/root (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43322 ceph-osd ceph txt unknown /proc/42871/task/43322/exe (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43322 ceph-osd ceph NOFD /proc/42871/task/43322/fd (opendir: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43334 ceph-osd ceph cwd unknown /proc/42871/task/43334/cwd (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43334 ceph-osd ceph rtd unknown /proc/42871/task/43334/root (readlink: Permission denied) 2024-09-12T02:33:16.702 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43334 ceph-osd ceph txt unknown /proc/42871/task/43334/exe (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43334 ceph-osd ceph NOFD /proc/42871/task/43334/fd (opendir: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43350 ceph-osd ceph cwd unknown /proc/42871/task/43350/cwd (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43350 ceph-osd ceph rtd unknown /proc/42871/task/43350/root (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43350 ceph-osd ceph txt unknown /proc/42871/task/43350/exe (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43350 ceph-osd ceph NOFD /proc/42871/task/43350/fd (opendir: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43360 ceph-osd ceph cwd unknown /proc/42871/task/43360/cwd (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43360 ceph-osd ceph rtd unknown /proc/42871/task/43360/root (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43360 ceph-osd ceph txt unknown /proc/42871/task/43360/exe (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43360 ceph-osd ceph NOFD /proc/42871/task/43360/fd (opendir: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43382 ceph-osd ceph cwd unknown /proc/42871/task/43382/cwd (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43382 ceph-osd ceph rtd unknown /proc/42871/task/43382/root (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43382 ceph-osd ceph txt unknown /proc/42871/task/43382/exe (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43382 ceph-osd ceph NOFD /proc/42871/task/43382/fd (opendir: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43387 ceph-osd ceph cwd unknown /proc/42871/task/43387/cwd (readlink: Permission denied) 2024-09-12T02:33:16.703 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43387 ceph-osd ceph rtd unknown /proc/42871/task/43387/root (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43387 ceph-osd ceph txt unknown /proc/42871/task/43387/exe (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43387 ceph-osd ceph NOFD /proc/42871/task/43387/fd (opendir: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43388 ceph-osd ceph cwd unknown /proc/42871/task/43388/cwd (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43388 ceph-osd ceph rtd unknown /proc/42871/task/43388/root (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43388 ceph-osd ceph txt unknown /proc/42871/task/43388/exe (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43388 ceph-osd ceph NOFD /proc/42871/task/43388/fd (opendir: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43389 safe_time ceph cwd unknown /proc/42871/task/43389/cwd (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43389 safe_time ceph rtd unknown /proc/42871/task/43389/root (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43389 safe_time ceph txt unknown /proc/42871/task/43389/exe (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43389 safe_time ceph NOFD /proc/42871/task/43389/fd (opendir: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43390 safe_time ceph cwd unknown /proc/42871/task/43390/cwd (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43390 safe_time ceph rtd unknown /proc/42871/task/43390/root (readlink: Permission denied) 2024-09-12T02:33:16.704 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43390 safe_time ceph txt unknown /proc/42871/task/43390/exe (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43390 safe_time ceph NOFD /proc/42871/task/43390/fd (opendir: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43391 safe_time ceph cwd unknown /proc/42871/task/43391/cwd (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43391 safe_time ceph rtd unknown /proc/42871/task/43391/root (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43391 safe_time ceph txt unknown /proc/42871/task/43391/exe (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43391 safe_time ceph NOFD /proc/42871/task/43391/fd (opendir: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43392 safe_time ceph cwd unknown /proc/42871/task/43392/cwd (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43392 safe_time ceph rtd unknown /proc/42871/task/43392/root (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43392 safe_time ceph txt unknown /proc/42871/task/43392/exe (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43392 safe_time ceph NOFD /proc/42871/task/43392/fd (opendir: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43393 fn_anonym ceph cwd unknown /proc/42871/task/43393/cwd (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43393 fn_anonym ceph rtd unknown /proc/42871/task/43393/root (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43393 fn_anonym ceph txt unknown /proc/42871/task/43393/exe (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43393 fn_anonym ceph NOFD /proc/42871/task/43393/fd (opendir: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43498 rocksdb:l ceph cwd unknown /proc/42871/task/43498/cwd (readlink: Permission denied) 2024-09-12T02:33:16.705 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43498 rocksdb:l ceph rtd unknown /proc/42871/task/43498/root (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43498 rocksdb:l ceph txt unknown /proc/42871/task/43498/exe (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43498 rocksdb:l ceph NOFD /proc/42871/task/43498/fd (opendir: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43499 rocksdb:l ceph cwd unknown /proc/42871/task/43499/cwd (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43499 rocksdb:l ceph rtd unknown /proc/42871/task/43499/root (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43499 rocksdb:l ceph txt unknown /proc/42871/task/43499/exe (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43499 rocksdb:l ceph NOFD /proc/42871/task/43499/fd (opendir: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43500 rocksdb:l ceph cwd unknown /proc/42871/task/43500/cwd (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43500 rocksdb:l ceph rtd unknown /proc/42871/task/43500/root (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43500 rocksdb:l ceph txt unknown /proc/42871/task/43500/exe (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43500 rocksdb:l ceph NOFD /proc/42871/task/43500/fd (opendir: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43501 rocksdb:h ceph cwd unknown /proc/42871/task/43501/cwd (readlink: Permission denied) 2024-09-12T02:33:16.706 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43501 rocksdb:h ceph rtd unknown /proc/42871/task/43501/root (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43501 rocksdb:h ceph txt unknown /proc/42871/task/43501/exe (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43501 rocksdb:h ceph NOFD /proc/42871/task/43501/fd (opendir: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43946 bstore_ai ceph cwd unknown /proc/42871/task/43946/cwd (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43946 bstore_ai ceph rtd unknown /proc/42871/task/43946/root (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43946 bstore_ai ceph txt unknown /proc/42871/task/43946/exe (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 43946 bstore_ai ceph NOFD /proc/42871/task/43946/fd (opendir: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44130 bstore_ai ceph cwd unknown /proc/42871/task/44130/cwd (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44130 bstore_ai ceph rtd unknown /proc/42871/task/44130/root (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44130 bstore_ai ceph txt unknown /proc/42871/task/44130/exe (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44130 bstore_ai ceph NOFD /proc/42871/task/44130/fd (opendir: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44312 ceph-osd ceph cwd unknown /proc/42871/task/44312/cwd (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44312 ceph-osd ceph rtd unknown /proc/42871/task/44312/root (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44312 ceph-osd ceph txt unknown /proc/42871/task/44312/exe (readlink: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44312 ceph-osd ceph NOFD /proc/42871/task/44312/fd (opendir: Permission denied) 2024-09-12T02:33:16.707 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44313 cfin ceph cwd unknown /proc/42871/task/44313/cwd (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44313 cfin ceph rtd unknown /proc/42871/task/44313/root (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44313 cfin ceph txt unknown /proc/42871/task/44313/exe (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44313 cfin ceph NOFD /proc/42871/task/44313/fd (opendir: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44314 bstore_kv ceph cwd unknown /proc/42871/task/44314/cwd (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44314 bstore_kv ceph rtd unknown /proc/42871/task/44314/root (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44314 bstore_kv ceph txt unknown /proc/42871/task/44314/exe (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44314 bstore_kv ceph NOFD /proc/42871/task/44314/fd (opendir: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44315 bstore_kv ceph cwd unknown /proc/42871/task/44315/cwd (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44315 bstore_kv ceph rtd unknown /proc/42871/task/44315/root (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44315 bstore_kv ceph txt unknown /proc/42871/task/44315/exe (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44315 bstore_kv ceph NOFD /proc/42871/task/44315/fd (opendir: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44316 bstore_me ceph cwd unknown /proc/42871/task/44316/cwd (readlink: Permission denied) 2024-09-12T02:33:16.708 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44316 bstore_me ceph rtd unknown /proc/42871/task/44316/root (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44316 bstore_me ceph txt unknown /proc/42871/task/44316/exe (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44316 bstore_me ceph NOFD /proc/42871/task/44316/fd (opendir: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44317 ms_dispat ceph cwd unknown /proc/42871/task/44317/cwd (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44317 ms_dispat ceph rtd unknown /proc/42871/task/44317/root (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44317 ms_dispat ceph txt unknown /proc/42871/task/44317/exe (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44317 ms_dispat ceph NOFD /proc/42871/task/44317/fd (opendir: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44318 ms_local ceph cwd unknown /proc/42871/task/44318/cwd (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44318 ms_local ceph rtd unknown /proc/42871/task/44318/root (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44318 ms_local ceph txt unknown /proc/42871/task/44318/exe (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44318 ms_local ceph NOFD /proc/42871/task/44318/fd (opendir: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44319 safe_time ceph cwd unknown /proc/42871/task/44319/cwd (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44319 safe_time ceph rtd unknown /proc/42871/task/44319/root (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44319 safe_time ceph txt unknown /proc/42871/task/44319/exe (readlink: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44319 safe_time ceph NOFD /proc/42871/task/44319/fd (opendir: Permission denied) 2024-09-12T02:33:16.709 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44320 safe_time ceph cwd unknown /proc/42871/task/44320/cwd (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44320 safe_time ceph rtd unknown /proc/42871/task/44320/root (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44320 safe_time ceph txt unknown /proc/42871/task/44320/exe (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44320 safe_time ceph NOFD /proc/42871/task/44320/fd (opendir: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44321 ms_dispat ceph cwd unknown /proc/42871/task/44321/cwd (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44321 ms_dispat ceph rtd unknown /proc/42871/task/44321/root (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44321 ms_dispat ceph txt unknown /proc/42871/task/44321/exe (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44321 ms_dispat ceph NOFD /proc/42871/task/44321/fd (opendir: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44322 ms_local ceph cwd unknown /proc/42871/task/44322/cwd (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44322 ms_local ceph rtd unknown /proc/42871/task/44322/root (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44322 ms_local ceph txt unknown /proc/42871/task/44322/exe (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44322 ms_local ceph NOFD /proc/42871/task/44322/fd (opendir: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44323 ms_dispat ceph cwd unknown /proc/42871/task/44323/cwd (readlink: Permission denied) 2024-09-12T02:33:16.710 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44323 ms_dispat ceph rtd unknown /proc/42871/task/44323/root (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44323 ms_dispat ceph txt unknown /proc/42871/task/44323/exe (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44323 ms_dispat ceph NOFD /proc/42871/task/44323/fd (opendir: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44324 ms_local ceph cwd unknown /proc/42871/task/44324/cwd (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44324 ms_local ceph rtd unknown /proc/42871/task/44324/root (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44324 ms_local ceph txt unknown /proc/42871/task/44324/exe (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44324 ms_local ceph NOFD /proc/42871/task/44324/fd (opendir: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44325 ms_dispat ceph cwd unknown /proc/42871/task/44325/cwd (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44325 ms_dispat ceph rtd unknown /proc/42871/task/44325/root (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44325 ms_dispat ceph txt unknown /proc/42871/task/44325/exe (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44325 ms_dispat ceph NOFD /proc/42871/task/44325/fd (opendir: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44326 ms_local ceph cwd unknown /proc/42871/task/44326/cwd (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44326 ms_local ceph rtd unknown /proc/42871/task/44326/root (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44326 ms_local ceph txt unknown /proc/42871/task/44326/exe (readlink: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44326 ms_local ceph NOFD /proc/42871/task/44326/fd (opendir: Permission denied) 2024-09-12T02:33:16.711 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44327 ms_dispat ceph cwd unknown /proc/42871/task/44327/cwd (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44327 ms_dispat ceph rtd unknown /proc/42871/task/44327/root (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44327 ms_dispat ceph txt unknown /proc/42871/task/44327/exe (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44327 ms_dispat ceph NOFD /proc/42871/task/44327/fd (opendir: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44328 ms_local ceph cwd unknown /proc/42871/task/44328/cwd (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44328 ms_local ceph rtd unknown /proc/42871/task/44328/root (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44328 ms_local ceph txt unknown /proc/42871/task/44328/exe (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44328 ms_local ceph NOFD /proc/42871/task/44328/fd (opendir: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44329 ms_dispat ceph cwd unknown /proc/42871/task/44329/cwd (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44329 ms_dispat ceph rtd unknown /proc/42871/task/44329/root (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44329 ms_dispat ceph txt unknown /proc/42871/task/44329/exe (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44329 ms_dispat ceph NOFD /proc/42871/task/44329/fd (opendir: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44330 ms_local ceph cwd unknown /proc/42871/task/44330/cwd (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44330 ms_local ceph rtd unknown /proc/42871/task/44330/root (readlink: Permission denied) 2024-09-12T02:33:16.712 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44330 ms_local ceph txt unknown /proc/42871/task/44330/exe (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44330 ms_local ceph NOFD /proc/42871/task/44330/fd (opendir: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44331 ms_dispat ceph cwd unknown /proc/42871/task/44331/cwd (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44331 ms_dispat ceph rtd unknown /proc/42871/task/44331/root (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44331 ms_dispat ceph txt unknown /proc/42871/task/44331/exe (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44331 ms_dispat ceph NOFD /proc/42871/task/44331/fd (opendir: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44332 ms_local ceph cwd unknown /proc/42871/task/44332/cwd (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44332 ms_local ceph rtd unknown /proc/42871/task/44332/root (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44332 ms_local ceph txt unknown /proc/42871/task/44332/exe (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44332 ms_local ceph NOFD /proc/42871/task/44332/fd (opendir: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44333 fn_anonym ceph cwd unknown /proc/42871/task/44333/cwd (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44333 fn_anonym ceph rtd unknown /proc/42871/task/44333/root (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44333 fn_anonym ceph txt unknown /proc/42871/task/44333/exe (readlink: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44333 fn_anonym ceph NOFD /proc/42871/task/44333/fd (opendir: Permission denied) 2024-09-12T02:33:16.713 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44334 finisher ceph cwd unknown /proc/42871/task/44334/cwd (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44334 finisher ceph rtd unknown /proc/42871/task/44334/root (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44334 finisher ceph txt unknown /proc/42871/task/44334/exe (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44334 finisher ceph NOFD /proc/42871/task/44334/fd (opendir: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44335 safe_time ceph cwd unknown /proc/42871/task/44335/cwd (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44335 safe_time ceph rtd unknown /proc/42871/task/44335/root (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44335 safe_time ceph txt unknown /proc/42871/task/44335/exe (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44335 safe_time ceph NOFD /proc/42871/task/44335/fd (opendir: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44336 safe_time ceph cwd unknown /proc/42871/task/44336/cwd (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44336 safe_time ceph rtd unknown /proc/42871/task/44336/root (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44336 safe_time ceph txt unknown /proc/42871/task/44336/exe (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44336 safe_time ceph NOFD /proc/42871/task/44336/fd (opendir: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44337 ceph-osd ceph cwd unknown /proc/42871/task/44337/cwd (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44337 ceph-osd ceph rtd unknown /proc/42871/task/44337/root (readlink: Permission denied) 2024-09-12T02:33:16.714 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44337 ceph-osd ceph txt unknown /proc/42871/task/44337/exe (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44337 ceph-osd ceph NOFD /proc/42871/task/44337/fd (opendir: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44338 osd_srv_a ceph cwd unknown /proc/42871/task/44338/cwd (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44338 osd_srv_a ceph rtd unknown /proc/42871/task/44338/root (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44338 osd_srv_a ceph txt unknown /proc/42871/task/44338/exe (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44338 osd_srv_a ceph NOFD /proc/42871/task/44338/fd (opendir: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44339 tp_osd_tp ceph cwd unknown /proc/42871/task/44339/cwd (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44339 tp_osd_tp ceph rtd unknown /proc/42871/task/44339/root (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44339 tp_osd_tp ceph txt unknown /proc/42871/task/44339/exe (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44339 tp_osd_tp ceph NOFD /proc/42871/task/44339/fd (opendir: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44340 tp_osd_tp ceph cwd unknown /proc/42871/task/44340/cwd (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44340 tp_osd_tp ceph rtd unknown /proc/42871/task/44340/root (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44340 tp_osd_tp ceph txt unknown /proc/42871/task/44340/exe (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44340 tp_osd_tp ceph NOFD /proc/42871/task/44340/fd (opendir: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44341 tp_osd_tp ceph cwd unknown /proc/42871/task/44341/cwd (readlink: Permission denied) 2024-09-12T02:33:16.715 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44341 tp_osd_tp ceph rtd unknown /proc/42871/task/44341/root (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44341 tp_osd_tp ceph txt unknown /proc/42871/task/44341/exe (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44341 tp_osd_tp ceph NOFD /proc/42871/task/44341/fd (opendir: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44342 tp_osd_tp ceph cwd unknown /proc/42871/task/44342/cwd (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44342 tp_osd_tp ceph rtd unknown /proc/42871/task/44342/root (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44342 tp_osd_tp ceph txt unknown /proc/42871/task/44342/exe (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44342 tp_osd_tp ceph NOFD /proc/42871/task/44342/fd (opendir: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44343 tp_osd_tp ceph cwd unknown /proc/42871/task/44343/cwd (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44343 tp_osd_tp ceph rtd unknown /proc/42871/task/44343/root (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44343 tp_osd_tp ceph txt unknown /proc/42871/task/44343/exe (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44343 tp_osd_tp ceph NOFD /proc/42871/task/44343/fd (opendir: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44344 tp_osd_tp ceph cwd unknown /proc/42871/task/44344/cwd (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44344 tp_osd_tp ceph rtd unknown /proc/42871/task/44344/root (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44344 tp_osd_tp ceph txt unknown /proc/42871/task/44344/exe (readlink: Permission denied) 2024-09-12T02:33:16.716 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44344 tp_osd_tp ceph NOFD /proc/42871/task/44344/fd (opendir: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44345 tp_osd_tp ceph cwd unknown /proc/42871/task/44345/cwd (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44345 tp_osd_tp ceph rtd unknown /proc/42871/task/44345/root (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44345 tp_osd_tp ceph txt unknown /proc/42871/task/44345/exe (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44345 tp_osd_tp ceph NOFD /proc/42871/task/44345/fd (opendir: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44346 tp_osd_tp ceph cwd unknown /proc/42871/task/44346/cwd (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44346 tp_osd_tp ceph rtd unknown /proc/42871/task/44346/root (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44346 tp_osd_tp ceph txt unknown /proc/42871/task/44346/exe (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44346 tp_osd_tp ceph NOFD /proc/42871/task/44346/fd (opendir: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44347 tp_osd_tp ceph cwd unknown /proc/42871/task/44347/cwd (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44347 tp_osd_tp ceph rtd unknown /proc/42871/task/44347/root (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44347 tp_osd_tp ceph txt unknown /proc/42871/task/44347/exe (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44347 tp_osd_tp ceph NOFD /proc/42871/task/44347/fd (opendir: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44348 tp_osd_tp ceph cwd unknown /proc/42871/task/44348/cwd (readlink: Permission denied) 2024-09-12T02:33:16.717 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44348 tp_osd_tp ceph rtd unknown /proc/42871/task/44348/root (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44348 tp_osd_tp ceph txt unknown /proc/42871/task/44348/exe (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44348 tp_osd_tp ceph NOFD /proc/42871/task/44348/fd (opendir: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44349 tp_osd_tp ceph cwd unknown /proc/42871/task/44349/cwd (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44349 tp_osd_tp ceph rtd unknown /proc/42871/task/44349/root (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44349 tp_osd_tp ceph txt unknown /proc/42871/task/44349/exe (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44349 tp_osd_tp ceph NOFD /proc/42871/task/44349/fd (opendir: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44350 tp_osd_tp ceph cwd unknown /proc/42871/task/44350/cwd (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44350 tp_osd_tp ceph rtd unknown /proc/42871/task/44350/root (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44350 tp_osd_tp ceph txt unknown /proc/42871/task/44350/exe (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44350 tp_osd_tp ceph NOFD /proc/42871/task/44350/fd (opendir: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44351 tp_osd_tp ceph cwd unknown /proc/42871/task/44351/cwd (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44351 tp_osd_tp ceph rtd unknown /proc/42871/task/44351/root (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44351 tp_osd_tp ceph txt unknown /proc/42871/task/44351/exe (readlink: Permission denied) 2024-09-12T02:33:16.718 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44351 tp_osd_tp ceph NOFD /proc/42871/task/44351/fd (opendir: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44352 tp_osd_tp ceph cwd unknown /proc/42871/task/44352/cwd (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44352 tp_osd_tp ceph rtd unknown /proc/42871/task/44352/root (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44352 tp_osd_tp ceph txt unknown /proc/42871/task/44352/exe (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44352 tp_osd_tp ceph NOFD /proc/42871/task/44352/fd (opendir: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44353 tp_osd_tp ceph cwd unknown /proc/42871/task/44353/cwd (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44353 tp_osd_tp ceph rtd unknown /proc/42871/task/44353/root (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44353 tp_osd_tp ceph txt unknown /proc/42871/task/44353/exe (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44353 tp_osd_tp ceph NOFD /proc/42871/task/44353/fd (opendir: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44354 tp_osd_tp ceph cwd unknown /proc/42871/task/44354/cwd (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44354 tp_osd_tp ceph rtd unknown /proc/42871/task/44354/root (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44354 tp_osd_tp ceph txt unknown /proc/42871/task/44354/exe (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44354 tp_osd_tp ceph NOFD /proc/42871/task/44354/fd (opendir: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44355 osd_srv_h ceph cwd unknown /proc/42871/task/44355/cwd (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44355 osd_srv_h ceph rtd unknown /proc/42871/task/44355/root (readlink: Permission denied) 2024-09-12T02:33:16.719 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44355 osd_srv_h ceph txt unknown /proc/42871/task/44355/exe (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 42871 44355 osd_srv_h ceph NOFD /proc/42871/task/44355/fd (opendir: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 43868 root cwd unknown /proc/43868/cwd (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 43868 root rtd unknown /proc/43868/root (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 43868 root txt unknown /proc/43868/exe (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 43868 root NOFD /proc/43868/fd (opendir: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 43887 root cwd unknown /proc/43887/cwd (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 43887 root rtd unknown /proc/43887/root (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 43887 root txt unknown /proc/43887/exe (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 43887 root NOFD /proc/43887/fd (opendir: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 49762 root cwd unknown /proc/49762/cwd (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 49762 root rtd unknown /proc/49762/root (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 49762 root txt unknown /proc/49762/exe (readlink: Permission denied) 2024-09-12T02:33:16.720 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 49762 root NOFD /proc/49762/fd (opendir: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 49764 root cwd unknown /proc/49764/cwd (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 49764 root rtd unknown /proc/49764/root (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 49764 root txt unknown /proc/49764/exe (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 49764 root NOFD /proc/49764/fd (opendir: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 ceph cwd unknown /proc/49766/cwd (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 ceph rtd unknown /proc/49766/root (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 ceph txt unknown /proc/49766/exe (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 ceph NOFD /proc/49766/fd (opendir: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49767 log ceph cwd unknown /proc/49766/task/49767/cwd (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49767 log ceph rtd unknown /proc/49766/task/49767/root (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49767 log ceph txt unknown /proc/49766/task/49767/exe (readlink: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49767 log ceph NOFD /proc/49766/task/49767/fd (opendir: Permission denied) 2024-09-12T02:33:16.721 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49769 msgr-work ceph cwd unknown /proc/49766/task/49769/cwd (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49769 msgr-work ceph rtd unknown /proc/49766/task/49769/root (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49769 msgr-work ceph txt unknown /proc/49766/task/49769/exe (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49769 msgr-work ceph NOFD /proc/49766/task/49769/fd (opendir: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49770 msgr-work ceph cwd unknown /proc/49766/task/49770/cwd (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49770 msgr-work ceph rtd unknown /proc/49766/task/49770/root (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49770 msgr-work ceph txt unknown /proc/49766/task/49770/exe (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49770 msgr-work ceph NOFD /proc/49766/task/49770/fd (opendir: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49771 msgr-work ceph cwd unknown /proc/49766/task/49771/cwd (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49771 msgr-work ceph rtd unknown /proc/49766/task/49771/root (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49771 msgr-work ceph txt unknown /proc/49766/task/49771/exe (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49771 msgr-work ceph NOFD /proc/49766/task/49771/fd (opendir: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49775 service ceph cwd unknown /proc/49766/task/49775/cwd (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49775 service ceph rtd unknown /proc/49766/task/49775/root (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49775 service ceph txt unknown /proc/49766/task/49775/exe (readlink: Permission denied) 2024-09-12T02:33:16.722 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49775 service ceph NOFD /proc/49766/task/49775/fd (opendir: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49776 admin_soc ceph cwd unknown /proc/49766/task/49776/cwd (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49776 admin_soc ceph rtd unknown /proc/49766/task/49776/root (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49776 admin_soc ceph txt unknown /proc/49766/task/49776/exe (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 49776 admin_soc ceph NOFD /proc/49766/task/49776/fd (opendir: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50102 signal_ha ceph cwd unknown /proc/49766/task/50102/cwd (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50102 signal_ha ceph rtd unknown /proc/49766/task/50102/root (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50102 signal_ha ceph txt unknown /proc/49766/task/50102/exe (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50102 signal_ha ceph NOFD /proc/49766/task/50102/fd (opendir: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50103 io_contex ceph cwd unknown /proc/49766/task/50103/cwd (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50103 io_contex ceph rtd unknown /proc/49766/task/50103/root (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50103 io_contex ceph txt unknown /proc/49766/task/50103/exe (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50103 io_contex ceph NOFD /proc/49766/task/50103/fd (opendir: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50104 io_contex ceph cwd unknown /proc/49766/task/50104/cwd (readlink: Permission denied) 2024-09-12T02:33:16.723 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50104 io_contex ceph rtd unknown /proc/49766/task/50104/root (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50104 io_contex ceph txt unknown /proc/49766/task/50104/exe (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50104 io_contex ceph NOFD /proc/49766/task/50104/fd (opendir: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50107 OpHistory ceph cwd unknown /proc/49766/task/50107/cwd (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50107 OpHistory ceph rtd unknown /proc/49766/task/50107/root (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50107 OpHistory ceph txt unknown /proc/49766/task/50107/exe (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50107 OpHistory ceph NOFD /proc/49766/task/50107/fd (opendir: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50108 ceph_time ceph cwd unknown /proc/49766/task/50108/cwd (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50108 ceph_time ceph rtd unknown /proc/49766/task/50108/root (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50108 ceph_time ceph txt unknown /proc/49766/task/50108/exe (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50108 ceph_time ceph NOFD /proc/49766/task/50108/fd (opendir: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50134 ceph-osd ceph cwd unknown /proc/49766/task/50134/cwd (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50134 ceph-osd ceph rtd unknown /proc/49766/task/50134/root (readlink: Permission denied) 2024-09-12T02:33:16.724 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50134 ceph-osd ceph txt unknown /proc/49766/task/50134/exe (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50134 ceph-osd ceph NOFD /proc/49766/task/50134/fd (opendir: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50155 ceph-osd ceph cwd unknown /proc/49766/task/50155/cwd (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50155 ceph-osd ceph rtd unknown /proc/49766/task/50155/root (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50155 ceph-osd ceph txt unknown /proc/49766/task/50155/exe (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50155 ceph-osd ceph NOFD /proc/49766/task/50155/fd (opendir: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50167 ceph-osd ceph cwd unknown /proc/49766/task/50167/cwd (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50167 ceph-osd ceph rtd unknown /proc/49766/task/50167/root (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50167 ceph-osd ceph txt unknown /proc/49766/task/50167/exe (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50167 ceph-osd ceph NOFD /proc/49766/task/50167/fd (opendir: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50254 ceph-osd ceph cwd unknown /proc/49766/task/50254/cwd (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50254 ceph-osd ceph rtd unknown /proc/49766/task/50254/root (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50254 ceph-osd ceph txt unknown /proc/49766/task/50254/exe (readlink: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50254 ceph-osd ceph NOFD /proc/49766/task/50254/fd (opendir: Permission denied) 2024-09-12T02:33:16.725 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50263 ceph-osd ceph cwd unknown /proc/49766/task/50263/cwd (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50263 ceph-osd ceph rtd unknown /proc/49766/task/50263/root (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50263 ceph-osd ceph txt unknown /proc/49766/task/50263/exe (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50263 ceph-osd ceph NOFD /proc/49766/task/50263/fd (opendir: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50288 ceph-osd ceph cwd unknown /proc/49766/task/50288/cwd (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50288 ceph-osd ceph rtd unknown /proc/49766/task/50288/root (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50288 ceph-osd ceph txt unknown /proc/49766/task/50288/exe (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50288 ceph-osd ceph NOFD /proc/49766/task/50288/fd (opendir: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50296 ceph-osd ceph cwd unknown /proc/49766/task/50296/cwd (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50296 ceph-osd ceph rtd unknown /proc/49766/task/50296/root (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50296 ceph-osd ceph txt unknown /proc/49766/task/50296/exe (readlink: Permission denied) 2024-09-12T02:33:16.726 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50296 ceph-osd ceph NOFD /proc/49766/task/50296/fd (opendir: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50299 ceph-osd ceph cwd unknown /proc/49766/task/50299/cwd (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50299 ceph-osd ceph rtd unknown /proc/49766/task/50299/root (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50299 ceph-osd ceph txt unknown /proc/49766/task/50299/exe (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50299 ceph-osd ceph NOFD /proc/49766/task/50299/fd (opendir: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50300 ceph-osd ceph cwd unknown /proc/49766/task/50300/cwd (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50300 ceph-osd ceph rtd unknown /proc/49766/task/50300/root (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50300 ceph-osd ceph txt unknown /proc/49766/task/50300/exe (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50300 ceph-osd ceph NOFD /proc/49766/task/50300/fd (opendir: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50301 safe_time ceph cwd unknown /proc/49766/task/50301/cwd (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50301 safe_time ceph rtd unknown /proc/49766/task/50301/root (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50301 safe_time ceph txt unknown /proc/49766/task/50301/exe (readlink: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50301 safe_time ceph NOFD /proc/49766/task/50301/fd (opendir: Permission denied) 2024-09-12T02:33:16.727 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50303 safe_time ceph cwd unknown /proc/49766/task/50303/cwd (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50303 safe_time ceph rtd unknown /proc/49766/task/50303/root (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50303 safe_time ceph txt unknown /proc/49766/task/50303/exe (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50303 safe_time ceph NOFD /proc/49766/task/50303/fd (opendir: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50304 safe_time ceph cwd unknown /proc/49766/task/50304/cwd (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50304 safe_time ceph rtd unknown /proc/49766/task/50304/root (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50304 safe_time ceph txt unknown /proc/49766/task/50304/exe (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50304 safe_time ceph NOFD /proc/49766/task/50304/fd (opendir: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50305 safe_time ceph cwd unknown /proc/49766/task/50305/cwd (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50305 safe_time ceph rtd unknown /proc/49766/task/50305/root (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50305 safe_time ceph txt unknown /proc/49766/task/50305/exe (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50305 safe_time ceph NOFD /proc/49766/task/50305/fd (opendir: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50306 fn_anonym ceph cwd unknown /proc/49766/task/50306/cwd (readlink: Permission denied) 2024-09-12T02:33:16.728 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50306 fn_anonym ceph rtd unknown /proc/49766/task/50306/root (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50306 fn_anonym ceph txt unknown /proc/49766/task/50306/exe (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50306 fn_anonym ceph NOFD /proc/49766/task/50306/fd (opendir: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50435 rocksdb:l ceph cwd unknown /proc/49766/task/50435/cwd (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50435 rocksdb:l ceph rtd unknown /proc/49766/task/50435/root (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50435 rocksdb:l ceph txt unknown /proc/49766/task/50435/exe (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50435 rocksdb:l ceph NOFD /proc/49766/task/50435/fd (opendir: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50436 rocksdb:l ceph cwd unknown /proc/49766/task/50436/cwd (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50436 rocksdb:l ceph rtd unknown /proc/49766/task/50436/root (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50436 rocksdb:l ceph txt unknown /proc/49766/task/50436/exe (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50436 rocksdb:l ceph NOFD /proc/49766/task/50436/fd (opendir: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50437 rocksdb:l ceph cwd unknown /proc/49766/task/50437/cwd (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50437 rocksdb:l ceph rtd unknown /proc/49766/task/50437/root (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50437 rocksdb:l ceph txt unknown /proc/49766/task/50437/exe (readlink: Permission denied) 2024-09-12T02:33:16.729 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50437 rocksdb:l ceph NOFD /proc/49766/task/50437/fd (opendir: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50438 rocksdb:h ceph cwd unknown /proc/49766/task/50438/cwd (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50438 rocksdb:h ceph rtd unknown /proc/49766/task/50438/root (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50438 rocksdb:h ceph txt unknown /proc/49766/task/50438/exe (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50438 rocksdb:h ceph NOFD /proc/49766/task/50438/fd (opendir: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50858 bstore_ai ceph cwd unknown /proc/49766/task/50858/cwd (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50858 bstore_ai ceph rtd unknown /proc/49766/task/50858/root (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50858 bstore_ai ceph txt unknown /proc/49766/task/50858/exe (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 50858 bstore_ai ceph NOFD /proc/49766/task/50858/fd (opendir: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51044 bstore_ai ceph cwd unknown /proc/49766/task/51044/cwd (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51044 bstore_ai ceph rtd unknown /proc/49766/task/51044/root (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51044 bstore_ai ceph txt unknown /proc/49766/task/51044/exe (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51044 bstore_ai ceph NOFD /proc/49766/task/51044/fd (opendir: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51226 ceph-osd ceph cwd unknown /proc/49766/task/51226/cwd (readlink: Permission denied) 2024-09-12T02:33:16.730 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51226 ceph-osd ceph rtd unknown /proc/49766/task/51226/root (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51226 ceph-osd ceph txt unknown /proc/49766/task/51226/exe (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51226 ceph-osd ceph NOFD /proc/49766/task/51226/fd (opendir: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51227 cfin ceph cwd unknown /proc/49766/task/51227/cwd (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51227 cfin ceph rtd unknown /proc/49766/task/51227/root (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51227 cfin ceph txt unknown /proc/49766/task/51227/exe (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51227 cfin ceph NOFD /proc/49766/task/51227/fd (opendir: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51228 bstore_kv ceph cwd unknown /proc/49766/task/51228/cwd (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51228 bstore_kv ceph rtd unknown /proc/49766/task/51228/root (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51228 bstore_kv ceph txt unknown /proc/49766/task/51228/exe (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51228 bstore_kv ceph NOFD /proc/49766/task/51228/fd (opendir: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51229 bstore_kv ceph cwd unknown /proc/49766/task/51229/cwd (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51229 bstore_kv ceph rtd unknown /proc/49766/task/51229/root (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51229 bstore_kv ceph txt unknown /proc/49766/task/51229/exe (readlink: Permission denied) 2024-09-12T02:33:16.731 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51229 bstore_kv ceph NOFD /proc/49766/task/51229/fd (opendir: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51230 bstore_me ceph cwd unknown /proc/49766/task/51230/cwd (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51230 bstore_me ceph rtd unknown /proc/49766/task/51230/root (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51230 bstore_me ceph txt unknown /proc/49766/task/51230/exe (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51230 bstore_me ceph NOFD /proc/49766/task/51230/fd (opendir: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51231 ms_dispat ceph cwd unknown /proc/49766/task/51231/cwd (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51231 ms_dispat ceph rtd unknown /proc/49766/task/51231/root (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51231 ms_dispat ceph txt unknown /proc/49766/task/51231/exe (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51231 ms_dispat ceph NOFD /proc/49766/task/51231/fd (opendir: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51232 ms_local ceph cwd unknown /proc/49766/task/51232/cwd (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51232 ms_local ceph rtd unknown /proc/49766/task/51232/root (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51232 ms_local ceph txt unknown /proc/49766/task/51232/exe (readlink: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51232 ms_local ceph NOFD /proc/49766/task/51232/fd (opendir: Permission denied) 2024-09-12T02:33:16.732 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51233 safe_time ceph cwd unknown /proc/49766/task/51233/cwd (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51233 safe_time ceph rtd unknown /proc/49766/task/51233/root (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51233 safe_time ceph txt unknown /proc/49766/task/51233/exe (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51233 safe_time ceph NOFD /proc/49766/task/51233/fd (opendir: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51234 safe_time ceph cwd unknown /proc/49766/task/51234/cwd (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51234 safe_time ceph rtd unknown /proc/49766/task/51234/root (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51234 safe_time ceph txt unknown /proc/49766/task/51234/exe (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51234 safe_time ceph NOFD /proc/49766/task/51234/fd (opendir: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51235 ms_dispat ceph cwd unknown /proc/49766/task/51235/cwd (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51235 ms_dispat ceph rtd unknown /proc/49766/task/51235/root (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51235 ms_dispat ceph txt unknown /proc/49766/task/51235/exe (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51235 ms_dispat ceph NOFD /proc/49766/task/51235/fd (opendir: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51236 ms_local ceph cwd unknown /proc/49766/task/51236/cwd (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51236 ms_local ceph rtd unknown /proc/49766/task/51236/root (readlink: Permission denied) 2024-09-12T02:33:16.733 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51236 ms_local ceph txt unknown /proc/49766/task/51236/exe (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51236 ms_local ceph NOFD /proc/49766/task/51236/fd (opendir: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51237 ms_dispat ceph cwd unknown /proc/49766/task/51237/cwd (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51237 ms_dispat ceph rtd unknown /proc/49766/task/51237/root (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51237 ms_dispat ceph txt unknown /proc/49766/task/51237/exe (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51237 ms_dispat ceph NOFD /proc/49766/task/51237/fd (opendir: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51238 ms_local ceph cwd unknown /proc/49766/task/51238/cwd (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51238 ms_local ceph rtd unknown /proc/49766/task/51238/root (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51238 ms_local ceph txt unknown /proc/49766/task/51238/exe (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51238 ms_local ceph NOFD /proc/49766/task/51238/fd (opendir: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51239 ms_dispat ceph cwd unknown /proc/49766/task/51239/cwd (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51239 ms_dispat ceph rtd unknown /proc/49766/task/51239/root (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51239 ms_dispat ceph txt unknown /proc/49766/task/51239/exe (readlink: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51239 ms_dispat ceph NOFD /proc/49766/task/51239/fd (opendir: Permission denied) 2024-09-12T02:33:16.734 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51240 ms_local ceph cwd unknown /proc/49766/task/51240/cwd (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51240 ms_local ceph rtd unknown /proc/49766/task/51240/root (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51240 ms_local ceph txt unknown /proc/49766/task/51240/exe (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51240 ms_local ceph NOFD /proc/49766/task/51240/fd (opendir: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51241 ms_dispat ceph cwd unknown /proc/49766/task/51241/cwd (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51241 ms_dispat ceph rtd unknown /proc/49766/task/51241/root (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51241 ms_dispat ceph txt unknown /proc/49766/task/51241/exe (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51241 ms_dispat ceph NOFD /proc/49766/task/51241/fd (opendir: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51242 ms_local ceph cwd unknown /proc/49766/task/51242/cwd (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51242 ms_local ceph rtd unknown /proc/49766/task/51242/root (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51242 ms_local ceph txt unknown /proc/49766/task/51242/exe (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51242 ms_local ceph NOFD /proc/49766/task/51242/fd (opendir: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51243 ms_dispat ceph cwd unknown /proc/49766/task/51243/cwd (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51243 ms_dispat ceph rtd unknown /proc/49766/task/51243/root (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51243 ms_dispat ceph txt unknown /proc/49766/task/51243/exe (readlink: Permission denied) 2024-09-12T02:33:16.735 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51243 ms_dispat ceph NOFD /proc/49766/task/51243/fd (opendir: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51244 ms_local ceph cwd unknown /proc/49766/task/51244/cwd (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51244 ms_local ceph rtd unknown /proc/49766/task/51244/root (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51244 ms_local ceph txt unknown /proc/49766/task/51244/exe (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51244 ms_local ceph NOFD /proc/49766/task/51244/fd (opendir: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51245 ms_dispat ceph cwd unknown /proc/49766/task/51245/cwd (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51245 ms_dispat ceph rtd unknown /proc/49766/task/51245/root (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51245 ms_dispat ceph txt unknown /proc/49766/task/51245/exe (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51245 ms_dispat ceph NOFD /proc/49766/task/51245/fd (opendir: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51246 ms_local ceph cwd unknown /proc/49766/task/51246/cwd (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51246 ms_local ceph rtd unknown /proc/49766/task/51246/root (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51246 ms_local ceph txt unknown /proc/49766/task/51246/exe (readlink: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51246 ms_local ceph NOFD /proc/49766/task/51246/fd (opendir: Permission denied) 2024-09-12T02:33:16.736 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51247 fn_anonym ceph cwd unknown /proc/49766/task/51247/cwd (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51247 fn_anonym ceph rtd unknown /proc/49766/task/51247/root (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51247 fn_anonym ceph txt unknown /proc/49766/task/51247/exe (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51247 fn_anonym ceph NOFD /proc/49766/task/51247/fd (opendir: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51248 finisher ceph cwd unknown /proc/49766/task/51248/cwd (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51248 finisher ceph rtd unknown /proc/49766/task/51248/root (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51248 finisher ceph txt unknown /proc/49766/task/51248/exe (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51248 finisher ceph NOFD /proc/49766/task/51248/fd (opendir: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51249 safe_time ceph cwd unknown /proc/49766/task/51249/cwd (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51249 safe_time ceph rtd unknown /proc/49766/task/51249/root (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51249 safe_time ceph txt unknown /proc/49766/task/51249/exe (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51249 safe_time ceph NOFD /proc/49766/task/51249/fd (opendir: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51250 safe_time ceph cwd unknown /proc/49766/task/51250/cwd (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51250 safe_time ceph rtd unknown /proc/49766/task/51250/root (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51250 safe_time ceph txt unknown /proc/49766/task/51250/exe (readlink: Permission denied) 2024-09-12T02:33:16.737 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51250 safe_time ceph NOFD /proc/49766/task/51250/fd (opendir: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51251 ceph-osd ceph cwd unknown /proc/49766/task/51251/cwd (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51251 ceph-osd ceph rtd unknown /proc/49766/task/51251/root (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51251 ceph-osd ceph txt unknown /proc/49766/task/51251/exe (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51251 ceph-osd ceph NOFD /proc/49766/task/51251/fd (opendir: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51252 osd_srv_a ceph cwd unknown /proc/49766/task/51252/cwd (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51252 osd_srv_a ceph rtd unknown /proc/49766/task/51252/root (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51252 osd_srv_a ceph txt unknown /proc/49766/task/51252/exe (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51252 osd_srv_a ceph NOFD /proc/49766/task/51252/fd (opendir: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51253 tp_osd_tp ceph cwd unknown /proc/49766/task/51253/cwd (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51253 tp_osd_tp ceph rtd unknown /proc/49766/task/51253/root (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51253 tp_osd_tp ceph txt unknown /proc/49766/task/51253/exe (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51253 tp_osd_tp ceph NOFD /proc/49766/task/51253/fd (opendir: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51254 tp_osd_tp ceph cwd unknown /proc/49766/task/51254/cwd (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51254 tp_osd_tp ceph rtd unknown /proc/49766/task/51254/root (readlink: Permission denied) 2024-09-12T02:33:16.738 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51254 tp_osd_tp ceph txt unknown /proc/49766/task/51254/exe (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51254 tp_osd_tp ceph NOFD /proc/49766/task/51254/fd (opendir: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51255 tp_osd_tp ceph cwd unknown /proc/49766/task/51255/cwd (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51255 tp_osd_tp ceph rtd unknown /proc/49766/task/51255/root (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51255 tp_osd_tp ceph txt unknown /proc/49766/task/51255/exe (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51255 tp_osd_tp ceph NOFD /proc/49766/task/51255/fd (opendir: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51256 tp_osd_tp ceph cwd unknown /proc/49766/task/51256/cwd (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51256 tp_osd_tp ceph rtd unknown /proc/49766/task/51256/root (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51256 tp_osd_tp ceph txt unknown /proc/49766/task/51256/exe (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51256 tp_osd_tp ceph NOFD /proc/49766/task/51256/fd (opendir: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51257 tp_osd_tp ceph cwd unknown /proc/49766/task/51257/cwd (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51257 tp_osd_tp ceph rtd unknown /proc/49766/task/51257/root (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51257 tp_osd_tp ceph txt unknown /proc/49766/task/51257/exe (readlink: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51257 tp_osd_tp ceph NOFD /proc/49766/task/51257/fd (opendir: Permission denied) 2024-09-12T02:33:16.739 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51258 tp_osd_tp ceph cwd unknown /proc/49766/task/51258/cwd (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51258 tp_osd_tp ceph rtd unknown /proc/49766/task/51258/root (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51258 tp_osd_tp ceph txt unknown /proc/49766/task/51258/exe (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51258 tp_osd_tp ceph NOFD /proc/49766/task/51258/fd (opendir: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51259 tp_osd_tp ceph cwd unknown /proc/49766/task/51259/cwd (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51259 tp_osd_tp ceph rtd unknown /proc/49766/task/51259/root (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51259 tp_osd_tp ceph txt unknown /proc/49766/task/51259/exe (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51259 tp_osd_tp ceph NOFD /proc/49766/task/51259/fd (opendir: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51260 tp_osd_tp ceph cwd unknown /proc/49766/task/51260/cwd (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51260 tp_osd_tp ceph rtd unknown /proc/49766/task/51260/root (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51260 tp_osd_tp ceph txt unknown /proc/49766/task/51260/exe (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51260 tp_osd_tp ceph NOFD /proc/49766/task/51260/fd (opendir: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51261 tp_osd_tp ceph cwd unknown /proc/49766/task/51261/cwd (readlink: Permission denied) 2024-09-12T02:33:16.740 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51261 tp_osd_tp ceph rtd unknown /proc/49766/task/51261/root (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51261 tp_osd_tp ceph txt unknown /proc/49766/task/51261/exe (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51261 tp_osd_tp ceph NOFD /proc/49766/task/51261/fd (opendir: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51262 tp_osd_tp ceph cwd unknown /proc/49766/task/51262/cwd (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51262 tp_osd_tp ceph rtd unknown /proc/49766/task/51262/root (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51262 tp_osd_tp ceph txt unknown /proc/49766/task/51262/exe (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51262 tp_osd_tp ceph NOFD /proc/49766/task/51262/fd (opendir: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51263 tp_osd_tp ceph cwd unknown /proc/49766/task/51263/cwd (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51263 tp_osd_tp ceph rtd unknown /proc/49766/task/51263/root (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51263 tp_osd_tp ceph txt unknown /proc/49766/task/51263/exe (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51263 tp_osd_tp ceph NOFD /proc/49766/task/51263/fd (opendir: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51264 tp_osd_tp ceph cwd unknown /proc/49766/task/51264/cwd (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51264 tp_osd_tp ceph rtd unknown /proc/49766/task/51264/root (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51264 tp_osd_tp ceph txt unknown /proc/49766/task/51264/exe (readlink: Permission denied) 2024-09-12T02:33:16.741 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51264 tp_osd_tp ceph NOFD /proc/49766/task/51264/fd (opendir: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51265 tp_osd_tp ceph cwd unknown /proc/49766/task/51265/cwd (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51265 tp_osd_tp ceph rtd unknown /proc/49766/task/51265/root (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51265 tp_osd_tp ceph txt unknown /proc/49766/task/51265/exe (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51265 tp_osd_tp ceph NOFD /proc/49766/task/51265/fd (opendir: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51266 tp_osd_tp ceph cwd unknown /proc/49766/task/51266/cwd (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51266 tp_osd_tp ceph rtd unknown /proc/49766/task/51266/root (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51266 tp_osd_tp ceph txt unknown /proc/49766/task/51266/exe (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51266 tp_osd_tp ceph NOFD /proc/49766/task/51266/fd (opendir: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51267 tp_osd_tp ceph cwd unknown /proc/49766/task/51267/cwd (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51267 tp_osd_tp ceph rtd unknown /proc/49766/task/51267/root (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51267 tp_osd_tp ceph txt unknown /proc/49766/task/51267/exe (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51267 tp_osd_tp ceph NOFD /proc/49766/task/51267/fd (opendir: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51268 tp_osd_tp ceph cwd unknown /proc/49766/task/51268/cwd (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51268 tp_osd_tp ceph rtd unknown /proc/49766/task/51268/root (readlink: Permission denied) 2024-09-12T02:33:16.742 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51268 tp_osd_tp ceph txt unknown /proc/49766/task/51268/exe (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51268 tp_osd_tp ceph NOFD /proc/49766/task/51268/fd (opendir: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51269 osd_srv_h ceph cwd unknown /proc/49766/task/51269/cwd (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51269 osd_srv_h ceph rtd unknown /proc/49766/task/51269/root (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51269 osd_srv_h ceph txt unknown /proc/49766/task/51269/exe (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 49766 51269 osd_srv_h ceph NOFD /proc/49766/task/51269/fd (opendir: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 50620 root cwd unknown /proc/50620/cwd (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 50620 root rtd unknown /proc/50620/root (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 50620 root txt unknown /proc/50620/exe (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 50620 root NOFD /proc/50620/fd (opendir: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 50637 root cwd unknown /proc/50637/cwd (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 50637 root rtd unknown /proc/50637/root (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 50637 root txt unknown /proc/50637/exe (readlink: Permission denied) 2024-09-12T02:33:16.743 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 50637 root NOFD /proc/50637/fd (opendir: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 54263 root cwd unknown /proc/54263/cwd (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 54263 root rtd unknown /proc/54263/root (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 54263 root txt unknown /proc/54263/exe (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 54263 root NOFD /proc/54263/fd (opendir: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 55908 root cwd unknown /proc/55908/cwd (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 55908 root rtd unknown /proc/55908/root (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 55908 root txt unknown /proc/55908/exe (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 55908 root NOFD /proc/55908/fd (opendir: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 56652 root cwd unknown /proc/56652/cwd (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 56652 root rtd unknown /proc/56652/root (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 56652 root txt unknown /proc/56652/exe (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 56652 root NOFD /proc/56652/fd (opendir: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 56654 root cwd unknown /proc/56654/cwd (readlink: Permission denied) 2024-09-12T02:33:16.744 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 56654 root rtd unknown /proc/56654/root (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 56654 root txt unknown /proc/56654/exe (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 56654 root NOFD /proc/56654/fd (opendir: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 ceph cwd unknown /proc/56656/cwd (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 ceph rtd unknown /proc/56656/root (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 ceph txt unknown /proc/56656/exe (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 ceph NOFD /proc/56656/fd (opendir: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56657 log ceph cwd unknown /proc/56656/task/56657/cwd (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56657 log ceph rtd unknown /proc/56656/task/56657/root (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56657 log ceph txt unknown /proc/56656/task/56657/exe (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56657 log ceph NOFD /proc/56656/task/56657/fd (opendir: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56659 msgr-work ceph cwd unknown /proc/56656/task/56659/cwd (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56659 msgr-work ceph rtd unknown /proc/56656/task/56659/root (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56659 msgr-work ceph txt unknown /proc/56656/task/56659/exe (readlink: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56659 msgr-work ceph NOFD /proc/56656/task/56659/fd (opendir: Permission denied) 2024-09-12T02:33:16.745 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56660 msgr-work ceph cwd unknown /proc/56656/task/56660/cwd (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56660 msgr-work ceph rtd unknown /proc/56656/task/56660/root (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56660 msgr-work ceph txt unknown /proc/56656/task/56660/exe (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56660 msgr-work ceph NOFD /proc/56656/task/56660/fd (opendir: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56661 msgr-work ceph cwd unknown /proc/56656/task/56661/cwd (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56661 msgr-work ceph rtd unknown /proc/56656/task/56661/root (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56661 msgr-work ceph txt unknown /proc/56656/task/56661/exe (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56661 msgr-work ceph NOFD /proc/56656/task/56661/fd (opendir: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56665 service ceph cwd unknown /proc/56656/task/56665/cwd (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56665 service ceph rtd unknown /proc/56656/task/56665/root (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56665 service ceph txt unknown /proc/56656/task/56665/exe (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56665 service ceph NOFD /proc/56656/task/56665/fd (opendir: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56666 admin_soc ceph cwd unknown /proc/56656/task/56666/cwd (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56666 admin_soc ceph rtd unknown /proc/56656/task/56666/root (readlink: Permission denied) 2024-09-12T02:33:16.746 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56666 admin_soc ceph txt unknown /proc/56656/task/56666/exe (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 56666 admin_soc ceph NOFD /proc/56656/task/56666/fd (opendir: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57001 signal_ha ceph cwd unknown /proc/56656/task/57001/cwd (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57001 signal_ha ceph rtd unknown /proc/56656/task/57001/root (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57001 signal_ha ceph txt unknown /proc/56656/task/57001/exe (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57001 signal_ha ceph NOFD /proc/56656/task/57001/fd (opendir: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57002 io_contex ceph cwd unknown /proc/56656/task/57002/cwd (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57002 io_contex ceph rtd unknown /proc/56656/task/57002/root (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57002 io_contex ceph txt unknown /proc/56656/task/57002/exe (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57002 io_contex ceph NOFD /proc/56656/task/57002/fd (opendir: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57003 io_contex ceph cwd unknown /proc/56656/task/57003/cwd (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57003 io_contex ceph rtd unknown /proc/56656/task/57003/root (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57003 io_contex ceph txt unknown /proc/56656/task/57003/exe (readlink: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57003 io_contex ceph NOFD /proc/56656/task/57003/fd (opendir: Permission denied) 2024-09-12T02:33:16.747 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57016 OpHistory ceph cwd unknown /proc/56656/task/57016/cwd (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57016 OpHistory ceph rtd unknown /proc/56656/task/57016/root (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57016 OpHistory ceph txt unknown /proc/56656/task/57016/exe (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57016 OpHistory ceph NOFD /proc/56656/task/57016/fd (opendir: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57017 ceph_time ceph cwd unknown /proc/56656/task/57017/cwd (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57017 ceph_time ceph rtd unknown /proc/56656/task/57017/root (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57017 ceph_time ceph txt unknown /proc/56656/task/57017/exe (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57017 ceph_time ceph NOFD /proc/56656/task/57017/fd (opendir: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57288 ceph-osd ceph cwd unknown /proc/56656/task/57288/cwd (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57288 ceph-osd ceph rtd unknown /proc/56656/task/57288/root (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57288 ceph-osd ceph txt unknown /proc/56656/task/57288/exe (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57288 ceph-osd ceph NOFD /proc/56656/task/57288/fd (opendir: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57289 safe_time ceph cwd unknown /proc/56656/task/57289/cwd (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57289 safe_time ceph rtd unknown /proc/56656/task/57289/root (readlink: Permission denied) 2024-09-12T02:33:16.748 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57289 safe_time ceph txt unknown /proc/56656/task/57289/exe (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57289 safe_time ceph NOFD /proc/56656/task/57289/fd (opendir: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57290 safe_time ceph cwd unknown /proc/56656/task/57290/cwd (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57290 safe_time ceph rtd unknown /proc/56656/task/57290/root (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57290 safe_time ceph txt unknown /proc/56656/task/57290/exe (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57290 safe_time ceph NOFD /proc/56656/task/57290/fd (opendir: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57291 safe_time ceph cwd unknown /proc/56656/task/57291/cwd (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57291 safe_time ceph rtd unknown /proc/56656/task/57291/root (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57291 safe_time ceph txt unknown /proc/56656/task/57291/exe (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57291 safe_time ceph NOFD /proc/56656/task/57291/fd (opendir: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57293 safe_time ceph cwd unknown /proc/56656/task/57293/cwd (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57293 safe_time ceph rtd unknown /proc/56656/task/57293/root (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57293 safe_time ceph txt unknown /proc/56656/task/57293/exe (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57293 safe_time ceph NOFD /proc/56656/task/57293/fd (opendir: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57294 fn_anonym ceph cwd unknown /proc/56656/task/57294/cwd (readlink: Permission denied) 2024-09-12T02:33:16.749 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57294 fn_anonym ceph rtd unknown /proc/56656/task/57294/root (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57294 fn_anonym ceph txt unknown /proc/56656/task/57294/exe (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57294 fn_anonym ceph NOFD /proc/56656/task/57294/fd (opendir: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57349 rocksdb:l ceph cwd unknown /proc/56656/task/57349/cwd (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57349 rocksdb:l ceph rtd unknown /proc/56656/task/57349/root (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57349 rocksdb:l ceph txt unknown /proc/56656/task/57349/exe (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57349 rocksdb:l ceph NOFD /proc/56656/task/57349/fd (opendir: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57350 rocksdb:l ceph cwd unknown /proc/56656/task/57350/cwd (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57350 rocksdb:l ceph rtd unknown /proc/56656/task/57350/root (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57350 rocksdb:l ceph txt unknown /proc/56656/task/57350/exe (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57350 rocksdb:l ceph NOFD /proc/56656/task/57350/fd (opendir: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57351 rocksdb:l ceph cwd unknown /proc/56656/task/57351/cwd (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57351 rocksdb:l ceph rtd unknown /proc/56656/task/57351/root (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57351 rocksdb:l ceph txt unknown /proc/56656/task/57351/exe (readlink: Permission denied) 2024-09-12T02:33:16.750 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57351 rocksdb:l ceph NOFD /proc/56656/task/57351/fd (opendir: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57352 rocksdb:h ceph cwd unknown /proc/56656/task/57352/cwd (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57352 rocksdb:h ceph rtd unknown /proc/56656/task/57352/root (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57352 rocksdb:h ceph txt unknown /proc/56656/task/57352/exe (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57352 rocksdb:h ceph NOFD /proc/56656/task/57352/fd (opendir: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57760 bstore_ai ceph cwd unknown /proc/56656/task/57760/cwd (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57760 bstore_ai ceph rtd unknown /proc/56656/task/57760/root (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57760 bstore_ai ceph txt unknown /proc/56656/task/57760/exe (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57760 bstore_ai ceph NOFD /proc/56656/task/57760/fd (opendir: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57951 bstore_ai ceph cwd unknown /proc/56656/task/57951/cwd (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57951 bstore_ai ceph rtd unknown /proc/56656/task/57951/root (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57951 bstore_ai ceph txt unknown /proc/56656/task/57951/exe (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 57951 bstore_ai ceph NOFD /proc/56656/task/57951/fd (opendir: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58134 ceph-osd ceph cwd unknown /proc/56656/task/58134/cwd (readlink: Permission denied) 2024-09-12T02:33:16.751 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58134 ceph-osd ceph rtd unknown /proc/56656/task/58134/root (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58134 ceph-osd ceph txt unknown /proc/56656/task/58134/exe (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58134 ceph-osd ceph NOFD /proc/56656/task/58134/fd (opendir: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58135 cfin ceph cwd unknown /proc/56656/task/58135/cwd (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58135 cfin ceph rtd unknown /proc/56656/task/58135/root (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58135 cfin ceph txt unknown /proc/56656/task/58135/exe (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58135 cfin ceph NOFD /proc/56656/task/58135/fd (opendir: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58136 bstore_kv ceph cwd unknown /proc/56656/task/58136/cwd (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58136 bstore_kv ceph rtd unknown /proc/56656/task/58136/root (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58136 bstore_kv ceph txt unknown /proc/56656/task/58136/exe (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58136 bstore_kv ceph NOFD /proc/56656/task/58136/fd (opendir: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58137 bstore_kv ceph cwd unknown /proc/56656/task/58137/cwd (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58137 bstore_kv ceph rtd unknown /proc/56656/task/58137/root (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58137 bstore_kv ceph txt unknown /proc/56656/task/58137/exe (readlink: Permission denied) 2024-09-12T02:33:16.752 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58137 bstore_kv ceph NOFD /proc/56656/task/58137/fd (opendir: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58138 bstore_me ceph cwd unknown /proc/56656/task/58138/cwd (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58138 bstore_me ceph rtd unknown /proc/56656/task/58138/root (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58138 bstore_me ceph txt unknown /proc/56656/task/58138/exe (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58138 bstore_me ceph NOFD /proc/56656/task/58138/fd (opendir: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58139 ms_dispat ceph cwd unknown /proc/56656/task/58139/cwd (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58139 ms_dispat ceph rtd unknown /proc/56656/task/58139/root (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58139 ms_dispat ceph txt unknown /proc/56656/task/58139/exe (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58139 ms_dispat ceph NOFD /proc/56656/task/58139/fd (opendir: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58140 ms_local ceph cwd unknown /proc/56656/task/58140/cwd (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58140 ms_local ceph rtd unknown /proc/56656/task/58140/root (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58140 ms_local ceph txt unknown /proc/56656/task/58140/exe (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58140 ms_local ceph NOFD /proc/56656/task/58140/fd (opendir: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58141 safe_time ceph cwd unknown /proc/56656/task/58141/cwd (readlink: Permission denied) 2024-09-12T02:33:16.753 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58141 safe_time ceph rtd unknown /proc/56656/task/58141/root (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58141 safe_time ceph txt unknown /proc/56656/task/58141/exe (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58141 safe_time ceph NOFD /proc/56656/task/58141/fd (opendir: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58142 safe_time ceph cwd unknown /proc/56656/task/58142/cwd (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58142 safe_time ceph rtd unknown /proc/56656/task/58142/root (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58142 safe_time ceph txt unknown /proc/56656/task/58142/exe (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58142 safe_time ceph NOFD /proc/56656/task/58142/fd (opendir: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58143 ms_dispat ceph cwd unknown /proc/56656/task/58143/cwd (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58143 ms_dispat ceph rtd unknown /proc/56656/task/58143/root (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58143 ms_dispat ceph txt unknown /proc/56656/task/58143/exe (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58143 ms_dispat ceph NOFD /proc/56656/task/58143/fd (opendir: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58144 ms_local ceph cwd unknown /proc/56656/task/58144/cwd (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58144 ms_local ceph rtd unknown /proc/56656/task/58144/root (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58144 ms_local ceph txt unknown /proc/56656/task/58144/exe (readlink: Permission denied) 2024-09-12T02:33:16.754 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58144 ms_local ceph NOFD /proc/56656/task/58144/fd (opendir: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58145 ms_dispat ceph cwd unknown /proc/56656/task/58145/cwd (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58145 ms_dispat ceph rtd unknown /proc/56656/task/58145/root (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58145 ms_dispat ceph txt unknown /proc/56656/task/58145/exe (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58145 ms_dispat ceph NOFD /proc/56656/task/58145/fd (opendir: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58146 ms_local ceph cwd unknown /proc/56656/task/58146/cwd (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58146 ms_local ceph rtd unknown /proc/56656/task/58146/root (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58146 ms_local ceph txt unknown /proc/56656/task/58146/exe (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58146 ms_local ceph NOFD /proc/56656/task/58146/fd (opendir: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58147 ms_dispat ceph cwd unknown /proc/56656/task/58147/cwd (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58147 ms_dispat ceph rtd unknown /proc/56656/task/58147/root (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58147 ms_dispat ceph txt unknown /proc/56656/task/58147/exe (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58147 ms_dispat ceph NOFD /proc/56656/task/58147/fd (opendir: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58148 ms_local ceph cwd unknown /proc/56656/task/58148/cwd (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58148 ms_local ceph rtd unknown /proc/56656/task/58148/root (readlink: Permission denied) 2024-09-12T02:33:16.755 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58148 ms_local ceph txt unknown /proc/56656/task/58148/exe (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58148 ms_local ceph NOFD /proc/56656/task/58148/fd (opendir: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58149 ms_dispat ceph cwd unknown /proc/56656/task/58149/cwd (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58149 ms_dispat ceph rtd unknown /proc/56656/task/58149/root (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58149 ms_dispat ceph txt unknown /proc/56656/task/58149/exe (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58149 ms_dispat ceph NOFD /proc/56656/task/58149/fd (opendir: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58150 ms_local ceph cwd unknown /proc/56656/task/58150/cwd (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58150 ms_local ceph rtd unknown /proc/56656/task/58150/root (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58150 ms_local ceph txt unknown /proc/56656/task/58150/exe (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58150 ms_local ceph NOFD /proc/56656/task/58150/fd (opendir: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58151 ms_dispat ceph cwd unknown /proc/56656/task/58151/cwd (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58151 ms_dispat ceph rtd unknown /proc/56656/task/58151/root (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58151 ms_dispat ceph txt unknown /proc/56656/task/58151/exe (readlink: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58151 ms_dispat ceph NOFD /proc/56656/task/58151/fd (opendir: Permission denied) 2024-09-12T02:33:16.756 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58152 ms_local ceph cwd unknown /proc/56656/task/58152/cwd (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58152 ms_local ceph rtd unknown /proc/56656/task/58152/root (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58152 ms_local ceph txt unknown /proc/56656/task/58152/exe (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58152 ms_local ceph NOFD /proc/56656/task/58152/fd (opendir: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58153 ms_dispat ceph cwd unknown /proc/56656/task/58153/cwd (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58153 ms_dispat ceph rtd unknown /proc/56656/task/58153/root (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58153 ms_dispat ceph txt unknown /proc/56656/task/58153/exe (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58153 ms_dispat ceph NOFD /proc/56656/task/58153/fd (opendir: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58154 ms_local ceph cwd unknown /proc/56656/task/58154/cwd (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58154 ms_local ceph rtd unknown /proc/56656/task/58154/root (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58154 ms_local ceph txt unknown /proc/56656/task/58154/exe (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58154 ms_local ceph NOFD /proc/56656/task/58154/fd (opendir: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58155 fn_anonym ceph cwd unknown /proc/56656/task/58155/cwd (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58155 fn_anonym ceph rtd unknown /proc/56656/task/58155/root (readlink: Permission denied) 2024-09-12T02:33:16.757 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58155 fn_anonym ceph txt unknown /proc/56656/task/58155/exe (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58155 fn_anonym ceph NOFD /proc/56656/task/58155/fd (opendir: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58156 finisher ceph cwd unknown /proc/56656/task/58156/cwd (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58156 finisher ceph rtd unknown /proc/56656/task/58156/root (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58156 finisher ceph txt unknown /proc/56656/task/58156/exe (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58156 finisher ceph NOFD /proc/56656/task/58156/fd (opendir: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58157 safe_time ceph cwd unknown /proc/56656/task/58157/cwd (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58157 safe_time ceph rtd unknown /proc/56656/task/58157/root (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58157 safe_time ceph txt unknown /proc/56656/task/58157/exe (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58157 safe_time ceph NOFD /proc/56656/task/58157/fd (opendir: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58158 safe_time ceph cwd unknown /proc/56656/task/58158/cwd (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58158 safe_time ceph rtd unknown /proc/56656/task/58158/root (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58158 safe_time ceph txt unknown /proc/56656/task/58158/exe (readlink: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58158 safe_time ceph NOFD /proc/56656/task/58158/fd (opendir: Permission denied) 2024-09-12T02:33:16.758 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58159 ceph-osd ceph cwd unknown /proc/56656/task/58159/cwd (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58159 ceph-osd ceph rtd unknown /proc/56656/task/58159/root (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58159 ceph-osd ceph txt unknown /proc/56656/task/58159/exe (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58159 ceph-osd ceph NOFD /proc/56656/task/58159/fd (opendir: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58160 osd_srv_a ceph cwd unknown /proc/56656/task/58160/cwd (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58160 osd_srv_a ceph rtd unknown /proc/56656/task/58160/root (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58160 osd_srv_a ceph txt unknown /proc/56656/task/58160/exe (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58160 osd_srv_a ceph NOFD /proc/56656/task/58160/fd (opendir: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58161 tp_osd_tp ceph cwd unknown /proc/56656/task/58161/cwd (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58161 tp_osd_tp ceph rtd unknown /proc/56656/task/58161/root (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58161 tp_osd_tp ceph txt unknown /proc/56656/task/58161/exe (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58161 tp_osd_tp ceph NOFD /proc/56656/task/58161/fd (opendir: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58162 tp_osd_tp ceph cwd unknown /proc/56656/task/58162/cwd (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58162 tp_osd_tp ceph rtd unknown /proc/56656/task/58162/root (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58162 tp_osd_tp ceph txt unknown /proc/56656/task/58162/exe (readlink: Permission denied) 2024-09-12T02:33:16.759 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58162 tp_osd_tp ceph NOFD /proc/56656/task/58162/fd (opendir: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58163 tp_osd_tp ceph cwd unknown /proc/56656/task/58163/cwd (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58163 tp_osd_tp ceph rtd unknown /proc/56656/task/58163/root (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58163 tp_osd_tp ceph txt unknown /proc/56656/task/58163/exe (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58163 tp_osd_tp ceph NOFD /proc/56656/task/58163/fd (opendir: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58164 tp_osd_tp ceph cwd unknown /proc/56656/task/58164/cwd (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58164 tp_osd_tp ceph rtd unknown /proc/56656/task/58164/root (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58164 tp_osd_tp ceph txt unknown /proc/56656/task/58164/exe (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58164 tp_osd_tp ceph NOFD /proc/56656/task/58164/fd (opendir: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58165 tp_osd_tp ceph cwd unknown /proc/56656/task/58165/cwd (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58165 tp_osd_tp ceph rtd unknown /proc/56656/task/58165/root (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58165 tp_osd_tp ceph txt unknown /proc/56656/task/58165/exe (readlink: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58165 tp_osd_tp ceph NOFD /proc/56656/task/58165/fd (opendir: Permission denied) 2024-09-12T02:33:16.760 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58166 tp_osd_tp ceph cwd unknown /proc/56656/task/58166/cwd (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58166 tp_osd_tp ceph rtd unknown /proc/56656/task/58166/root (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58166 tp_osd_tp ceph txt unknown /proc/56656/task/58166/exe (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58166 tp_osd_tp ceph NOFD /proc/56656/task/58166/fd (opendir: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58167 tp_osd_tp ceph cwd unknown /proc/56656/task/58167/cwd (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58167 tp_osd_tp ceph rtd unknown /proc/56656/task/58167/root (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58167 tp_osd_tp ceph txt unknown /proc/56656/task/58167/exe (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58167 tp_osd_tp ceph NOFD /proc/56656/task/58167/fd (opendir: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58168 tp_osd_tp ceph cwd unknown /proc/56656/task/58168/cwd (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58168 tp_osd_tp ceph rtd unknown /proc/56656/task/58168/root (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58168 tp_osd_tp ceph txt unknown /proc/56656/task/58168/exe (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58168 tp_osd_tp ceph NOFD /proc/56656/task/58168/fd (opendir: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58169 tp_osd_tp ceph cwd unknown /proc/56656/task/58169/cwd (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58169 tp_osd_tp ceph rtd unknown /proc/56656/task/58169/root (readlink: Permission denied) 2024-09-12T02:33:16.761 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58169 tp_osd_tp ceph txt unknown /proc/56656/task/58169/exe (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58169 tp_osd_tp ceph NOFD /proc/56656/task/58169/fd (opendir: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58170 tp_osd_tp ceph cwd unknown /proc/56656/task/58170/cwd (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58170 tp_osd_tp ceph rtd unknown /proc/56656/task/58170/root (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58170 tp_osd_tp ceph txt unknown /proc/56656/task/58170/exe (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58170 tp_osd_tp ceph NOFD /proc/56656/task/58170/fd (opendir: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58171 tp_osd_tp ceph cwd unknown /proc/56656/task/58171/cwd (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58171 tp_osd_tp ceph rtd unknown /proc/56656/task/58171/root (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58171 tp_osd_tp ceph txt unknown /proc/56656/task/58171/exe (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58171 tp_osd_tp ceph NOFD /proc/56656/task/58171/fd (opendir: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58172 tp_osd_tp ceph cwd unknown /proc/56656/task/58172/cwd (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58172 tp_osd_tp ceph rtd unknown /proc/56656/task/58172/root (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58172 tp_osd_tp ceph txt unknown /proc/56656/task/58172/exe (readlink: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58172 tp_osd_tp ceph NOFD /proc/56656/task/58172/fd (opendir: Permission denied) 2024-09-12T02:33:16.762 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58173 tp_osd_tp ceph cwd unknown /proc/56656/task/58173/cwd (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58173 tp_osd_tp ceph rtd unknown /proc/56656/task/58173/root (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58173 tp_osd_tp ceph txt unknown /proc/56656/task/58173/exe (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58173 tp_osd_tp ceph NOFD /proc/56656/task/58173/fd (opendir: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58174 tp_osd_tp ceph cwd unknown /proc/56656/task/58174/cwd (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58174 tp_osd_tp ceph rtd unknown /proc/56656/task/58174/root (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58174 tp_osd_tp ceph txt unknown /proc/56656/task/58174/exe (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58174 tp_osd_tp ceph NOFD /proc/56656/task/58174/fd (opendir: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58175 tp_osd_tp ceph cwd unknown /proc/56656/task/58175/cwd (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58175 tp_osd_tp ceph rtd unknown /proc/56656/task/58175/root (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58175 tp_osd_tp ceph txt unknown /proc/56656/task/58175/exe (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58175 tp_osd_tp ceph NOFD /proc/56656/task/58175/fd (opendir: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58176 tp_osd_tp ceph cwd unknown /proc/56656/task/58176/cwd (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58176 tp_osd_tp ceph rtd unknown /proc/56656/task/58176/root (readlink: Permission denied) 2024-09-12T02:33:16.763 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58176 tp_osd_tp ceph txt unknown /proc/56656/task/58176/exe (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58176 tp_osd_tp ceph NOFD /proc/56656/task/58176/fd (opendir: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58177 osd_srv_h ceph cwd unknown /proc/56656/task/58177/cwd (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58177 osd_srv_h ceph rtd unknown /proc/56656/task/58177/root (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58177 osd_srv_h ceph txt unknown /proc/56656/task/58177/exe (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 56656 58177 osd_srv_h ceph NOFD /proc/56656/task/58177/fd (opendir: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 57330 root cwd unknown /proc/57330/cwd (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 57330 root rtd unknown /proc/57330/root (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 57330 root txt unknown /proc/57330/exe (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 57330 root NOFD /proc/57330/fd (opendir: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 57547 root cwd unknown /proc/57547/cwd (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 57547 root rtd unknown /proc/57547/root (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 57547 root txt unknown /proc/57547/exe (readlink: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 57547 root NOFD /proc/57547/fd (opendir: Permission denied) 2024-09-12T02:33:16.764 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 60345 root cwd unknown /proc/60345/cwd (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 60345 root rtd unknown /proc/60345/root (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 60345 root txt unknown /proc/60345/exe (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 60345 root NOFD /proc/60345/fd (opendir: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 60422 root cwd unknown /proc/60422/cwd (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 60422 root rtd unknown /proc/60422/root (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 60422 root txt unknown /proc/60422/exe (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 60422 root NOFD /proc/60422/fd (opendir: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 62447 root cwd unknown /proc/62447/cwd (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 62447 root rtd unknown /proc/62447/root (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 62447 root txt unknown /proc/62447/exe (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 62447 root NOFD /proc/62447/fd (opendir: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 63189 root cwd unknown /proc/63189/cwd (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 63189 root rtd unknown /proc/63189/root (readlink: Permission denied) 2024-09-12T02:33:16.765 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 63189 root txt unknown /proc/63189/exe (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 63189 root NOFD /proc/63189/fd (opendir: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 63191 root cwd unknown /proc/63191/cwd (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 63191 root rtd unknown /proc/63191/root (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 63191 root txt unknown /proc/63191/exe (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 63191 root NOFD /proc/63191/fd (opendir: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 ceph cwd unknown /proc/63193/cwd (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 ceph rtd unknown /proc/63193/root (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 ceph txt unknown /proc/63193/exe (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 ceph NOFD /proc/63193/fd (opendir: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63194 log ceph cwd unknown /proc/63193/task/63194/cwd (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63194 log ceph rtd unknown /proc/63193/task/63194/root (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63194 log ceph txt unknown /proc/63193/task/63194/exe (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63194 log ceph NOFD /proc/63193/task/63194/fd (opendir: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63196 msgr-work ceph cwd unknown /proc/63193/task/63196/cwd (readlink: Permission denied) 2024-09-12T02:33:16.766 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63196 msgr-work ceph rtd unknown /proc/63193/task/63196/root (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63196 msgr-work ceph txt unknown /proc/63193/task/63196/exe (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63196 msgr-work ceph NOFD /proc/63193/task/63196/fd (opendir: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63197 msgr-work ceph cwd unknown /proc/63193/task/63197/cwd (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63197 msgr-work ceph rtd unknown /proc/63193/task/63197/root (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63197 msgr-work ceph txt unknown /proc/63193/task/63197/exe (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63197 msgr-work ceph NOFD /proc/63193/task/63197/fd (opendir: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63198 msgr-work ceph cwd unknown /proc/63193/task/63198/cwd (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63198 msgr-work ceph rtd unknown /proc/63193/task/63198/root (readlink: Permission denied) 2024-09-12T02:33:16.767 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63198 msgr-work ceph txt unknown /proc/63193/task/63198/exe (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63198 msgr-work ceph NOFD /proc/63193/task/63198/fd (opendir: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63202 service ceph cwd unknown /proc/63193/task/63202/cwd (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63202 service ceph rtd unknown /proc/63193/task/63202/root (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63202 service ceph txt unknown /proc/63193/task/63202/exe (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63202 service ceph NOFD /proc/63193/task/63202/fd (opendir: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63203 admin_soc ceph cwd unknown /proc/63193/task/63203/cwd (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63203 admin_soc ceph rtd unknown /proc/63193/task/63203/root (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63203 admin_soc ceph txt unknown /proc/63193/task/63203/exe (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63203 admin_soc ceph NOFD /proc/63193/task/63203/fd (opendir: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63534 signal_ha ceph cwd unknown /proc/63193/task/63534/cwd (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63534 signal_ha ceph rtd unknown /proc/63193/task/63534/root (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63534 signal_ha ceph txt unknown /proc/63193/task/63534/exe (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63534 signal_ha ceph NOFD /proc/63193/task/63534/fd (opendir: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63535 io_contex ceph cwd unknown /proc/63193/task/63535/cwd (readlink: Permission denied) 2024-09-12T02:33:16.768 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63535 io_contex ceph rtd unknown /proc/63193/task/63535/root (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63535 io_contex ceph txt unknown /proc/63193/task/63535/exe (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63535 io_contex ceph NOFD /proc/63193/task/63535/fd (opendir: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63536 io_contex ceph cwd unknown /proc/63193/task/63536/cwd (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63536 io_contex ceph rtd unknown /proc/63193/task/63536/root (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63536 io_contex ceph txt unknown /proc/63193/task/63536/exe (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63536 io_contex ceph NOFD /proc/63193/task/63536/fd (opendir: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63549 OpHistory ceph cwd unknown /proc/63193/task/63549/cwd (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63549 OpHistory ceph rtd unknown /proc/63193/task/63549/root (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63549 OpHistory ceph txt unknown /proc/63193/task/63549/exe (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63549 OpHistory ceph NOFD /proc/63193/task/63549/fd (opendir: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63550 ceph_time ceph cwd unknown /proc/63193/task/63550/cwd (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63550 ceph_time ceph rtd unknown /proc/63193/task/63550/root (readlink: Permission denied) 2024-09-12T02:33:16.769 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63550 ceph_time ceph txt unknown /proc/63193/task/63550/exe (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63550 ceph_time ceph NOFD /proc/63193/task/63550/fd (opendir: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63567 ceph-osd ceph cwd unknown /proc/63193/task/63567/cwd (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63567 ceph-osd ceph rtd unknown /proc/63193/task/63567/root (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63567 ceph-osd ceph txt unknown /proc/63193/task/63567/exe (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63567 ceph-osd ceph NOFD /proc/63193/task/63567/fd (opendir: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63573 ceph-osd ceph cwd unknown /proc/63193/task/63573/cwd (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63573 ceph-osd ceph rtd unknown /proc/63193/task/63573/root (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63573 ceph-osd ceph txt unknown /proc/63193/task/63573/exe (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63573 ceph-osd ceph NOFD /proc/63193/task/63573/fd (opendir: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63613 ceph-osd ceph cwd unknown /proc/63193/task/63613/cwd (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63613 ceph-osd ceph rtd unknown /proc/63193/task/63613/root (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63613 ceph-osd ceph txt unknown /proc/63193/task/63613/exe (readlink: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63613 ceph-osd ceph NOFD /proc/63193/task/63613/fd (opendir: Permission denied) 2024-09-12T02:33:16.770 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63730 ceph-osd ceph cwd unknown /proc/63193/task/63730/cwd (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63730 ceph-osd ceph rtd unknown /proc/63193/task/63730/root (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63730 ceph-osd ceph txt unknown /proc/63193/task/63730/exe (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63730 ceph-osd ceph NOFD /proc/63193/task/63730/fd (opendir: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63744 ceph-osd ceph cwd unknown /proc/63193/task/63744/cwd (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63744 ceph-osd ceph rtd unknown /proc/63193/task/63744/root (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63744 ceph-osd ceph txt unknown /proc/63193/task/63744/exe (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63744 ceph-osd ceph NOFD /proc/63193/task/63744/fd (opendir: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63747 ceph-osd ceph cwd unknown /proc/63193/task/63747/cwd (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63747 ceph-osd ceph rtd unknown /proc/63193/task/63747/root (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63747 ceph-osd ceph txt unknown /proc/63193/task/63747/exe (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63747 ceph-osd ceph NOFD /proc/63193/task/63747/fd (opendir: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63832 ceph-osd ceph cwd unknown /proc/63193/task/63832/cwd (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63832 ceph-osd ceph rtd unknown /proc/63193/task/63832/root (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63832 ceph-osd ceph txt unknown /proc/63193/task/63832/exe (readlink: Permission denied) 2024-09-12T02:33:16.771 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63832 ceph-osd ceph NOFD /proc/63193/task/63832/fd (opendir: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63848 ceph-osd ceph cwd unknown /proc/63193/task/63848/cwd (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63848 ceph-osd ceph rtd unknown /proc/63193/task/63848/root (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63848 ceph-osd ceph txt unknown /proc/63193/task/63848/exe (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63848 ceph-osd ceph NOFD /proc/63193/task/63848/fd (opendir: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63849 ceph-osd ceph cwd unknown /proc/63193/task/63849/cwd (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63849 ceph-osd ceph rtd unknown /proc/63193/task/63849/root (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63849 ceph-osd ceph txt unknown /proc/63193/task/63849/exe (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63849 ceph-osd ceph NOFD /proc/63193/task/63849/fd (opendir: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63850 safe_time ceph cwd unknown /proc/63193/task/63850/cwd (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63850 safe_time ceph rtd unknown /proc/63193/task/63850/root (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63850 safe_time ceph txt unknown /proc/63193/task/63850/exe (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63850 safe_time ceph NOFD /proc/63193/task/63850/fd (opendir: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63851 safe_time ceph cwd unknown /proc/63193/task/63851/cwd (readlink: Permission denied) 2024-09-12T02:33:16.772 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63851 safe_time ceph rtd unknown /proc/63193/task/63851/root (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63851 safe_time ceph txt unknown /proc/63193/task/63851/exe (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63851 safe_time ceph NOFD /proc/63193/task/63851/fd (opendir: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63852 safe_time ceph cwd unknown /proc/63193/task/63852/cwd (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63852 safe_time ceph rtd unknown /proc/63193/task/63852/root (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63852 safe_time ceph txt unknown /proc/63193/task/63852/exe (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63852 safe_time ceph NOFD /proc/63193/task/63852/fd (opendir: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63854 safe_time ceph cwd unknown /proc/63193/task/63854/cwd (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63854 safe_time ceph rtd unknown /proc/63193/task/63854/root (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63854 safe_time ceph txt unknown /proc/63193/task/63854/exe (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63854 safe_time ceph NOFD /proc/63193/task/63854/fd (opendir: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63855 fn_anonym ceph cwd unknown /proc/63193/task/63855/cwd (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63855 fn_anonym ceph rtd unknown /proc/63193/task/63855/root (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63855 fn_anonym ceph txt unknown /proc/63193/task/63855/exe (readlink: Permission denied) 2024-09-12T02:33:16.773 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63855 fn_anonym ceph NOFD /proc/63193/task/63855/fd (opendir: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63872 rocksdb:l ceph cwd unknown /proc/63193/task/63872/cwd (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63872 rocksdb:l ceph rtd unknown /proc/63193/task/63872/root (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63872 rocksdb:l ceph txt unknown /proc/63193/task/63872/exe (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63872 rocksdb:l ceph NOFD /proc/63193/task/63872/fd (opendir: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63873 rocksdb:l ceph cwd unknown /proc/63193/task/63873/cwd (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63873 rocksdb:l ceph rtd unknown /proc/63193/task/63873/root (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63873 rocksdb:l ceph txt unknown /proc/63193/task/63873/exe (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63873 rocksdb:l ceph NOFD /proc/63193/task/63873/fd (opendir: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63874 rocksdb:l ceph cwd unknown /proc/63193/task/63874/cwd (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63874 rocksdb:l ceph rtd unknown /proc/63193/task/63874/root (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63874 rocksdb:l ceph txt unknown /proc/63193/task/63874/exe (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63874 rocksdb:l ceph NOFD /proc/63193/task/63874/fd (opendir: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63875 rocksdb:h ceph cwd unknown /proc/63193/task/63875/cwd (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63875 rocksdb:h ceph rtd unknown /proc/63193/task/63875/root (readlink: Permission denied) 2024-09-12T02:33:16.774 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63875 rocksdb:h ceph txt unknown /proc/63193/task/63875/exe (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 63875 rocksdb:h ceph NOFD /proc/63193/task/63875/fd (opendir: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64326 bstore_ai ceph cwd unknown /proc/63193/task/64326/cwd (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64326 bstore_ai ceph rtd unknown /proc/63193/task/64326/root (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64326 bstore_ai ceph txt unknown /proc/63193/task/64326/exe (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64326 bstore_ai ceph NOFD /proc/63193/task/64326/fd (opendir: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64512 bstore_ai ceph cwd unknown /proc/63193/task/64512/cwd (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64512 bstore_ai ceph rtd unknown /proc/63193/task/64512/root (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64512 bstore_ai ceph txt unknown /proc/63193/task/64512/exe (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64512 bstore_ai ceph NOFD /proc/63193/task/64512/fd (opendir: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64694 ceph-osd ceph cwd unknown /proc/63193/task/64694/cwd (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64694 ceph-osd ceph rtd unknown /proc/63193/task/64694/root (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64694 ceph-osd ceph txt unknown /proc/63193/task/64694/exe (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64694 ceph-osd ceph NOFD /proc/63193/task/64694/fd (opendir: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64695 cfin ceph cwd unknown /proc/63193/task/64695/cwd (readlink: Permission denied) 2024-09-12T02:33:16.775 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64695 cfin ceph rtd unknown /proc/63193/task/64695/root (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64695 cfin ceph txt unknown /proc/63193/task/64695/exe (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64695 cfin ceph NOFD /proc/63193/task/64695/fd (opendir: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64696 bstore_kv ceph cwd unknown /proc/63193/task/64696/cwd (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64696 bstore_kv ceph rtd unknown /proc/63193/task/64696/root (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64696 bstore_kv ceph txt unknown /proc/63193/task/64696/exe (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64696 bstore_kv ceph NOFD /proc/63193/task/64696/fd (opendir: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64697 bstore_kv ceph cwd unknown /proc/63193/task/64697/cwd (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64697 bstore_kv ceph rtd unknown /proc/63193/task/64697/root (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64697 bstore_kv ceph txt unknown /proc/63193/task/64697/exe (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64697 bstore_kv ceph NOFD /proc/63193/task/64697/fd (opendir: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64698 bstore_me ceph cwd unknown /proc/63193/task/64698/cwd (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64698 bstore_me ceph rtd unknown /proc/63193/task/64698/root (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64698 bstore_me ceph txt unknown /proc/63193/task/64698/exe (readlink: Permission denied) 2024-09-12T02:33:16.776 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64698 bstore_me ceph NOFD /proc/63193/task/64698/fd (opendir: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64699 ms_dispat ceph cwd unknown /proc/63193/task/64699/cwd (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64699 ms_dispat ceph rtd unknown /proc/63193/task/64699/root (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64699 ms_dispat ceph txt unknown /proc/63193/task/64699/exe (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64699 ms_dispat ceph NOFD /proc/63193/task/64699/fd (opendir: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64700 ms_local ceph cwd unknown /proc/63193/task/64700/cwd (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64700 ms_local ceph rtd unknown /proc/63193/task/64700/root (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64700 ms_local ceph txt unknown /proc/63193/task/64700/exe (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64700 ms_local ceph NOFD /proc/63193/task/64700/fd (opendir: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64701 safe_time ceph cwd unknown /proc/63193/task/64701/cwd (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64701 safe_time ceph rtd unknown /proc/63193/task/64701/root (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64701 safe_time ceph txt unknown /proc/63193/task/64701/exe (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64701 safe_time ceph NOFD /proc/63193/task/64701/fd (opendir: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64702 safe_time ceph cwd unknown /proc/63193/task/64702/cwd (readlink: Permission denied) 2024-09-12T02:33:16.777 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64702 safe_time ceph rtd unknown /proc/63193/task/64702/root (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64702 safe_time ceph txt unknown /proc/63193/task/64702/exe (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64702 safe_time ceph NOFD /proc/63193/task/64702/fd (opendir: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64703 ms_dispat ceph cwd unknown /proc/63193/task/64703/cwd (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64703 ms_dispat ceph rtd unknown /proc/63193/task/64703/root (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64703 ms_dispat ceph txt unknown /proc/63193/task/64703/exe (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64703 ms_dispat ceph NOFD /proc/63193/task/64703/fd (opendir: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64704 ms_local ceph cwd unknown /proc/63193/task/64704/cwd (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64704 ms_local ceph rtd unknown /proc/63193/task/64704/root (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64704 ms_local ceph txt unknown /proc/63193/task/64704/exe (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64704 ms_local ceph NOFD /proc/63193/task/64704/fd (opendir: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64705 ms_dispat ceph cwd unknown /proc/63193/task/64705/cwd (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64705 ms_dispat ceph rtd unknown /proc/63193/task/64705/root (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64705 ms_dispat ceph txt unknown /proc/63193/task/64705/exe (readlink: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64705 ms_dispat ceph NOFD /proc/63193/task/64705/fd (opendir: Permission denied) 2024-09-12T02:33:16.778 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64706 ms_local ceph cwd unknown /proc/63193/task/64706/cwd (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64706 ms_local ceph rtd unknown /proc/63193/task/64706/root (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64706 ms_local ceph txt unknown /proc/63193/task/64706/exe (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64706 ms_local ceph NOFD /proc/63193/task/64706/fd (opendir: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64707 ms_dispat ceph cwd unknown /proc/63193/task/64707/cwd (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64707 ms_dispat ceph rtd unknown /proc/63193/task/64707/root (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64707 ms_dispat ceph txt unknown /proc/63193/task/64707/exe (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64707 ms_dispat ceph NOFD /proc/63193/task/64707/fd (opendir: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64708 ms_local ceph cwd unknown /proc/63193/task/64708/cwd (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64708 ms_local ceph rtd unknown /proc/63193/task/64708/root (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64708 ms_local ceph txt unknown /proc/63193/task/64708/exe (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64708 ms_local ceph NOFD /proc/63193/task/64708/fd (opendir: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64709 ms_dispat ceph cwd unknown /proc/63193/task/64709/cwd (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64709 ms_dispat ceph rtd unknown /proc/63193/task/64709/root (readlink: Permission denied) 2024-09-12T02:33:16.779 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64709 ms_dispat ceph txt unknown /proc/63193/task/64709/exe (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64709 ms_dispat ceph NOFD /proc/63193/task/64709/fd (opendir: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64710 ms_local ceph cwd unknown /proc/63193/task/64710/cwd (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64710 ms_local ceph rtd unknown /proc/63193/task/64710/root (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64710 ms_local ceph txt unknown /proc/63193/task/64710/exe (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64710 ms_local ceph NOFD /proc/63193/task/64710/fd (opendir: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64711 ms_dispat ceph cwd unknown /proc/63193/task/64711/cwd (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64711 ms_dispat ceph rtd unknown /proc/63193/task/64711/root (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64711 ms_dispat ceph txt unknown /proc/63193/task/64711/exe (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64711 ms_dispat ceph NOFD /proc/63193/task/64711/fd (opendir: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64712 ms_local ceph cwd unknown /proc/63193/task/64712/cwd (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64712 ms_local ceph rtd unknown /proc/63193/task/64712/root (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64712 ms_local ceph txt unknown /proc/63193/task/64712/exe (readlink: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64712 ms_local ceph NOFD /proc/63193/task/64712/fd (opendir: Permission denied) 2024-09-12T02:33:16.780 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64713 ms_dispat ceph cwd unknown /proc/63193/task/64713/cwd (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64713 ms_dispat ceph rtd unknown /proc/63193/task/64713/root (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64713 ms_dispat ceph txt unknown /proc/63193/task/64713/exe (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64713 ms_dispat ceph NOFD /proc/63193/task/64713/fd (opendir: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64714 ms_local ceph cwd unknown /proc/63193/task/64714/cwd (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64714 ms_local ceph rtd unknown /proc/63193/task/64714/root (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64714 ms_local ceph txt unknown /proc/63193/task/64714/exe (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64714 ms_local ceph NOFD /proc/63193/task/64714/fd (opendir: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64715 fn_anonym ceph cwd unknown /proc/63193/task/64715/cwd (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64715 fn_anonym ceph rtd unknown /proc/63193/task/64715/root (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64715 fn_anonym ceph txt unknown /proc/63193/task/64715/exe (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64715 fn_anonym ceph NOFD /proc/63193/task/64715/fd (opendir: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64716 finisher ceph cwd unknown /proc/63193/task/64716/cwd (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64716 finisher ceph rtd unknown /proc/63193/task/64716/root (readlink: Permission denied) 2024-09-12T02:33:16.781 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64716 finisher ceph txt unknown /proc/63193/task/64716/exe (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64716 finisher ceph NOFD /proc/63193/task/64716/fd (opendir: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64717 safe_time ceph cwd unknown /proc/63193/task/64717/cwd (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64717 safe_time ceph rtd unknown /proc/63193/task/64717/root (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64717 safe_time ceph txt unknown /proc/63193/task/64717/exe (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64717 safe_time ceph NOFD /proc/63193/task/64717/fd (opendir: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64718 safe_time ceph cwd unknown /proc/63193/task/64718/cwd (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64718 safe_time ceph rtd unknown /proc/63193/task/64718/root (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64718 safe_time ceph txt unknown /proc/63193/task/64718/exe (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64718 safe_time ceph NOFD /proc/63193/task/64718/fd (opendir: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64719 ceph-osd ceph cwd unknown /proc/63193/task/64719/cwd (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64719 ceph-osd ceph rtd unknown /proc/63193/task/64719/root (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64719 ceph-osd ceph txt unknown /proc/63193/task/64719/exe (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64719 ceph-osd ceph NOFD /proc/63193/task/64719/fd (opendir: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64720 osd_srv_a ceph cwd unknown /proc/63193/task/64720/cwd (readlink: Permission denied) 2024-09-12T02:33:16.782 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64720 osd_srv_a ceph rtd unknown /proc/63193/task/64720/root (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64720 osd_srv_a ceph txt unknown /proc/63193/task/64720/exe (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64720 osd_srv_a ceph NOFD /proc/63193/task/64720/fd (opendir: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64721 tp_osd_tp ceph cwd unknown /proc/63193/task/64721/cwd (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64721 tp_osd_tp ceph rtd unknown /proc/63193/task/64721/root (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64721 tp_osd_tp ceph txt unknown /proc/63193/task/64721/exe (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64721 tp_osd_tp ceph NOFD /proc/63193/task/64721/fd (opendir: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64722 tp_osd_tp ceph cwd unknown /proc/63193/task/64722/cwd (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64722 tp_osd_tp ceph rtd unknown /proc/63193/task/64722/root (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64722 tp_osd_tp ceph txt unknown /proc/63193/task/64722/exe (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64722 tp_osd_tp ceph NOFD /proc/63193/task/64722/fd (opendir: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64723 tp_osd_tp ceph cwd unknown /proc/63193/task/64723/cwd (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64723 tp_osd_tp ceph rtd unknown /proc/63193/task/64723/root (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64723 tp_osd_tp ceph txt unknown /proc/63193/task/64723/exe (readlink: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64723 tp_osd_tp ceph NOFD /proc/63193/task/64723/fd (opendir: Permission denied) 2024-09-12T02:33:16.783 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64724 tp_osd_tp ceph cwd unknown /proc/63193/task/64724/cwd (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64724 tp_osd_tp ceph rtd unknown /proc/63193/task/64724/root (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64724 tp_osd_tp ceph txt unknown /proc/63193/task/64724/exe (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64724 tp_osd_tp ceph NOFD /proc/63193/task/64724/fd (opendir: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64725 tp_osd_tp ceph cwd unknown /proc/63193/task/64725/cwd (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64725 tp_osd_tp ceph rtd unknown /proc/63193/task/64725/root (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64725 tp_osd_tp ceph txt unknown /proc/63193/task/64725/exe (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64725 tp_osd_tp ceph NOFD /proc/63193/task/64725/fd (opendir: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64726 tp_osd_tp ceph cwd unknown /proc/63193/task/64726/cwd (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64726 tp_osd_tp ceph rtd unknown /proc/63193/task/64726/root (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64726 tp_osd_tp ceph txt unknown /proc/63193/task/64726/exe (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64726 tp_osd_tp ceph NOFD /proc/63193/task/64726/fd (opendir: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64727 tp_osd_tp ceph cwd unknown /proc/63193/task/64727/cwd (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64727 tp_osd_tp ceph rtd unknown /proc/63193/task/64727/root (readlink: Permission denied) 2024-09-12T02:33:16.784 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64727 tp_osd_tp ceph txt unknown /proc/63193/task/64727/exe (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64727 tp_osd_tp ceph NOFD /proc/63193/task/64727/fd (opendir: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64728 tp_osd_tp ceph cwd unknown /proc/63193/task/64728/cwd (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64728 tp_osd_tp ceph rtd unknown /proc/63193/task/64728/root (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64728 tp_osd_tp ceph txt unknown /proc/63193/task/64728/exe (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64728 tp_osd_tp ceph NOFD /proc/63193/task/64728/fd (opendir: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64729 tp_osd_tp ceph cwd unknown /proc/63193/task/64729/cwd (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64729 tp_osd_tp ceph rtd unknown /proc/63193/task/64729/root (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64729 tp_osd_tp ceph txt unknown /proc/63193/task/64729/exe (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64729 tp_osd_tp ceph NOFD /proc/63193/task/64729/fd (opendir: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64730 tp_osd_tp ceph cwd unknown /proc/63193/task/64730/cwd (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64730 tp_osd_tp ceph rtd unknown /proc/63193/task/64730/root (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64730 tp_osd_tp ceph txt unknown /proc/63193/task/64730/exe (readlink: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64730 tp_osd_tp ceph NOFD /proc/63193/task/64730/fd (opendir: Permission denied) 2024-09-12T02:33:16.785 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64731 tp_osd_tp ceph cwd unknown /proc/63193/task/64731/cwd (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64731 tp_osd_tp ceph rtd unknown /proc/63193/task/64731/root (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64731 tp_osd_tp ceph txt unknown /proc/63193/task/64731/exe (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64731 tp_osd_tp ceph NOFD /proc/63193/task/64731/fd (opendir: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64732 tp_osd_tp ceph cwd unknown /proc/63193/task/64732/cwd (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64732 tp_osd_tp ceph rtd unknown /proc/63193/task/64732/root (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64732 tp_osd_tp ceph txt unknown /proc/63193/task/64732/exe (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64732 tp_osd_tp ceph NOFD /proc/63193/task/64732/fd (opendir: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64733 tp_osd_tp ceph cwd unknown /proc/63193/task/64733/cwd (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64733 tp_osd_tp ceph rtd unknown /proc/63193/task/64733/root (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64733 tp_osd_tp ceph txt unknown /proc/63193/task/64733/exe (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64733 tp_osd_tp ceph NOFD /proc/63193/task/64733/fd (opendir: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64734 tp_osd_tp ceph cwd unknown /proc/63193/task/64734/cwd (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64734 tp_osd_tp ceph rtd unknown /proc/63193/task/64734/root (readlink: Permission denied) 2024-09-12T02:33:16.786 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64734 tp_osd_tp ceph txt unknown /proc/63193/task/64734/exe (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64734 tp_osd_tp ceph NOFD /proc/63193/task/64734/fd (opendir: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64735 tp_osd_tp ceph cwd unknown /proc/63193/task/64735/cwd (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64735 tp_osd_tp ceph rtd unknown /proc/63193/task/64735/root (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64735 tp_osd_tp ceph txt unknown /proc/63193/task/64735/exe (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64735 tp_osd_tp ceph NOFD /proc/63193/task/64735/fd (opendir: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64736 tp_osd_tp ceph cwd unknown /proc/63193/task/64736/cwd (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64736 tp_osd_tp ceph rtd unknown /proc/63193/task/64736/root (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64736 tp_osd_tp ceph txt unknown /proc/63193/task/64736/exe (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64736 tp_osd_tp ceph NOFD /proc/63193/task/64736/fd (opendir: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64737 osd_srv_h ceph cwd unknown /proc/63193/task/64737/cwd (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64737 osd_srv_h ceph rtd unknown /proc/63193/task/64737/root (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64737 osd_srv_h ceph txt unknown /proc/63193/task/64737/exe (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-osd 63193 64737 osd_srv_h ceph NOFD /proc/63193/task/64737/fd (opendir: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 64068 root cwd unknown /proc/64068/cwd (readlink: Permission denied) 2024-09-12T02:33:16.787 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 64068 root rtd unknown /proc/64068/root (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 64068 root txt unknown /proc/64068/exe (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 64068 root NOFD /proc/64068/fd (opendir: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 64098 root cwd unknown /proc/64098/cwd (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 64098 root rtd unknown /proc/64098/root (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 64098 root txt unknown /proc/64098/exe (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 64098 root NOFD /proc/64098/fd (opendir: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67873 root cwd unknown /proc/67873/cwd (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67873 root rtd unknown /proc/67873/root (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67873 root txt unknown /proc/67873/exe (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67873 root NOFD /proc/67873/fd (opendir: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67890 root cwd unknown /proc/67890/cwd (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67890 root rtd unknown /proc/67890/root (readlink: Permission denied) 2024-09-12T02:33:16.788 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67890 root txt unknown /proc/67890/exe (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67890 root NOFD /proc/67890/fd (opendir: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67891 root cwd unknown /proc/67891/cwd (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67891 root rtd unknown /proc/67891/root (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67891 root txt unknown /proc/67891/exe (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67891 root NOFD /proc/67891/fd (opendir: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67908 root cwd unknown /proc/67908/cwd (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67908 root rtd unknown /proc/67908/root (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67908 root txt unknown /proc/67908/exe (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67908 root NOFD /proc/67908/fd (opendir: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67909 root cwd unknown /proc/67909/cwd (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67909 root rtd unknown /proc/67909/root (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67909 root txt unknown /proc/67909/exe (readlink: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67909 root NOFD /proc/67909/fd (opendir: Permission denied) 2024-09-12T02:33:16.789 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67926 root cwd unknown /proc/67926/cwd (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67926 root rtd unknown /proc/67926/root (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67926 root txt unknown /proc/67926/exe (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67926 root NOFD /proc/67926/fd (opendir: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67927 root cwd unknown /proc/67927/cwd (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67927 root rtd unknown /proc/67927/root (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67927 root txt unknown /proc/67927/exe (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 67927 root NOFD /proc/67927/fd (opendir: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67944 root cwd unknown /proc/67944/cwd (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67944 root rtd unknown /proc/67944/root (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67944 root txt unknown /proc/67944/exe (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:journalct 67944 root NOFD /proc/67944/fd (opendir: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 68079 root cwd unknown /proc/68079/cwd (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 68079 root rtd unknown /proc/68079/root (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 68079 root txt unknown /proc/68079/exe (readlink: Permission denied) 2024-09-12T02:33:16.790 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/u 68079 root NOFD /proc/68079/fd (opendir: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68448 root cwd unknown /proc/68448/cwd (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68448 root rtd unknown /proc/68448/root (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68448 root txt unknown /proc/68448/exe (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68448 root NOFD /proc/68448/fd (opendir: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68450 root cwd unknown /proc/68450/cwd (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68450 root rtd unknown /proc/68450/root (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68450 root txt unknown /proc/68450/exe (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68450 root NOFD /proc/68450/fd (opendir: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 ceph cwd unknown /proc/68470/cwd (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 ceph rtd unknown /proc/68470/root (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 ceph txt unknown /proc/68470/exe (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 ceph NOFD /proc/68470/fd (opendir: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68471 log ceph cwd unknown /proc/68470/task/68471/cwd (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68471 log ceph rtd unknown /proc/68470/task/68471/root (readlink: Permission denied) 2024-09-12T02:33:16.791 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68471 log ceph txt unknown /proc/68470/task/68471/exe (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68471 log ceph NOFD /proc/68470/task/68471/fd (opendir: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68473 msgr-work ceph cwd unknown /proc/68470/task/68473/cwd (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68473 msgr-work ceph rtd unknown /proc/68470/task/68473/root (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68473 msgr-work ceph txt unknown /proc/68470/task/68473/exe (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68473 msgr-work ceph NOFD /proc/68470/task/68473/fd (opendir: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68474 msgr-work ceph cwd unknown /proc/68470/task/68474/cwd (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68474 msgr-work ceph rtd unknown /proc/68470/task/68474/root (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68474 msgr-work ceph txt unknown /proc/68470/task/68474/exe (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68474 msgr-work ceph NOFD /proc/68470/task/68474/fd (opendir: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68475 msgr-work ceph cwd unknown /proc/68470/task/68475/cwd (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68475 msgr-work ceph rtd unknown /proc/68470/task/68475/root (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68475 msgr-work ceph txt unknown /proc/68470/task/68475/exe (readlink: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68475 msgr-work ceph NOFD /proc/68470/task/68475/fd (opendir: Permission denied) 2024-09-12T02:33:16.792 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68479 service ceph cwd unknown /proc/68470/task/68479/cwd (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68479 service ceph rtd unknown /proc/68470/task/68479/root (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68479 service ceph txt unknown /proc/68470/task/68479/exe (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68479 service ceph NOFD /proc/68470/task/68479/fd (opendir: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68480 admin_soc ceph cwd unknown /proc/68470/task/68480/cwd (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68480 admin_soc ceph rtd unknown /proc/68470/task/68480/root (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68480 admin_soc ceph txt unknown /proc/68470/task/68480/exe (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68480 admin_soc ceph NOFD /proc/68470/task/68480/fd (opendir: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68481 signal_ha ceph cwd unknown /proc/68470/task/68481/cwd (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68481 signal_ha ceph rtd unknown /proc/68470/task/68481/root (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68481 signal_ha ceph txt unknown /proc/68470/task/68481/exe (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68481 signal_ha ceph NOFD /proc/68470/task/68481/fd (opendir: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68482 io_contex ceph cwd unknown /proc/68470/task/68482/cwd (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68482 io_contex ceph rtd unknown /proc/68470/task/68482/root (readlink: Permission denied) 2024-09-12T02:33:16.793 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68482 io_contex ceph txt unknown /proc/68470/task/68482/exe (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68482 io_contex ceph NOFD /proc/68470/task/68482/fd (opendir: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68483 io_contex ceph cwd unknown /proc/68470/task/68483/cwd (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68483 io_contex ceph rtd unknown /proc/68470/task/68483/root (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68483 io_contex ceph txt unknown /proc/68470/task/68483/exe (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68483 io_contex ceph NOFD /proc/68470/task/68483/fd (opendir: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68484 ms_dispat ceph cwd unknown /proc/68470/task/68484/cwd (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68484 ms_dispat ceph rtd unknown /proc/68470/task/68484/root (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68484 ms_dispat ceph txt unknown /proc/68470/task/68484/exe (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68484 ms_dispat ceph NOFD /proc/68470/task/68484/fd (opendir: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68485 ms_local ceph cwd unknown /proc/68470/task/68485/cwd (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68485 ms_local ceph rtd unknown /proc/68470/task/68485/root (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68485 ms_local ceph txt unknown /proc/68470/task/68485/exe (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68485 ms_local ceph NOFD /proc/68470/task/68485/fd (opendir: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68486 safe_time ceph cwd unknown /proc/68470/task/68486/cwd (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68486 safe_time ceph rtd unknown /proc/68470/task/68486/root (readlink: Permission denied) 2024-09-12T02:33:16.794 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68486 safe_time ceph txt unknown /proc/68470/task/68486/exe (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68486 safe_time ceph NOFD /proc/68470/task/68486/fd (opendir: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68487 safe_time ceph cwd unknown /proc/68470/task/68487/cwd (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68487 safe_time ceph rtd unknown /proc/68470/task/68487/root (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68487 safe_time ceph txt unknown /proc/68470/task/68487/exe (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68487 safe_time ceph NOFD /proc/68470/task/68487/fd (opendir: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68488 ceph-mds ceph cwd unknown /proc/68470/task/68488/cwd (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68488 ceph-mds ceph rtd unknown /proc/68470/task/68488/root (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68488 ceph-mds ceph txt unknown /proc/68470/task/68488/exe (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68488 ceph-mds ceph NOFD /proc/68470/task/68488/fd (opendir: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68644 safe_time ceph cwd unknown /proc/68470/task/68644/cwd (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68644 safe_time ceph rtd unknown /proc/68470/task/68644/root (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68644 safe_time ceph txt unknown /proc/68470/task/68644/exe (readlink: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68470 68644 safe_time ceph NOFD /proc/68470/task/68644/fd (opendir: Permission denied) 2024-09-12T02:33:16.795 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68871 root cwd unknown /proc/68871/cwd (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68871 root rtd unknown /proc/68871/root (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68871 root txt unknown /proc/68871/exe (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 68871 root NOFD /proc/68871/fd (opendir: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68873 root cwd unknown /proc/68873/cwd (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68873 root rtd unknown /proc/68873/root (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68873 root txt unknown /proc/68873/exe (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 68873 root NOFD /proc/68873/fd (opendir: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 ceph cwd unknown /proc/68875/cwd (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 ceph rtd unknown /proc/68875/root (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 ceph txt unknown /proc/68875/exe (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 ceph NOFD /proc/68875/fd (opendir: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68878 log ceph cwd unknown /proc/68875/task/68878/cwd (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68878 log ceph rtd unknown /proc/68875/task/68878/root (readlink: Permission denied) 2024-09-12T02:33:16.796 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68878 log ceph txt unknown /proc/68875/task/68878/exe (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68878 log ceph NOFD /proc/68875/task/68878/fd (opendir: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68880 msgr-work ceph cwd unknown /proc/68875/task/68880/cwd (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68880 msgr-work ceph rtd unknown /proc/68875/task/68880/root (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68880 msgr-work ceph txt unknown /proc/68875/task/68880/exe (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68880 msgr-work ceph NOFD /proc/68875/task/68880/fd (opendir: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68881 msgr-work ceph cwd unknown /proc/68875/task/68881/cwd (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68881 msgr-work ceph rtd unknown /proc/68875/task/68881/root (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68881 msgr-work ceph txt unknown /proc/68875/task/68881/exe (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68881 msgr-work ceph NOFD /proc/68875/task/68881/fd (opendir: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68882 msgr-work ceph cwd unknown /proc/68875/task/68882/cwd (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68882 msgr-work ceph rtd unknown /proc/68875/task/68882/root (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68882 msgr-work ceph txt unknown /proc/68875/task/68882/exe (readlink: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68882 msgr-work ceph NOFD /proc/68875/task/68882/fd (opendir: Permission denied) 2024-09-12T02:33:16.797 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68886 service ceph cwd unknown /proc/68875/task/68886/cwd (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68886 service ceph rtd unknown /proc/68875/task/68886/root (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68886 service ceph txt unknown /proc/68875/task/68886/exe (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68886 service ceph NOFD /proc/68875/task/68886/fd (opendir: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68887 admin_soc ceph cwd unknown /proc/68875/task/68887/cwd (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68887 admin_soc ceph rtd unknown /proc/68875/task/68887/root (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68887 admin_soc ceph txt unknown /proc/68875/task/68887/exe (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68887 admin_soc ceph NOFD /proc/68875/task/68887/fd (opendir: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68888 signal_ha ceph cwd unknown /proc/68875/task/68888/cwd (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68888 signal_ha ceph rtd unknown /proc/68875/task/68888/root (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68888 signal_ha ceph txt unknown /proc/68875/task/68888/exe (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68888 signal_ha ceph NOFD /proc/68875/task/68888/fd (opendir: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68889 io_contex ceph cwd unknown /proc/68875/task/68889/cwd (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68889 io_contex ceph rtd unknown /proc/68875/task/68889/root (readlink: Permission denied) 2024-09-12T02:33:16.798 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68889 io_contex ceph txt unknown /proc/68875/task/68889/exe (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68889 io_contex ceph NOFD /proc/68875/task/68889/fd (opendir: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68890 io_contex ceph cwd unknown /proc/68875/task/68890/cwd (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68890 io_contex ceph rtd unknown /proc/68875/task/68890/root (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68890 io_contex ceph txt unknown /proc/68875/task/68890/exe (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68890 io_contex ceph NOFD /proc/68875/task/68890/fd (opendir: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68891 ms_dispat ceph cwd unknown /proc/68875/task/68891/cwd (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68891 ms_dispat ceph rtd unknown /proc/68875/task/68891/root (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68891 ms_dispat ceph txt unknown /proc/68875/task/68891/exe (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68891 ms_dispat ceph NOFD /proc/68875/task/68891/fd (opendir: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68892 ms_local ceph cwd unknown /proc/68875/task/68892/cwd (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68892 ms_local ceph rtd unknown /proc/68875/task/68892/root (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68892 ms_local ceph txt unknown /proc/68875/task/68892/exe (readlink: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68892 ms_local ceph NOFD /proc/68875/task/68892/fd (opendir: Permission denied) 2024-09-12T02:33:16.799 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68893 safe_time ceph cwd unknown /proc/68875/task/68893/cwd (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68893 safe_time ceph rtd unknown /proc/68875/task/68893/root (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68893 safe_time ceph txt unknown /proc/68875/task/68893/exe (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68893 safe_time ceph NOFD /proc/68875/task/68893/fd (opendir: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68894 safe_time ceph cwd unknown /proc/68875/task/68894/cwd (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68894 safe_time ceph rtd unknown /proc/68875/task/68894/root (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68894 safe_time ceph txt unknown /proc/68875/task/68894/exe (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68894 safe_time ceph NOFD /proc/68875/task/68894/fd (opendir: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68895 ceph-mds ceph cwd unknown /proc/68875/task/68895/cwd (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68895 ceph-mds ceph rtd unknown /proc/68875/task/68895/root (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68895 ceph-mds ceph txt unknown /proc/68875/task/68895/exe (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68895 ceph-mds ceph NOFD /proc/68875/task/68895/fd (opendir: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68959 safe_time ceph cwd unknown /proc/68875/task/68959/cwd (readlink: Permission denied) 2024-09-12T02:33:16.800 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68959 safe_time ceph rtd unknown /proc/68875/task/68959/root (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68959 safe_time ceph txt unknown /proc/68875/task/68959/exe (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 68875 68959 safe_time ceph NOFD /proc/68875/task/68959/fd (opendir: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 69678 root cwd unknown /proc/69678/cwd (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 69678 root rtd unknown /proc/69678/root (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 69678 root txt unknown /proc/69678/exe (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 69678 root NOFD /proc/69678/fd (opendir: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 69682 root cwd unknown /proc/69682/cwd (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 69682 root rtd unknown /proc/69682/root (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 69682 root txt unknown /proc/69682/exe (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 69682 root NOFD /proc/69682/fd (opendir: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 ceph cwd unknown /proc/69689/cwd (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 ceph rtd unknown /proc/69689/root (readlink: Permission denied) 2024-09-12T02:33:16.801 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 ceph txt unknown /proc/69689/exe (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 ceph NOFD /proc/69689/fd (opendir: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69690 log ceph cwd unknown /proc/69689/task/69690/cwd (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69690 log ceph rtd unknown /proc/69689/task/69690/root (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69690 log ceph txt unknown /proc/69689/task/69690/exe (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69690 log ceph NOFD /proc/69689/task/69690/fd (opendir: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69692 msgr-work ceph cwd unknown /proc/69689/task/69692/cwd (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69692 msgr-work ceph rtd unknown /proc/69689/task/69692/root (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69692 msgr-work ceph txt unknown /proc/69689/task/69692/exe (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69692 msgr-work ceph NOFD /proc/69689/task/69692/fd (opendir: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69693 msgr-work ceph cwd unknown /proc/69689/task/69693/cwd (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69693 msgr-work ceph rtd unknown /proc/69689/task/69693/root (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69693 msgr-work ceph txt unknown /proc/69689/task/69693/exe (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69693 msgr-work ceph NOFD /proc/69689/task/69693/fd (opendir: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69694 msgr-work ceph cwd unknown /proc/69689/task/69694/cwd (readlink: Permission denied) 2024-09-12T02:33:16.802 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69694 msgr-work ceph rtd unknown /proc/69689/task/69694/root (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69694 msgr-work ceph txt unknown /proc/69689/task/69694/exe (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69694 msgr-work ceph NOFD /proc/69689/task/69694/fd (opendir: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69698 service ceph cwd unknown /proc/69689/task/69698/cwd (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69698 service ceph rtd unknown /proc/69689/task/69698/root (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69698 service ceph txt unknown /proc/69689/task/69698/exe (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69698 service ceph NOFD /proc/69689/task/69698/fd (opendir: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69699 admin_soc ceph cwd unknown /proc/69689/task/69699/cwd (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69699 admin_soc ceph rtd unknown /proc/69689/task/69699/root (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69699 admin_soc ceph txt unknown /proc/69689/task/69699/exe (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69699 admin_soc ceph NOFD /proc/69689/task/69699/fd (opendir: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69700 signal_ha ceph cwd unknown /proc/69689/task/69700/cwd (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69700 signal_ha ceph rtd unknown /proc/69689/task/69700/root (readlink: Permission denied) 2024-09-12T02:33:16.803 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69700 signal_ha ceph txt unknown /proc/69689/task/69700/exe (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69700 signal_ha ceph NOFD /proc/69689/task/69700/fd (opendir: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69701 io_contex ceph cwd unknown /proc/69689/task/69701/cwd (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69701 io_contex ceph rtd unknown /proc/69689/task/69701/root (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69701 io_contex ceph txt unknown /proc/69689/task/69701/exe (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69701 io_contex ceph NOFD /proc/69689/task/69701/fd (opendir: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69702 io_contex ceph cwd unknown /proc/69689/task/69702/cwd (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69702 io_contex ceph rtd unknown /proc/69689/task/69702/root (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69702 io_contex ceph txt unknown /proc/69689/task/69702/exe (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69702 io_contex ceph NOFD /proc/69689/task/69702/fd (opendir: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69703 ms_dispat ceph cwd unknown /proc/69689/task/69703/cwd (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69703 ms_dispat ceph rtd unknown /proc/69689/task/69703/root (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69703 ms_dispat ceph txt unknown /proc/69689/task/69703/exe (readlink: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69703 ms_dispat ceph NOFD /proc/69689/task/69703/fd (opendir: Permission denied) 2024-09-12T02:33:16.804 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69704 ms_local ceph cwd unknown /proc/69689/task/69704/cwd (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69704 ms_local ceph rtd unknown /proc/69689/task/69704/root (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69704 ms_local ceph txt unknown /proc/69689/task/69704/exe (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69704 ms_local ceph NOFD /proc/69689/task/69704/fd (opendir: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69705 safe_time ceph cwd unknown /proc/69689/task/69705/cwd (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69705 safe_time ceph rtd unknown /proc/69689/task/69705/root (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69705 safe_time ceph txt unknown /proc/69689/task/69705/exe (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69705 safe_time ceph NOFD /proc/69689/task/69705/fd (opendir: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69706 safe_time ceph cwd unknown /proc/69689/task/69706/cwd (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69706 safe_time ceph rtd unknown /proc/69689/task/69706/root (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69706 safe_time ceph txt unknown /proc/69689/task/69706/exe (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69706 safe_time ceph NOFD /proc/69689/task/69706/fd (opendir: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69707 ceph-mds ceph cwd unknown /proc/69689/task/69707/cwd (readlink: Permission denied) 2024-09-12T02:33:16.805 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69707 ceph-mds ceph rtd unknown /proc/69689/task/69707/root (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69707 ceph-mds ceph txt unknown /proc/69689/task/69707/exe (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69707 ceph-mds ceph NOFD /proc/69689/task/69707/fd (opendir: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69893 safe_time ceph cwd unknown /proc/69689/task/69893/cwd (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69893 safe_time ceph rtd unknown /proc/69689/task/69893/root (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69893 safe_time ceph txt unknown /proc/69689/task/69893/exe (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 69893 safe_time ceph NOFD /proc/69689/task/69893/fd (opendir: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72220 ceph_time ceph cwd unknown /proc/69689/task/72220/cwd (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72220 ceph_time ceph rtd unknown /proc/69689/task/72220/root (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72220 ceph_time ceph txt unknown /proc/69689/task/72220/exe (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72220 ceph_time ceph NOFD /proc/69689/task/72220/fd (opendir: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72221 OpHistory ceph cwd unknown /proc/69689/task/72221/cwd (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72221 OpHistory ceph rtd unknown /proc/69689/task/72221/root (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72221 OpHistory ceph txt unknown /proc/69689/task/72221/exe (readlink: Permission denied) 2024-09-12T02:33:16.806 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72221 OpHistory ceph NOFD /proc/69689/task/72221/fd (opendir: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72223 ms_dispat ceph cwd unknown /proc/69689/task/72223/cwd (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72223 ms_dispat ceph rtd unknown /proc/69689/task/72223/root (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72223 ms_dispat ceph txt unknown /proc/69689/task/72223/exe (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72223 ms_dispat ceph NOFD /proc/69689/task/72223/fd (opendir: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72225 ms_dispat ceph cwd unknown /proc/69689/task/72225/cwd (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72225 ms_dispat ceph rtd unknown /proc/69689/task/72225/root (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72225 ms_dispat ceph txt unknown /proc/69689/task/72225/exe (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72225 ms_dispat ceph NOFD /proc/69689/task/72225/fd (opendir: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72230 mds_rank_ ceph cwd unknown /proc/69689/task/72230/cwd (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72230 mds_rank_ ceph rtd unknown /proc/69689/task/72230/root (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72230 mds_rank_ ceph txt unknown /proc/69689/task/72230/exe (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72230 mds_rank_ ceph NOFD /proc/69689/task/72230/fd (opendir: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72232 PQ_Finish ceph cwd unknown /proc/69689/task/72232/cwd (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72232 PQ_Finish ceph rtd unknown /proc/69689/task/72232/root (readlink: Permission denied) 2024-09-12T02:33:16.807 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72232 PQ_Finish ceph txt unknown /proc/69689/task/72232/exe (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72232 PQ_Finish ceph NOFD /proc/69689/task/72232/fd (opendir: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72233 safe_time ceph cwd unknown /proc/69689/task/72233/cwd (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72233 safe_time ceph rtd unknown /proc/69689/task/72233/root (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72233 safe_time ceph txt unknown /proc/69689/task/72233/exe (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72233 safe_time ceph NOFD /proc/69689/task/72233/fd (opendir: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72234 MR_Finish ceph cwd unknown /proc/69689/task/72234/cwd (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72234 MR_Finish ceph rtd unknown /proc/69689/task/72234/root (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72234 MR_Finish ceph txt unknown /proc/69689/task/72234/exe (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72234 MR_Finish ceph NOFD /proc/69689/task/72234/fd (opendir: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72238 md_submit ceph cwd unknown /proc/69689/task/72238/cwd (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72238 md_submit ceph rtd unknown /proc/69689/task/72238/root (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72238 md_submit ceph txt unknown /proc/69689/task/72238/exe (readlink: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 69689 72238 md_submit ceph NOFD /proc/69689/task/72238/fd (opendir: Permission denied) 2024-09-12T02:33:16.808 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 69916 root cwd unknown /proc/69916/cwd (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 69916 root rtd unknown /proc/69916/root (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 69916 root txt unknown /proc/69916/exe (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 69916 root NOFD /proc/69916/fd (opendir: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 70057 root cwd unknown /proc/70057/cwd (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 70057 root rtd unknown /proc/70057/root (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 70057 root txt unknown /proc/70057/exe (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/2 70057 root NOFD /proc/70057/fd (opendir: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 70060 root cwd unknown /proc/70060/cwd (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 70060 root rtd unknown /proc/70060/root (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 70060 root txt unknown /proc/70060/exe (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:conmon 70060 root NOFD /proc/70060/fd (opendir: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 70062 root cwd unknown /proc/70062/cwd (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 70062 root rtd unknown /proc/70062/root (readlink: Permission denied) 2024-09-12T02:33:16.809 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 70062 root txt unknown /proc/70062/exe (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:podman-in 70062 root NOFD /proc/70062/fd (opendir: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 ceph cwd unknown /proc/70064/cwd (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 ceph rtd unknown /proc/70064/root (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 ceph txt unknown /proc/70064/exe (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 ceph NOFD /proc/70064/fd (opendir: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70065 log ceph cwd unknown /proc/70064/task/70065/cwd (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70065 log ceph rtd unknown /proc/70064/task/70065/root (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70065 log ceph txt unknown /proc/70064/task/70065/exe (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70065 log ceph NOFD /proc/70064/task/70065/fd (opendir: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70067 msgr-work ceph cwd unknown /proc/70064/task/70067/cwd (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70067 msgr-work ceph rtd unknown /proc/70064/task/70067/root (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70067 msgr-work ceph txt unknown /proc/70064/task/70067/exe (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70067 msgr-work ceph NOFD /proc/70064/task/70067/fd (opendir: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70068 msgr-work ceph cwd unknown /proc/70064/task/70068/cwd (readlink: Permission denied) 2024-09-12T02:33:16.810 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70068 msgr-work ceph rtd unknown /proc/70064/task/70068/root (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70068 msgr-work ceph txt unknown /proc/70064/task/70068/exe (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70068 msgr-work ceph NOFD /proc/70064/task/70068/fd (opendir: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70069 msgr-work ceph cwd unknown /proc/70064/task/70069/cwd (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70069 msgr-work ceph rtd unknown /proc/70064/task/70069/root (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70069 msgr-work ceph txt unknown /proc/70064/task/70069/exe (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70069 msgr-work ceph NOFD /proc/70064/task/70069/fd (opendir: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70073 service ceph cwd unknown /proc/70064/task/70073/cwd (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70073 service ceph rtd unknown /proc/70064/task/70073/root (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70073 service ceph txt unknown /proc/70064/task/70073/exe (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70073 service ceph NOFD /proc/70064/task/70073/fd (opendir: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70074 admin_soc ceph cwd unknown /proc/70064/task/70074/cwd (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70074 admin_soc ceph rtd unknown /proc/70064/task/70074/root (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70074 admin_soc ceph txt unknown /proc/70064/task/70074/exe (readlink: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70074 admin_soc ceph NOFD /proc/70064/task/70074/fd (opendir: Permission denied) 2024-09-12T02:33:16.811 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70075 signal_ha ceph cwd unknown /proc/70064/task/70075/cwd (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70075 signal_ha ceph rtd unknown /proc/70064/task/70075/root (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70075 signal_ha ceph txt unknown /proc/70064/task/70075/exe (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70075 signal_ha ceph NOFD /proc/70064/task/70075/fd (opendir: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70076 io_contex ceph cwd unknown /proc/70064/task/70076/cwd (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70076 io_contex ceph rtd unknown /proc/70064/task/70076/root (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70076 io_contex ceph txt unknown /proc/70064/task/70076/exe (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70076 io_contex ceph NOFD /proc/70064/task/70076/fd (opendir: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70077 io_contex ceph cwd unknown /proc/70064/task/70077/cwd (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70077 io_contex ceph rtd unknown /proc/70064/task/70077/root (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70077 io_contex ceph txt unknown /proc/70064/task/70077/exe (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70077 io_contex ceph NOFD /proc/70064/task/70077/fd (opendir: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70078 ms_dispat ceph cwd unknown /proc/70064/task/70078/cwd (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70078 ms_dispat ceph rtd unknown /proc/70064/task/70078/root (readlink: Permission denied) 2024-09-12T02:33:16.812 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70078 ms_dispat ceph txt unknown /proc/70064/task/70078/exe (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70078 ms_dispat ceph NOFD /proc/70064/task/70078/fd (opendir: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70079 ms_local ceph cwd unknown /proc/70064/task/70079/cwd (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70079 ms_local ceph rtd unknown /proc/70064/task/70079/root (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70079 ms_local ceph txt unknown /proc/70064/task/70079/exe (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70079 ms_local ceph NOFD /proc/70064/task/70079/fd (opendir: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70080 safe_time ceph cwd unknown /proc/70064/task/70080/cwd (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70080 safe_time ceph rtd unknown /proc/70064/task/70080/root (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70080 safe_time ceph txt unknown /proc/70064/task/70080/exe (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70080 safe_time ceph NOFD /proc/70064/task/70080/fd (opendir: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70081 safe_time ceph cwd unknown /proc/70064/task/70081/cwd (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70081 safe_time ceph rtd unknown /proc/70064/task/70081/root (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70081 safe_time ceph txt unknown /proc/70064/task/70081/exe (readlink: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70081 safe_time ceph NOFD /proc/70064/task/70081/fd (opendir: Permission denied) 2024-09-12T02:33:16.813 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70082 ceph-mds ceph cwd unknown /proc/70064/task/70082/cwd (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70082 ceph-mds ceph rtd unknown /proc/70064/task/70082/root (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70082 ceph-mds ceph txt unknown /proc/70064/task/70082/exe (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70082 ceph-mds ceph NOFD /proc/70064/task/70082/fd (opendir: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70087 safe_time ceph cwd unknown /proc/70064/task/70087/cwd (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70087 safe_time ceph rtd unknown /proc/70064/task/70087/root (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70087 safe_time ceph txt unknown /proc/70064/task/70087/exe (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 70087 safe_time ceph NOFD /proc/70064/task/70087/fd (opendir: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72219 ceph_time ceph cwd unknown /proc/70064/task/72219/cwd (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72219 ceph_time ceph rtd unknown /proc/70064/task/72219/root (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72219 ceph_time ceph txt unknown /proc/70064/task/72219/exe (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72219 ceph_time ceph NOFD /proc/70064/task/72219/fd (opendir: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72222 OpHistory ceph cwd unknown /proc/70064/task/72222/cwd (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72222 OpHistory ceph rtd unknown /proc/70064/task/72222/root (readlink: Permission denied) 2024-09-12T02:33:16.814 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72222 OpHistory ceph txt unknown /proc/70064/task/72222/exe (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72222 OpHistory ceph NOFD /proc/70064/task/72222/fd (opendir: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72224 ms_dispat ceph cwd unknown /proc/70064/task/72224/cwd (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72224 ms_dispat ceph rtd unknown /proc/70064/task/72224/root (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72224 ms_dispat ceph txt unknown /proc/70064/task/72224/exe (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72224 ms_dispat ceph NOFD /proc/70064/task/72224/fd (opendir: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72226 ms_dispat ceph cwd unknown /proc/70064/task/72226/cwd (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72226 ms_dispat ceph rtd unknown /proc/70064/task/72226/root (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72226 ms_dispat ceph txt unknown /proc/70064/task/72226/exe (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72226 ms_dispat ceph NOFD /proc/70064/task/72226/fd (opendir: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72227 mds_rank_ ceph cwd unknown /proc/70064/task/72227/cwd (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72227 mds_rank_ ceph rtd unknown /proc/70064/task/72227/root (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72227 mds_rank_ ceph txt unknown /proc/70064/task/72227/exe (readlink: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72227 mds_rank_ ceph NOFD /proc/70064/task/72227/fd (opendir: Permission denied) 2024-09-12T02:33:16.815 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72228 PQ_Finish ceph cwd unknown /proc/70064/task/72228/cwd (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72228 PQ_Finish ceph rtd unknown /proc/70064/task/72228/root (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72228 PQ_Finish ceph txt unknown /proc/70064/task/72228/exe (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72228 PQ_Finish ceph NOFD /proc/70064/task/72228/fd (opendir: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72229 safe_time ceph cwd unknown /proc/70064/task/72229/cwd (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72229 safe_time ceph rtd unknown /proc/70064/task/72229/root (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72229 safe_time ceph txt unknown /proc/70064/task/72229/exe (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72229 safe_time ceph NOFD /proc/70064/task/72229/fd (opendir: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72231 MR_Finish ceph cwd unknown /proc/70064/task/72231/cwd (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72231 MR_Finish ceph rtd unknown /proc/70064/task/72231/root (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72231 MR_Finish ceph txt unknown /proc/70064/task/72231/exe (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72231 MR_Finish ceph NOFD /proc/70064/task/72231/fd (opendir: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72236 md_submit ceph cwd unknown /proc/70064/task/72236/cwd (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72236 md_submit ceph rtd unknown /proc/70064/task/72236/root (readlink: Permission denied) 2024-09-12T02:33:16.816 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72236 md_submit ceph txt unknown /proc/70064/task/72236/exe (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:ceph-mds 70064 72236 md_submit ceph NOFD /proc/70064/task/72236/fd (opendir: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 75327 root cwd unknown /proc/75327/cwd (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 75327 root rtd unknown /proc/75327/root (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 75327 root txt unknown /proc/75327/exe (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/4 75327 root NOFD /proc/75327/fd (opendir: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 77848 root cwd unknown /proc/77848/cwd (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 77848 root rtd unknown /proc/77848/root (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 77848 root txt unknown /proc/77848/exe (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/7 77848 root NOFD /proc/77848/fd (opendir: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 80599 root cwd unknown /proc/80599/cwd (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 80599 root rtd unknown /proc/80599/root (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 80599 root txt unknown /proc/80599/exe (readlink: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 80599 root NOFD /proc/80599/fd (opendir: Permission denied) 2024-09-12T02:33:16.817 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80708 root cwd unknown /proc/80708/cwd (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80708 root rtd unknown /proc/80708/root (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80708 root txt unknown /proc/80708/exe (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80708 root NOFD /proc/80708/fd (opendir: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80709 root cwd unknown /proc/80709/cwd (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80709 root rtd unknown /proc/80709/root (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80709 root txt unknown /proc/80709/exe (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80709 root NOFD /proc/80709/fd (opendir: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80710 root cwd unknown /proc/80710/cwd (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80710 root rtd unknown /proc/80710/root (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80710 root txt unknown /proc/80710/exe (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/R 80710 root NOFD /proc/80710/fd (opendir: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 81496 root cwd unknown /proc/81496/cwd (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 81496 root rtd unknown /proc/81496/root (readlink: Permission denied) 2024-09-12T02:33:16.818 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 81496 root txt unknown /proc/81496/exe (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:sudo 81496 root NOFD /proc/81496/fd (opendir: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:daemon-he 81530 root cwd unknown /proc/81530/cwd (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:daemon-he 81530 root rtd unknown /proc/81530/root (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:daemon-he 81530 root txt unknown /proc/81530/exe (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:daemon-he 81530 root NOFD /proc/81530/fd (opendir: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:bash 81532 root cwd unknown /proc/81532/cwd (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:bash 81532 root rtd unknown /proc/81532/root (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:bash 81532 root txt unknown /proc/81532/exe (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:bash 81532 root NOFD /proc/81532/fd (opendir: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 81762 root cwd unknown /proc/81762/cwd (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 81762 root rtd unknown /proc/81762/root (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 81762 root txt unknown /proc/81762/exe (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/1 81762 root NOFD /proc/81762/fd (opendir: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 84001 root cwd unknown /proc/84001/cwd (readlink: Permission denied) 2024-09-12T02:33:16.819 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 84001 root rtd unknown /proc/84001/root (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 84001 root txt unknown /proc/84001/exe (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/6 84001 root NOFD /proc/84001/fd (opendir: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 84764 root cwd unknown /proc/84764/cwd (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 84764 root rtd unknown /proc/84764/root (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 84764 root txt unknown /proc/84764/exe (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 84764 root NOFD /proc/84764/fd (opendir: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 85915 root cwd unknown /proc/85915/cwd (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 85915 root rtd unknown /proc/85915/root (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 85915 root txt unknown /proc/85915/exe (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/0 85915 root NOFD /proc/85915/fd (opendir: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 87070 root cwd unknown /proc/87070/cwd (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 87070 root rtd unknown /proc/87070/root (readlink: Permission denied) 2024-09-12T02:33:16.820 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 87070 root txt unknown /proc/87070/exe (readlink: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/3 87070 root NOFD /proc/87070/fd (opendir: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87133 root cwd unknown /proc/87133/cwd (readlink: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87133 root rtd unknown /proc/87133/root (readlink: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87133 root txt unknown /proc/87133/exe (readlink: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87133 root NOFD /proc/87133/fd (opendir: Permission denied) 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T02:33:16.821 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu 0r FIFO 0,13 0t0 234263 pipe 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu 1w FIFO 0,13 0t0 234264 pipe 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:timeout 87218 ubuntu 2w FIFO 0,13 0t0 234265 pipe 2024-09-12T02:33:16.822 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T02:33:16.823 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu 0r FIFO 0,13 0t0 234263 pipe 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu 1w FIFO 0,13 0t0 234264 pipe 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu 2w FIFO 0,13 0t0 234265 pipe 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:fsync-tes 87236 ubuntu 255r REG 8,1 207 532634 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87304 root cwd unknown /proc/87304/cwd (readlink: Permission denied) 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87304 root rtd unknown /proc/87304/root (readlink: Permission denied) 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87304 root txt unknown /proc/87304/exe (readlink: Permission denied) 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:kworker/5 87304 root NOFD /proc/87304/fd (opendir: Permission denied) 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:sleep 89853 root cwd unknown /proc/89853/cwd (readlink: Permission denied) 2024-09-12T02:33:16.824 INFO:tasks.workunit.client.0.smithi001.stdout:sleep 89853 root rtd unknown /proc/89853/root (readlink: Permission denied) 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:sleep 89853 root txt unknown /proc/89853/exe (readlink: Permission denied) 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:sleep 89853 root NOFD /proc/89853/fd (opendir: Permission denied) 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T02:33:16.825 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 0r FIFO 0,13 0t0 234263 pipe 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 1w FIFO 0,13 0t0 234264 pipe 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 2w FIFO 0,13 0t0 234265 pipe 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 4r DIR 0,20 0 247976 /proc/90380/fd 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 5w FIFO 0,13 0t0 247981 pipe 2024-09-12T02:33:16.826 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90380 ubuntu 6r FIFO 0,13 0t0 247982 pipe 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T02:33:16.827 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu 4r FIFO 0,13 0t0 247981 pipe 2024-09-12T02:33:16.828 INFO:tasks.workunit.client.0.smithi001.stdout:lsof 90381 ubuntu 7w FIFO 0,13 0t0 247982 pipe 2024-09-12T02:33:16.829 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:33:16.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:33:16.873 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-12T02:33:16.873 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:33:17.225 DEBUG:teuthology.parallel:result is None 2024-09-12T02:33:17.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:33:17.255 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:33:17.255 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T02:33:17.265 INFO:tasks.quiescer:joining Quiescers 2024-09-12T02:33:17.266 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T02:33:17.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:33:17.552 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:17.951 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:17 smithi001 ceph-mon[31252]: pgmap v413: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 347 KiB/s wr, 16 op/s 2024-09-12T02:33:17.951 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:17 smithi001 ceph-mon[31252]: scrub summary: idle 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 -- 172.21.15.1:0/3406370033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 msgr2=0x7f8038110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 --2- 172.21.15.1:0/3406370033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f8038110820 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8030009900 tx=0x7f803002a480 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 -- 172.21.15.1:0/3406370033 shutdown_connections 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 --2- 172.21.15.1:0/3406370033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f8038110820 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 --2- 172.21.15.1:0/3406370033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f803810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 --2- 172.21.15.1:0/3406370033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 0x7f8038074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 -- 172.21.15.1:0/3406370033 >> 172.21.15.1:0/3406370033 conn(0x7f80380fd8f0 msgr2=0x7f80380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 -- 172.21.15.1:0/3406370033 shutdown_connections 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 -- 172.21.15.1:0/3406370033 wait complete. 2024-09-12T02:33:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.034+0000 7f803d505640 1 Processor -- start 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 -- start start 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 0x7f80381a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f80381a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8038114240 con 0x7f803810e3d0 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80381140c0 con 0x7f8038074f40 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f803d505640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f80381143c0 con 0x7f8038074620 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59770/0 (socket says 172.21.15.1:59770) 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 -- 172.21.15.1:0/597107142 learned_addr learned my addr 172.21.15.1:0/597107142 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f8036ffd640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 0x7f80381a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80367fc640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f80381a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 -- 172.21.15.1:0/597107142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 msgr2=0x7f80381a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 0x7f80381a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 -- 172.21.15.1:0/597107142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 msgr2=0x7f80381a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f80381a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 -- 172.21.15.1:0/597107142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803819ad00 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80367fc640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f80381a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.035+0000 7f80377fe640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8030009230 tx=0x7f80300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.036+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803003f030 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.036+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803819af90 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.036+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8030003ce0 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.036+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030035070 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.036+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80381a72e0 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.037+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038074a80 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.039+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8030042030 con 0x7f803810e3d0 2024-09-12T02:33:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.039+0000 7f802ffff640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 0x7f80240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.040+0000 7f8036ffd640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 0x7f80240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.040+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f80300ef9f0 con 0x7f803810e3d0 2024-09-12T02:33:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.040+0000 7f8036ffd640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 0x7f80240a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f802800a400 tx=0x7f802800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.043+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80300bc8d0 con 0x7f803810e3d0 2024-09-12T02:33:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:17 smithi134 ceph-mon[35091]: pgmap v413: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 347 KiB/s wr, 16 op/s 2024-09-12T02:33:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:17 smithi134 ceph-mon[35091]: scrub summary: idle 2024-09-12T02:33:18.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:17 smithi173 ceph-mon[35036]: pgmap v413: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 347 KiB/s wr, 16 op/s 2024-09-12T02:33:18.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:17 smithi173 ceph-mon[35036]: scrub summary: idle 2024-09-12T02:33:18.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.253+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8038109550 con 0x7f803810e3d0 2024-09-12T02:33:18.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.254+0000 7f802ffff640 1 -- 172.21.15.1:0/597107142 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f80300bc1d0 con 0x7f803810e3d0 2024-09-12T02:33:18.255 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:18.255 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:33:18.255 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:33:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.256+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 msgr2=0x7f80240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.256+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 0x7f80240a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f802800a400 tx=0x7f802800d040 comp rx=0 tx=0).stop 2024-09-12T02:33:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.256+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 msgr2=0x7f803819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.256+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8030009230 tx=0x7f80300042f0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 shutdown_connections 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f80240a2b80 0x7f80240a5040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f803810e3d0 0x7f803819a5d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8038074f40 0x7f80381a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 --2- 172.21.15.1:0/597107142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8038074620 0x7f80381a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 >> 172.21.15.1:0/597107142 conn(0x7f80380fd8f0 msgr2=0x7f80380ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 shutdown_connections 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:18.257+0000 7f803d505640 1 -- 172.21.15.1:0/597107142 wait complete. 2024-09-12T02:33:19.082 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:18 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/597107142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:19.121 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24494 quiesce db --cancel --all' 2024-09-12T02:33:19.121 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24494 quiesce db --cancel --all 2024-09-12T02:33:19.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:18 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/597107142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:19.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:18 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/597107142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:19.387 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:19.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 -- 172.21.15.1:0/3390849472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf010e500 msgr2=0x7fcdf0110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 --2- 172.21.15.1:0/3390849472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf010e500 0x7fcdf0110910 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009ca0 tx=0x7fcde802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 -- 172.21.15.1:0/3390849472 shutdown_connections 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 --2- 172.21.15.1:0/3390849472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf010e500 0x7fcdf0110910 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 --2- 172.21.15.1:0/3390849472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf0101440 0x7fcdf010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 --2- 172.21.15.1:0/3390849472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 -- 172.21.15.1:0/3390849472 >> 172.21.15.1:0/3390849472 conn(0x7fcdf00fc7d0 msgr2=0x7fcdf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 -- 172.21.15.1:0/3390849472 shutdown_connections 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.981+0000 7fcdf7635640 1 -- 172.21.15.1:0/3390849472 wait complete. 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 Processor -- start 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 -- start start 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf010e500 0x7fcdf019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0114250 con 0x7fcdf0101440 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01140d0 con 0x7fcdf0100b20 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf7635640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01143d0 con 0x7fcdf010e500 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59788/0 (socket says 172.21.15.1:59788) 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/1108490354 learned_addr learned my addr 172.21.15.1:0/1108490354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf010e500 0x7fcdf019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/1108490354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf010e500 msgr2=0x7fcdf019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf010e500 0x7fcdf019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/1108490354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 msgr2=0x7fcdf019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/1108490354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf019f6e0 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.982+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcde000d950 tx=0x7fcde000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.983+0000 7fcde67fc640 1 -- 172.21.15.1:0/1108490354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0017070 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.983+0000 7fcde67fc640 1 -- 172.21.15.1:0/1108490354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde0009c30 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.983+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf019f9d0 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.983+0000 7fcde67fc640 1 -- 172.21.15.1:0/1108490354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde000f600 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.983+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf01a72b0 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.985+0000 7fcde67fc640 1 -- 172.21.15.1:0/1108490354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fcde001a070 con 0x7fcdf0101440 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.985+0000 7fcdf9a0e740 1 Processor -- start 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 -- start start 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c194de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c195320 0x558e5c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e5c0f9200 con 0x558e5c19fbe0 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e5c09fdc0 con 0x558e5c195320 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558e5c0f51c0 con 0x558e5c194a00 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcde67fc640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 0x7fcddc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 0x7fcddc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59798/0 (socket says 172.21.15.1:59798) 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/3851390564 learned_addr learned my addr 172.21.15.1:0/3851390564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcde67fc640 1 -- 172.21.15.1:0/1108490354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcde00ceaf0 con 0x7fcdf0101440 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c195320 0x558e5c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/3851390564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 msgr2=0x558e5c194de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c194de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/3851390564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c195320 msgr2=0x558e5c19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c195320 0x558e5c19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.986+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/3851390564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5be6a620 con 0x558e5c19fbe0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcde00976e0 tx=0x7fcde006e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c855c067ca44c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 0x7fcddc0a50c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009430 tx=0x7fcde802f330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcddb7fe640 1 -- 172.21.15.1:0/3851390564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0021070 con 0x558e5c19fbe0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcddb7fe640 1 -- 172.21.15.1:0/3851390564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde0009de0 con 0x558e5c19fbe0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcddb7fe640 1 -- 172.21.15.1:0/3851390564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde009b2d0 con 0x558e5c19fbe0 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.987+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/3851390564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 msgr2=0x558e5c1a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcde00976e0 tx=0x7fcde006e390 comp rx=0 tx=0).stop 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/3851390564 shutdown_connections 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c19fbe0 0x558e5c1a1fd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:19.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c195320 0x558e5c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/3851390564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c194de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/3851390564 >> 172.21.15.1:0/3851390564 conn(0x558e5c190f90 msgr2=0x558e5c191370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/3851390564 shutdown_connections 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/3851390564 wait complete. 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 -- start start 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 Processor -- start 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c19c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.988+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e5c1a2750 con 0x558e5c194a00 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e5c093c50 con 0x558e5c19fbe0 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558e5c1a28d0 con 0x558e5c195320 2024-09-12T02:33:20.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf9a0e740 10 client.0 _ll_register_callbacks cb 0x558e5c0a5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59808/0 (socket says 172.21.15.1:59808) 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 -- 172.21.15.1:0/1499957622 learned_addr learned my addr 172.21.15.1:0/1499957622 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 -- 172.21.15.1:0/1499957622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 msgr2=0x558e5c19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 -- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 msgr2=0x558e5c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 -- 172.21.15.1:0/1499957622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5c19d5c0 con 0x558e5c194a00 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00bfb0 tx=0x7fcdec0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2023720f6d9d4999 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec0035f0 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcdec003790 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcde0009de0 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.989+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcdec003990 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 10 client.16275 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e5c1ae370 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde0009de0 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcdec019070 con 0x558e5c194a00 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 10 client.16275 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 10 client.16275 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 20 client.16275 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c1af7d0 0x558e5c1b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 4 client.16275 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:20.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5c106770 con 0x558e5c1af7d0 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.990+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c1af7d0 0x558e5c1b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.991+0000 7fcdd8ff9640 10 client.16275 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.991+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c1af7d0 0x558e5c1b1c40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56da81b2ebbc3ce server_cookie=fe2b6aa530235b31 in_seq=0 out_seq=0 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/1499957622 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5c106770 con 0x558e5c1af7d0 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdd8ff9640 10 client.16275 handle_command_reply: tid=0 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 client.16275 shutdown 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 msgr2=0x558e5c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00bfb0 tx=0x7fcdec0128e0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 shutdown_connections 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c1af7d0 0x558e5c1b1c40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/1499957622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c19f560 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 >> 172.21.15.1:0/1499957622 conn(0x558e5c190f90 msgr2=0x558e5c1901d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdd8ff9640 0 client.16275 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:20.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 shutdown_connections 2024-09-12T02:33:20.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/1499957622 wait complete. 2024-09-12T02:33:20.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:19.992+0000 7fcdf9a0e740 20 client.16275 trim_cache size 0 max 16384 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 Processor -- start 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 -- start start 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c197d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01af870 con 0x558e5c194a00 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01b13b0 con 0x558e5c19fbe0 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01aff40 con 0x558e5c195320 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf53d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf53d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59814/0 (socket says 172.21.15.1:59814) 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf53d1640 1 -- 172.21.15.1:0/2816775613 learned_addr learned my addr 172.21.15.1:0/2816775613 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.010+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 -- 172.21.15.1:0/2816775613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 msgr2=0x558e5c197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 -- 172.21.15.1:0/2816775613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 msgr2=0x558e5c1b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 -- 172.21.15.1:0/2816775613 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5c18c730 con 0x558e5c194a00 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcdec010e70 tx=0x7fcdec00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3c3607cd0f800b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcddaffd640 1 -- 172.21.15.1:0/2816775613 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec0044c0 con 0x558e5c194a00 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcddaffd640 1 -- 172.21.15.1:0/2816775613 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdec005040 con 0x558e5c194a00 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.011+0000 7fcddaffd640 1 -- 172.21.15.1:0/2816775613 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec010910 con 0x558e5c194a00 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2816775613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 msgr2=0x558e5c1b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcdec010e70 tx=0x7fcdec00b7c0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2816775613 shutdown_connections 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c195320 0x558e5c197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2816775613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c194a00 0x558e5c1b1c40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2816775613 >> 172.21.15.1:0/2816775613 conn(0x558e5c190f90 msgr2=0x558e5c1975f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2816775613 shutdown_connections 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2816775613 wait complete. 2024-09-12T02:33:20.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 -- start start 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.012+0000 7fcdf9a0e740 1 Processor -- start 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c1a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1a3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01b0ce0 con 0x558e5c195320 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01b0610 con 0x558e5c19fbe0 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf01ad850 con 0x558e5c194a00 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf9a0e740 10 client.0 _ll_register_callbacks cb 0x7fcdec00bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59826/0 (socket says 172.21.15.1:59826) 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/2792413112 learned_addr learned my addr 172.21.15.1:0/2792413112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf5bd2640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c1a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/2792413112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 msgr2=0x558e5c1a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c1a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 msgr2=0x558e5c1a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf4bd0640 1 -- 172.21.15.1:0/2792413112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5c19d100 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.013+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c1a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf4bd0640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcde0099580 tx=0x7fcde0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a4ff09d03752f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0021040 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcde00cc680 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdec005040 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcde00b9050 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 10 client.16281 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e5c219fd0 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdec005040 con 0x558e5c195320 2024-09-12T02:33:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcde0097940 con 0x558e5c195320 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 10 client.16281 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 10 client.16281 resolve_mds: validated gid 24494 aka daemon mds.b 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 20 client.16281 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c21a2c0 0x558e5c21c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 4 client.16281 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.014+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x558e5c100c80 con 0x558e5c21a2c0 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c21a2c0 0x558e5c21c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdf53d1640 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c21a2c0 0x558e5c21c6b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63ca9f61884bad1 server_cookie=7ec2983cb82902e7 in_seq=0 out_seq=0 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdd8ff9640 10 client.16281 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdd8ff9640 1 -- 172.21.15.1:0/2792413112 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x558e5c100c80 con 0x558e5c21a2c0 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdd8ff9640 10 client.16281 handle_command_reply: tid=0 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdf9a0e740 1 client.16281 shutdown 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 msgr2=0x558e5c1a3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.015+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcde0099580 tx=0x7fcde0010ce0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 shutdown_connections 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e5c195320 0x558e5c1a3310 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x558e5c21a2c0 0x558e5c21c6b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e5c19fbe0 0x558e5c1a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 --2- 172.21.15.1:0/2792413112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558e5c194a00 0x558e5c1a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 >> 172.21.15.1:0/2792413112 conn(0x558e5c190f90 msgr2=0x558e5c196c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdd8ff9640 0 client.16281 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 shutdown_connections 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 1 -- 172.21.15.1:0/2792413112 wait complete. 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf9a0e740 20 client.16281 trim_cache size 0 max 16384 2024-09-12T02:33:20.021 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24494, 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 8, 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": {} 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:33:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 msgr2=0x7fcddc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 0x7fcddc0a50c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009430 tx=0x7fcde802f330 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 msgr2=0x7fcdf019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcde000d950 tx=0x7fcde000de10 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 shutdown_connections 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fcddc0a2c00 0x7fcddc0a50c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcdf0101440 0x7fcdf019ac70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdf010e500 0x7fcdf019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 --2- 172.21.15.1:0/1108490354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf0100b20 0x7fcdf019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.016+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 >> 172.21.15.1:0/1108490354 conn(0x7fcdf00fc7d0 msgr2=0x7fcdf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.017+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 shutdown_connections 2024-09-12T02:33:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:20.017+0000 7fcdf7635640 1 -- 172.21.15.1:0/1108490354 wait complete. 2024-09-12T02:33:20.026 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:19 smithi001 ceph-mon[31252]: pgmap v414: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 688 KiB/s wr, 14 op/s 2024-09-12T02:33:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:19 smithi134 ceph-mon[35091]: pgmap v414: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 688 KiB/s wr, 14 op/s 2024-09-12T02:33:20.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:19 smithi173 ceph-mon[35036]: pgmap v414: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 688 KiB/s wr, 14 op/s 2024-09-12T02:33:20.938 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T02:33:20.938 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T02:33:20.948 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:33:20.957 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T02:33:20.993 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T02:33:22.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:21 smithi001 ceph-mon[31252]: pgmap v415: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 691 KiB/s wr, 17 op/s 2024-09-12T02:33:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:21 smithi134 ceph-mon[35091]: pgmap v415: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 691 KiB/s wr, 17 op/s 2024-09-12T02:33:22.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:21 smithi173 ceph-mon[35036]: pgmap v415: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 691 KiB/s wr, 17 op/s 2024-09-12T02:33:24.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:23 smithi001 ceph-mon[31252]: pgmap v416: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 689 KiB/s wr, 14 op/s 2024-09-12T02:33:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:23 smithi134 ceph-mon[35091]: pgmap v416: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 689 KiB/s wr, 14 op/s 2024-09-12T02:33:24.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:23 smithi173 ceph-mon[35036]: pgmap v416: 97 pgs: 97 active+clean; 258 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 689 KiB/s wr, 14 op/s 2024-09-12T02:33:26.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:25 smithi001 ceph-mon[31252]: pgmap v417: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-09-12T02:33:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:25 smithi134 ceph-mon[35091]: pgmap v417: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-09-12T02:33:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:25 smithi173 ceph-mon[35036]: pgmap v417: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.0 MiB/s wr, 15 op/s 2024-09-12T02:33:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:27 smithi001 ceph-mon[31252]: pgmap v418: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 19 op/s 2024-09-12T02:33:28.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:27 smithi134 ceph-mon[35091]: pgmap v418: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 19 op/s 2024-09-12T02:33:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:27 smithi173 ceph-mon[35036]: pgmap v418: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 19 op/s 2024-09-12T02:33:30.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:29 smithi001 ceph-mon[31252]: pgmap v419: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-12T02:33:30.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:29 smithi134 ceph-mon[35091]: pgmap v419: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-12T02:33:30.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:29 smithi173 ceph-mon[35036]: pgmap v419: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 16 op/s 2024-09-12T02:33:32.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:31 smithi001 ceph-mon[31252]: pgmap v420: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-12T02:33:32.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:31 smithi134 ceph-mon[35091]: pgmap v420: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-12T02:33:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:31 smithi173 ceph-mon[35036]: pgmap v420: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-12T02:33:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:33 smithi001 ceph-mon[31252]: pgmap v421: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 16 op/s 2024-09-12T02:33:34.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:33 smithi134 ceph-mon[35091]: pgmap v421: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 16 op/s 2024-09-12T02:33:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:33 smithi173 ceph-mon[35036]: pgmap v421: 97 pgs: 97 active+clean; 257 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 16 op/s 2024-09-12T02:33:36.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:35 smithi001 ceph-mon[31252]: pgmap v422: 97 pgs: 97 active+clean; 193 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-12T02:33:36.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:35 smithi134 ceph-mon[35091]: pgmap v422: 97 pgs: 97 active+clean; 193 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-12T02:33:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:35 smithi173 ceph-mon[35036]: pgmap v422: 97 pgs: 97 active+clean; 193 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 21 MiB/s wr, 18 op/s 2024-09-12T02:33:38.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:37 smithi001 ceph-mon[31252]: pgmap v423: 97 pgs: 97 active+clean; 9.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 MiB/s wr, 22 op/s 2024-09-12T02:33:38.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:37 smithi134 ceph-mon[35091]: pgmap v423: 97 pgs: 97 active+clean; 9.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 MiB/s wr, 22 op/s 2024-09-12T02:33:38.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:37 smithi173 ceph-mon[35036]: pgmap v423: 97 pgs: 97 active+clean; 9.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 18 MiB/s wr, 22 op/s 2024-09-12T02:33:40.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:39 smithi001 ceph-mon[31252]: pgmap v424: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.7 MiB/s wr, 17 op/s 2024-09-12T02:33:40.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:39 smithi134 ceph-mon[35091]: pgmap v424: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.7 MiB/s wr, 17 op/s 2024-09-12T02:33:40.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:39 smithi173 ceph-mon[35036]: pgmap v424: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.7 MiB/s wr, 17 op/s 2024-09-12T02:33:42.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:41 smithi001 ceph-mon[31252]: pgmap v425: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-09-12T02:33:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:41 smithi134 ceph-mon[35091]: pgmap v425: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-09-12T02:33:42.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:41 smithi173 ceph-mon[35036]: pgmap v425: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 MiB/s wr, 18 op/s 2024-09-12T02:33:44.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:43 smithi001 ceph-mon[31252]: pgmap v426: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:33:44.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:43 smithi134 ceph-mon[35091]: pgmap v426: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:33:44.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:43 smithi173 ceph-mon[35036]: pgmap v426: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.3 MiB/s wr, 15 op/s 2024-09-12T02:33:45.912 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:33:46.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:45 smithi001 ceph-mon[31252]: pgmap v427: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-12T02:33:46.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:45 smithi134 ceph-mon[35091]: pgmap v427: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-12T02:33:46.186 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:46.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:45 smithi173 ceph-mon[35036]: pgmap v427: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 -- 172.21.15.1:0/1252196725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf810c170 msgr2=0x7f7cf810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/1252196725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf810c170 0x7f7cf810e610 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ca0 tx=0x7f7cf002a950 comp rx=0 tx=0).stop 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 -- 172.21.15.1:0/1252196725 shutdown_connections 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/1252196725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf810c170 0x7f7cf810e610 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/1252196725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 0x7f7cf810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/1252196725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf8102d40 0x7f7cf8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.664+0000 7f7cfcffa640 1 -- 172.21.15.1:0/1252196725 >> 172.21.15.1:0/1252196725 conn(0x7f7cf80fc7a0 msgr2=0x7f7cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.665+0000 7f7cfcffa640 1 -- 172.21.15.1:0/1252196725 shutdown_connections 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.665+0000 7f7cfcffa640 1 -- 172.21.15.1:0/1252196725 wait complete. 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.665+0000 7f7cfcffa640 1 Processor -- start 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.665+0000 7f7cfcffa640 1 -- start start 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 0x7f7cf819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf810c170 0x7f7cf819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8111fb0 con 0x7f7cf8102d40 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8111e30 con 0x7f7cf8103660 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8112130 con 0x7f7cf810c170 2024-09-12T02:33:46.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39698/0 (socket says 172.21.15.1:39698) 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 -- 172.21.15.1:0/2720251708 learned_addr learned my addr 172.21.15.1:0/2720251708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 0x7f7cf819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf810c170 0x7f7cf819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 -- 172.21.15.1:0/2720251708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf810c170 msgr2=0x7f7cf819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf810c170 0x7f7cf819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 -- 172.21.15.1:0/2720251708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 msgr2=0x7f7cf819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 0x7f7cf819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 -- 172.21.15.1:0/2720251708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf819f570 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b4a0 tx=0x7f7ce800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7ce77fe640 1 -- 172.21.15.1:0/2720251708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8014070 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7ce77fe640 1 -- 172.21.15.1:0/2720251708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ce8010af0 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf819f860 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7ce77fe640 1 -- 172.21.15.1:0/2720251708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017d10 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.666+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf81a7140 con 0x7f7cf8102d40 2024-09-12T02:33:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.669+0000 7f7ce77fe640 1 -- 172.21.15.1:0/2720251708 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cf8102d40 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.669+0000 7f7cff3d3740 1 Processor -- start 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.669+0000 7f7cff3d3740 1 -- start start 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b97140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b99a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f34af22e0 con 0x563f34b8c4a0 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563f34a99ce0 con 0x563f34b8cdc0 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563f34aee2a0 con 0x563f34b97680 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39708/0 (socket says 172.21.15.1:39708) 2024-09-12T02:33:46.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 -- 172.21.15.1:0/2413403610 learned_addr learned my addr 172.21.15.1:0/2413403610 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b97140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7ce77fe640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 0x7f7ce00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b99a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 -- 172.21.15.1:0/2413403610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 msgr2=0x563f34b99a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b99a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 -- 172.21.15.1:0/2413403610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 msgr2=0x563f34b97140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b97140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 -- 172.21.15.1:0/2413403610 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f34a7e440 con 0x563f34b8c4a0 2024-09-12T02:33:46.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b99a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7ce77fe640 1 -- 172.21.15.1:0/2720251708 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7ce80ce430 con 0x7f7cf8102d40 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.670+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 0x7f7ce00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.671+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0030040 tx=0x7f7cf002f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dcad626c84efed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.671+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 0x7f7ce00a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7cf004c000 tx=0x7f7cf004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.671+0000 7f7ce4ff9640 1 -- 172.21.15.1:0/2413403610 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0041040 con 0x563f34b8c4a0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.671+0000 7f7ce4ff9640 1 -- 172.21.15.1:0/2413403610 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf0004520 con 0x563f34b8c4a0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.671+0000 7f7ce4ff9640 1 -- 172.21.15.1:0/2413403610 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0034040 con 0x563f34b8c4a0 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2413403610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 msgr2=0x563f34b8c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0030040 tx=0x7f7cf002f9c0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2413403610 shutdown_connections 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b99a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b97140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2413403610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b8c880 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2413403610 >> 172.21.15.1:0/2413403610 conn(0x563f34b88a30 msgr2=0x563f34b88e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2413403610 shutdown_connections 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2413403610 wait complete. 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- start start 2024-09-12T02:33:46.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 Processor -- start 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b94840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563f34b9a250 con 0x563f34b8c4a0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563f34aad050 con 0x563f34b8cdc0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563f34b9a3d0 con 0x563f34b97680 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cff3d3740 10 client.0 _ll_register_callbacks cb 0x563f34aed160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.672+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39720/0 (socket says 172.21.15.1:39720) 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 -- 172.21.15.1:0/2576586631 learned_addr learned my addr 172.21.15.1:0/2576586631 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b94840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 -- 172.21.15.1:0/2576586631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 msgr2=0x563f34b94840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b94840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 -- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 msgr2=0x563f34b942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b942c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 -- 172.21.15.1:0/2576586631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f348633c0 con 0x563f34b8c4a0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800be60 tx=0x7f7ce809a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328f836e8dbe409a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce801e040 con 0x563f34b8c4a0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7ce8010ca0 con 0x563f34b8c4a0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf0004520 con 0x563f34b8c4a0 2024-09-12T02:33:46.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ce809f020 con 0x563f34b8c4a0 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cff3d3740 10 client.16293 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f34ba5c40 con 0x563f34b8c4a0 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.673+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf0004520 con 0x563f34b8c4a0 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ce8010610 con 0x563f34b8c4a0 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 10 client.16293 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 20 client.16293 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34ba7150 0x563f34ba9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 4 client.16293 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f34aff850 con 0x563f34ba7150 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34ba7150 0x563f34ba9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cddffb640 10 client.16293 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.674+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34ba7150 0x563f34ba9560 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3bd3ff50cadc3f server_cookie=ff56d1d2bc7b780b in_seq=0 out_seq=0 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cddffb640 1 -- 172.21.15.1:0/2576586631 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f34aff850 con 0x563f34ba7150 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cddffb640 10 client.16293 handle_command_reply: tid=0 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 client.16293 shutdown 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 msgr2=0x563f34b97010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800be60 tx=0x7f7ce809a5d0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 shutdown_connections 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34ba7150 0x563f34ba9560 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b94840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cddffb640 0 client.16293 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8cdc0 0x563f34b942c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2576586631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b97010 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 >> 172.21.15.1:0/2576586631 conn(0x563f34b88a30 msgr2=0x563f34b8e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 shutdown_connections 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.675+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2576586631 wait complete. 2024-09-12T02:33:46.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.676+0000 7f7cff3d3740 20 client.16293 trim_cache size 0 max 16384 2024-09-12T02:33:46.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.692+0000 7f7cff3d3740 1 Processor -- start 2024-09-12T02:33:46.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 -- start start 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 0x563f34baee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b97680 0x563f34baf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81af7f0 con 0x563f34b8c4a0 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81b1330 con 0x563f34b97680 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81afec0 con 0x563f34b8cdc0 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39734/0 (socket says 172.21.15.1:39734) 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 -- 172.21.15.1:0/4132009730 learned_addr learned my addr 172.21.15.1:0/4132009730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 0x563f34baee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b97680 0x563f34baf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 -- 172.21.15.1:0/4132009730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 msgr2=0x563f34baee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 0x563f34baee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 -- 172.21.15.1:0/4132009730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b97680 msgr2=0x563f34baf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b97680 0x563f34baf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 -- 172.21.15.1:0/4132009730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f34b93270 con 0x563f34b8c4a0 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 0x563f34baee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.693+0000 7f7cf659c640 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80cc280 tx=0x7f7ce800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea687c47b9d045bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cdffff640 1 -- 172.21.15.1:0/4132009730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80d2070 con 0x563f34b8c4a0 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cdffff640 1 -- 172.21.15.1:0/4132009730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ce8009230 con 0x563f34b8c4a0 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cdffff640 1 -- 172.21.15.1:0/4132009730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce801e070 con 0x563f34b8c4a0 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 -- 172.21.15.1:0/4132009730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 msgr2=0x563f34b92b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80cc280 tx=0x7f7ce800bf90 comp rx=0 tx=0).stop 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 -- 172.21.15.1:0/4132009730 shutdown_connections 2024-09-12T02:33:46.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b97680 0x563f34baf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b8cdc0 0x563f34baee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/4132009730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8c4a0 0x563f34b92b90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 -- 172.21.15.1:0/4132009730 >> 172.21.15.1:0/4132009730 conn(0x563f34b88a30 msgr2=0x563f34b96340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 -- 172.21.15.1:0/4132009730 shutdown_connections 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.694+0000 7f7cff3d3740 1 -- 172.21.15.1:0/4132009730 wait complete. 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 -- start start 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 Processor -- start 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 0x563f34b9d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b9e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81b0c60 con 0x563f34b8cdc0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81b0590 con 0x563f34b8c4a0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81ad7d0 con 0x563f34b97680 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cff3d3740 10 client.0 _ll_register_callbacks cb 0x7f7ce8017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39746/0 (socket says 172.21.15.1:39746) 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 -- 172.21.15.1:0/2044111587 learned_addr learned my addr 172.21.15.1:0/2044111587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf6d9d640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b9e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 0x563f34b9d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 -- 172.21.15.1:0/2044111587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 msgr2=0x563f34b9e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b9e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 -- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 msgr2=0x563f34b9d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 0x563f34b9d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf5d9b640 1 -- 172.21.15.1:0/2044111587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f34b8cbf0 con 0x563f34b8cdc0 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.695+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 0x563f34b9d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cf5d9b640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x563f34b89db0 tx=0x7f7cec0138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44da8beabcc6be82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec01d620 con 0x563f34b8cdc0 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7cec01d7c0 con 0x563f34b8cdc0 2024-09-12T02:33:46.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce8009230 con 0x563f34b8cdc0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7cec02d050 con 0x563f34b8cdc0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 10 client.16299 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f34b94bb0 con 0x563f34b8cdc0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ce8009230 con 0x563f34b8cdc0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7cec011440 con 0x563f34b8cdc0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 10 client.16299 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.696+0000 7f7cff3d3740 20 client.16299 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34c127b0 0x563f34c14bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 4 client.16299 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563f34af9d60 con 0x563f34c127b0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34c127b0 0x563f34c14bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:46.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cf659c640 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34c127b0 0x563f34c14bd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23ed464ecdc7c58 server_cookie=b8485ad04b65bbfd in_seq=0 out_seq=0 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cddffb640 10 client.16299 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cddffb640 1 -- 172.21.15.1:0/2044111587 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563f34af9d60 con 0x563f34c127b0 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cddffb640 10 client.16299 handle_command_reply: tid=0 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 1 client.16299 shutdown 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 msgr2=0x563f34b9dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.697+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x563f34b89db0 tx=0x7f7cec0138f0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 shutdown_connections 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563f34b8cdc0 0x563f34b9dba0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x563f34c127b0 0x563f34c14bd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563f34b97680 0x563f34b9e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 --2- 172.21.15.1:0/2044111587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563f34b8c4a0 0x563f34b9d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 >> 172.21.15.1:0/2044111587 conn(0x563f34b88a30 msgr2=0x563f34b96340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cddffb640 0 client.16299 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 shutdown_connections 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 1 -- 172.21.15.1:0/2044111587 wait complete. 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cff3d3740 20 client.16299 trim_cache size 0 max 16384 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-12T02:33:46.707 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-12T02:33:46.708 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:33:46.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 msgr2=0x7f7ce00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 0x7f7ce00a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7cf004c000 tx=0x7f7cf004d000 comp rx=0 tx=0).stop 2024-09-12T02:33:46.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 msgr2=0x7f7cf819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:46.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b4a0 tx=0x7f7ce800b960 comp rx=0 tx=0).stop 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 shutdown_connections 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f7ce00a2b80 0x7f7ce00a5040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cf810c170 0x7f7cf819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cf8103660 0x7f7cf819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 --2- 172.21.15.1:0/2720251708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cf8102d40 0x7f7cf819a660 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 >> 172.21.15.1:0/2720251708 conn(0x7f7cf80fc7a0 msgr2=0x7f7cf810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 shutdown_connections 2024-09-12T02:33:46.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:46.698+0000 7f7cfcffa640 1 -- 172.21.15.1:0/2720251708 wait complete. 2024-09-12T02:33:47.490 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:33:47.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:33:47.752 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:48.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:47 smithi001 ceph-mon[31252]: pgmap v428: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-12T02:33:48.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:47 smithi134 ceph-mon[35091]: pgmap v428: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-12T02:33:48.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:47 smithi173 ceph-mon[35036]: pgmap v428: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 15 op/s 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 -- 172.21.15.1:0/769811269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4106f20 msgr2=0x7fafd410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 --2- 172.21.15.1:0/769811269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4106f20 0x7fafd410eaa0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009ca0 tx=0x7fafcc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 -- 172.21.15.1:0/769811269 shutdown_connections 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 --2- 172.21.15.1:0/769811269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4106f20 0x7fafd410eaa0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 --2- 172.21.15.1:0/769811269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 0x7fafd41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 --2- 172.21.15.1:0/769811269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4101df0 0x7fafd41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 -- 172.21.15.1:0/769811269 >> 172.21.15.1:0/769811269 conn(0x7fafd40fd8b0 msgr2=0x7fafd40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.272+0000 7fafdb65e640 1 -- 172.21.15.1:0/769811269 shutdown_connections 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 -- 172.21.15.1:0/769811269 wait complete. 2024-09-12T02:33:48.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 Processor -- start 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 -- start start 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 0x7fafd4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4106f20 0x7fafd419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4111fc0 con 0x7fafd4101df0 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4111e40 con 0x7fafd41027a0 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafdb65e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4112140 con 0x7fafd4106f20 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.273+0000 7fafd93fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39776/0 (socket says 172.21.15.1:39776) 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 -- 172.21.15.1:0/3024688763 learned_addr learned my addr 172.21.15.1:0/3024688763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd9bfb640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4106f20 0x7fafd419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd8bf9640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 0x7fafd4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:48.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 -- 172.21.15.1:0/3024688763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4106f20 msgr2=0x7fafd419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4106f20 0x7fafd419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 -- 172.21.15.1:0/3024688763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 msgr2=0x7fafd4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 0x7fafd4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 -- 172.21.15.1:0/3024688763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd419d430 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafd93fa640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d770 tx=0x7fafd000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0017070 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafd0005500 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd419d720 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0004e00 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.274+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd41a5000 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.275+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd41021d0 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.276+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fafd0004fa0 con 0x7fafd4101df0 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.277+0000 7fafca7fc640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 0x7fafc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:48.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.277+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fafd00ceae0 con 0x7fafd4101df0 2024-09-12T02:33:48.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.277+0000 7fafd8bf9640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 0x7fafc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:48.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.278+0000 7fafd8bf9640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 0x7fafc00a5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafd41083b0 tx=0x7fafc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:48.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.281+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafd009ba20 con 0x7fafd4101df0 2024-09-12T02:33:48.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.493+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafd410a160 con 0x7fafd4101df0 2024-09-12T02:33:48.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.494+0000 7fafca7fc640 1 -- 172.21.15.1:0/3024688763 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7fafd009b320 con 0x7fafd4101df0 2024-09-12T02:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:48.495 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:33:48.495 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:33:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 msgr2=0x7fafc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 0x7fafc00a5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafd41083b0 tx=0x7fafc4008040 comp rx=0 tx=0).stop 2024-09-12T02:33:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 msgr2=0x7fafd4198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:48.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d770 tx=0x7fafd000dc30 comp rx=0 tx=0).stop 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 shutdown_connections 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fafc00a2b80 0x7fafc00a5040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd4106f20 0x7fafd419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd41027a0 0x7fafd4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 --2- 172.21.15.1:0/3024688763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafd4101df0 0x7fafd4198520 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 >> 172.21.15.1:0/3024688763 conn(0x7fafd40fd8b0 msgr2=0x7fafd40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 shutdown_connections 2024-09-12T02:33:48.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:48.497+0000 7fafdb65e640 1 -- 172.21.15.1:0/3024688763 wait complete. 2024-09-12T02:33:49.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:48 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3024688763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:49.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:48 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3024688763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:49.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:48 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3024688763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:33:49.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T02:33:49.589 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:50.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:49 smithi001 ceph-mon[31252]: pgmap v429: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:33:50.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/1269328277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98101de0 msgr2=0x7f9f981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/1269328277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98101de0 0x7f9f981021c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009900 tx=0x7f9f9402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/1269328277 shutdown_connections 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/1269328277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98106f10 0x7f9f9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/1269328277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98102790 0x7f9f981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/1269328277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98101de0 0x7f9f981021c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/1269328277 >> 172.21.15.1:0/1269328277 conn(0x7f9f980fd8c0 msgr2=0x7f9f980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/1269328277 shutdown_connections 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.091+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/1269328277 wait complete. 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 Processor -- start 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 -- start start 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 0x7f9f98198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98106f10 0x7f9f9819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98111fc0 con 0x7f9f98102790 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98111e40 con 0x7f9f98101de0 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9ebc7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98112140 con 0x7f9f98106f10 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39790/0 (socket says 172.21.15.1:39790) 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 -- 172.21.15.1:0/2486352626 learned_addr learned my addr 172.21.15.1:0/2486352626 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9c963640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 0x7f9f98198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 -- 172.21.15.1:0/2486352626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98106f10 msgr2=0x7f9f9819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98106f10 0x7f9f9819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 -- 172.21.15.1:0/2486352626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 msgr2=0x7f9f98198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 0x7f9f98198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f8ffff640 1 -- 172.21.15.1:0/2486352626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9819d2c0 con 0x7f9f98102790 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.092+0000 7f9f9c963640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 0x7f9f98198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c920 tx=0x7f9f8800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f8dffb640 1 -- 172.21.15.1:0/2486352626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88007c70 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f8dffb640 1 -- 172.21.15.1:0/2486352626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f88007e10 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9819d5b0 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f8dffb640 1 -- 172.21.15.1:0/2486352626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88018890 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.093+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981a4e90 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.095+0000 7f9f8dffb640 1 -- 172.21.15.1:0/2486352626 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9f88018a70 con 0x7f9f98102790 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 Processor -- start 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 -- start start 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 0x55f42e8c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 0x55f42e8d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f42e82b2f0 con 0x55f42e8d0370 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f42e7d2cf0 con 0x55f42e8c6b40 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f42e8272b0 con 0x55f42e8c55d0 2024-09-12T02:33:50.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f8dffb640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 0x7f9f800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 0x55f42e8d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f9d164640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 0x7f9f800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f8ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 0x55f42e8d2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39800/0 (socket says 172.21.15.1:39800) 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f8ffff640 1 -- 172.21.15.1:0/1191022909 learned_addr learned my addr 172.21.15.1:0/1191022909 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 0x55f42e8c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f9d164640 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.096+0000 7f9f8dffb640 1 -- 172.21.15.1:0/2486352626 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9f880cf2c0 con 0x7f9f98102790 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 -- 172.21.15.1:0/1191022909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 msgr2=0x55f42e8c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 -- 172.21.15.1:0/1191022909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 msgr2=0x55f42e8d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 0x55f42e8d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 -- 172.21.15.1:0/1191022909 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42e7b73a0 con 0x55f42e8c55d0 2024-09-12T02:33:50.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9d164640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 0x7f9f800a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f900139b0 tx=0x7f9f90009b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 0x55f42e8c5a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a9e0 tx=0x7f9f94004200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bef377fbc8e525f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f7effd640 1 -- 172.21.15.1:0/1191022909 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9403f070 con 0x55f42e8c55d0 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f7effd640 1 -- 172.21.15.1:0/1191022909 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f94005500 con 0x55f42e8c55d0 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.097+0000 7f9f7effd640 1 -- 172.21.15.1:0/1191022909 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94035070 con 0x55f42e8c55d0 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1191022909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 msgr2=0x55f42e8c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 0x55f42e8c5a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a9e0 tx=0x7f9f94004200 comp rx=0 tx=0).stop 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1191022909 shutdown_connections 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8d0370 0x55f42e8d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c55d0 0x55f42e8c5a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1191022909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1191022909 >> 172.21.15.1:0/1191022909 conn(0x55f42e88e310 msgr2=0x55f42e8c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1191022909 shutdown_connections 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1191022909 wait complete. 2024-09-12T02:33:50.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 -- start start 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.098+0000 7f9fa0fa0740 1 Processor -- start 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f42e8d3010 con 0x55f42e8c55d0 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f42e7e6060 con 0x55f42e8d0370 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f42e8d3190 con 0x55f42e8c6b40 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9fa0fa0740 10 client.0 _ll_register_callbacks cb 0x55f42e5398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39812/0 (socket says 172.21.15.1:39812) 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 -- 172.21.15.1:0/1840395515 learned_addr learned my addr 172.21.15.1:0/1840395515 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9d164640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 -- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 msgr2=0x55f42e8cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 -- 172.21.15.1:0/1840395515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 msgr2=0x55f42e8cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f9c963640 1 -- 172.21.15.1:0/1840395515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42e59c3c0 con 0x55f42e8c55d0 2024-09-12T02:33:50.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.099+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.100+0000 7f9f9c963640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f94004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32ba6e62109bc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.100+0000 7f9f77fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.100+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9404c060 con 0x55f42e8c55d0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.100+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9f94005280 con 0x55f42e8c55d0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.100+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f94005500 con 0x55f42e8c55d0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f9403f070 con 0x55f42e8c55d0 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 10 client.16317 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:50.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f42e8dea90 con 0x55f42e8c55d0 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f94005500 con 0x55f42e8c55d0 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f94003a00 con 0x55f42e8c55d0 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 10 client.16317 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 10 client.16317 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 20 client.16317 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e8dfde0 0x55f42e8e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 4 client.16317 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.101+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f42e838860 con 0x55f42e8dfde0 2024-09-12T02:33:50.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.102+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e8dfde0 0x55f42e8e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.102+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e8dfde0 0x55f42e8e21d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5abc41ae9008ab9c server_cookie=bfed57c16e86347e in_seq=0 out_seq=0 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.102+0000 7f9f77fff640 10 client.16317 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9f77fff640 1 -- 172.21.15.1:0/1840395515 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f42e838860 con 0x55f42e8dfde0 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9f77fff640 10 client.16317 handle_command_reply: tid=0 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 client.16317 shutdown 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 msgr2=0x55f42e8cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f94004c10 comp rx=0 tx=0).stop 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 shutdown_connections 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e8dfde0 0x55f42e8e21d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/1840395515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cfd50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9f77fff640 0 client.16317 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 >> 172.21.15.1:0/1840395515 conn(0x55f42e88e310 msgr2=0x55f42e8c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 shutdown_connections 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/1840395515 wait complete. 2024-09-12T02:33:50.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.103+0000 7f9fa0fa0740 20 client.16317 trim_cache size 0 max 16384 2024-09-12T02:33:50.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 Processor -- start 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 -- start start 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ad480 con 0x55f42e8c55d0 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981aefc0 con 0x55f42e8d0370 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.116+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981adb50 con 0x55f42e8c6b40 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39816/0 (socket says 172.21.15.1:39816) 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 -- 172.21.15.1:0/867087010 learned_addr learned my addr 172.21.15.1:0/867087010 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:50.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9d164640 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 -- 172.21.15.1:0/867087010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 msgr2=0x55f42e8cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 -- 172.21.15.1:0/867087010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 msgr2=0x55f42e8cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 -- 172.21.15.1:0/867087010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42e8c2960 con 0x55f42e8c55d0 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f9c963640 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a910 tx=0x7f9f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7028527d0e1108a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f7e7fc640 1 -- 172.21.15.1:0/867087010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9404c040 con 0x55f42e8c55d0 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f7e7fc640 1 -- 172.21.15.1:0/867087010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f94003ad0 con 0x55f42e8c55d0 2024-09-12T02:33:50.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.117+0000 7f9f7e7fc640 1 -- 172.21.15.1:0/867087010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94035040 con 0x55f42e8c55d0 2024-09-12T02:33:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/867087010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 msgr2=0x55f42e8cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a910 tx=0x7f9f940046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/867087010 shutdown_connections 2024-09-12T02:33:50.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8d0370 0x55f42e8cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8c6b40 0x55f42e8cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/867087010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8cc8c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/867087010 >> 172.21.15.1:0/867087010 conn(0x55f42e88e310 msgr2=0x55f42e8ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/867087010 shutdown_connections 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/867087010 wait complete. 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 -- start start 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.118+0000 7f9fa0fa0740 1 Processor -- start 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8e2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8d0370 0x55f42e8e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ae8f0 con 0x55f42e8c55d0 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ae220 con 0x55f42e8c6b40 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ab460 con 0x55f42e8d0370 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9fa0fa0740 10 client.0 _ll_register_callbacks cb 0x7f9f8800fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39832/0 (socket says 172.21.15.1:39832) 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 -- 172.21.15.1:0/2112487158 learned_addr learned my addr 172.21.15.1:0/2112487158 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8e2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9d164640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8d0370 0x55f42e8e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 -- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8d0370 msgr2=0x55f42e8e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8d0370 0x55f42e8e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 -- 172.21.15.1:0/2112487158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 msgr2=0x55f42e8e2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8e2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 -- 172.21.15.1:0/2112487158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42e8e3480 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f9c963640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005360 tx=0x7f9f94005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fe25295c7c094b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.119+0000 7f9f77fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9405f060 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f9f94031910 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f94003ad0 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f9404c030 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 10 client.16323 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f42e94a430 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f94003ad0 con 0x55f42e8c55d0 2024-09-12T02:33:50.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f9403b5d0 con 0x55f42e8c55d0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 10 client.16323 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 10 client.16323 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 20 client.16323 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e94a9e0 0x55f42e94ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 4 client.16323 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 --> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f42e832d70 con 0x55f42e94a9e0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.120+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e94a9e0 0x55f42e94ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9f8ffff640 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e94a9e0 0x55f42e94ce00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f71298b5ef9bce9 server_cookie=65c02bdec004d19 in_seq=0 out_seq=0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9f77fff640 10 client.16323 ms_handle_connect on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9f77fff640 1 -- 172.21.15.1:0/2112487158 <== mds.4 v2:172.21.15.173:6834/7391882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f42e832d70 con 0x55f42e94a9e0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9f77fff640 10 client.16323 handle_command_reply: tid=0 2024-09-12T02:33:50.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 client.16323 shutdown 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 msgr2=0x55f42e8e5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005360 tx=0x7f9f94005390 comp rx=0 tx=0).stop 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 shutdown_connections 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:6834/7391882,v1:172.21.15.173:6835/7391882] conn(0x55f42e94a9e0 0x55f42e94ce00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f42e8d0370 0x55f42e8e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f42e8c6b40 0x55f42e8e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 --2- 172.21.15.1:0/2112487158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f42e8c55d0 0x55f42e8e5660 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9f77fff640 0 client.16323 ms_handle_reset on v2:172.21.15.173:6834/7391882 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 >> 172.21.15.1:0/2112487158 conn(0x55f42e88e310 msgr2=0x55f42e8cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 shutdown_connections 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.121+0000 7f9fa0fa0740 1 -- 172.21.15.1:0/2112487158 wait complete. 2024-09-12T02:33:50.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9fa0fa0740 20 client.16323 trim_cache size 0 max 16384 2024-09-12T02:33:50.129 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:50.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 msgr2=0x7f9f800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 0x7f9f800a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f900139b0 tx=0x7f9f90009b60 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 msgr2=0x7f9f98198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c920 tx=0x7f9f8800cde0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 shutdown_connections 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f9f800a2b80 0x7f9f800a5040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f98102790 0x7f9f98198850 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f98106f10 0x7f9f9819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 --2- 172.21.15.1:0/2486352626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f98101de0 0x7f9f98198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 >> 172.21.15.1:0/2486352626 conn(0x7f9f980fd8c0 msgr2=0x7f9f980ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 shutdown_connections 2024-09-12T02:33:50.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:50.122+0000 7f9f9ebc7640 1 -- 172.21.15.1:0/2486352626 wait complete. 2024-09-12T02:33:50.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:49 smithi134 ceph-mon[35091]: pgmap v429: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:33:50.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:49 smithi173 ceph-mon[35036]: pgmap v429: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:33:51.134 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T02:33:51.398 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.886+0000 7fb0643c0640 1 -- 172.21.15.1:0/572556586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c10c170 msgr2=0x7fb05c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.886+0000 7fb0643c0640 1 --2- 172.21.15.1:0/572556586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c10c170 0x7fb05c10e610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb054009ca0 tx=0x7fb05402a950 comp rx=0 tx=0).stop 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- 172.21.15.1:0/572556586 shutdown_connections 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- 172.21.15.1:0/572556586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c10c170 0x7fb05c10e610 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- 172.21.15.1:0/572556586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c103660 0x7fb05c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- 172.21.15.1:0/572556586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c102d40 0x7fb05c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- 172.21.15.1:0/572556586 >> 172.21.15.1:0/572556586 conn(0x7fb05c0fc7a0 msgr2=0x7fb05c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- 172.21.15.1:0/572556586 shutdown_connections 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- 172.21.15.1:0/572556586 wait complete. 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 Processor -- start 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- start start 2024-09-12T02:33:51.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c103660 0x7fb05c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c10c170 0x7fb05c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c111f30 con 0x7fb05c102d40 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c111db0 con 0x7fb05c103660 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.887+0000 7fb0643c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1120b0 con 0x7fb05c10c170 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45842/0 (socket says 172.21.15.1:45842) 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 -- 172.21.15.1:0/1849824470 learned_addr learned my addr 172.21.15.1:0/1849824470 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06295d640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c10c170 0x7fb05c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06195b640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c103660 0x7fb05c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 -- 172.21.15.1:0/1849824470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c10c170 msgr2=0x7fb05c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c10c170 0x7fb05c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 -- 172.21.15.1:0/1849824470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c103660 msgr2=0x7fb05c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c103660 0x7fb05c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 -- 172.21.15.1:0/1849824470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c1a6900 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb06215c640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb05800d950 tx=0x7fb05800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb0537fe640 1 -- 172.21.15.1:0/1849824470 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058017070 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb0537fe640 1 -- 172.21.15.1:0/1849824470 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb058009c30 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c1a6bf0 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb0537fe640 1 -- 172.21.15.1:0/1849824470 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05800f6b0 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.888+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05c1a7180 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb0537fe640 1 -- 172.21.15.1:0/1849824470 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb0580109d0 con 0x7fb05c102d40 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb066799740 1 Processor -- start 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb066799740 1 -- start start 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb066799740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed373b40 0x5648ed372090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb066799740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.891+0000 7fb066799740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed37f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb066799740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5648ed2d82f0 con 0x5648ed3725d0 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb066799740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648ed27fcf0 con 0x5648ed373b40 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb066799740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5648ed2d42b0 con 0x5648ed37d370 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06295d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed373b40 0x5648ed372090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45844/0 (socket says 172.21.15.1:45844) 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 -- 172.21.15.1:0/3495004744 learned_addr learned my addr 172.21.15.1:0/3495004744 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06195b640 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed37f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb0537fe640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 0x7fb0480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 -- 172.21.15.1:0/3495004744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 msgr2=0x5648ed37f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed37f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 -- 172.21.15.1:0/3495004744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed373b40 msgr2=0x5648ed372090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed373b40 0x5648ed372090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 -- 172.21.15.1:0/3495004744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ed2643a0 con 0x5648ed3725d0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06295d640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 0x7fb0480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb06215c640 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0580a78f0 tx=0x7fb0580af640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcad227da2d969a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.892+0000 7fb0537fe640 1 -- 172.21.15.1:0/1849824470 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb0580ced00 con 0x7fb05c102d40 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb050dea640 1 -- 172.21.15.1:0/3495004744 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058020070 con 0x5648ed3725d0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb050dea640 1 -- 172.21.15.1:0/3495004744 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb05809bbe0 con 0x5648ed3725d0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb050dea640 1 -- 172.21.15.1:0/3495004744 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05809b020 con 0x5648ed3725d0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 -- 172.21.15.1:0/3495004744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 msgr2=0x5648ed372a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb0580a78f0 tx=0x7fb0580af640 comp rx=0 tx=0).stop 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb06295d640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 0x7fb0480a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb054004af0 tx=0x7fb0540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 -- 172.21.15.1:0/3495004744 shutdown_connections 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed3725d0 0x5648ed372a10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed37f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 --2- 172.21.15.1:0/3495004744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed373b40 0x5648ed372090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 -- 172.21.15.1:0/3495004744 >> 172.21.15.1:0/3495004744 conn(0x5648ed33b310 msgr2=0x5648ed36ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.893+0000 7fb066799740 1 -- 172.21.15.1:0/3495004744 shutdown_connections 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 -- 172.21.15.1:0/3495004744 wait complete. 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 -- start start 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 Processor -- start 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed37cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed373b40 0x5648ed37a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5648ed380010 con 0x5648ed37d370 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648ed293060 con 0x5648ed3725d0 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5648ed380190 con 0x5648ed373b40 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb066799740 10 client.0 _ll_register_callbacks cb 0x5648ecfe68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:51.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb06295d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb06295d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45860/0 (socket says 172.21.15.1:45860) 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb06295d640 1 -- 172.21.15.1:0/1299236200 learned_addr learned my addr 172.21.15.1:0/1299236200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb06195b640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed373b40 0x5648ed37a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.894+0000 7fb06215c640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed37cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 -- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed373b40 msgr2=0x5648ed37a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed373b40 0x5648ed37a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 -- 172.21.15.1:0/1299236200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 msgr2=0x5648ed37cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed37cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 -- 172.21.15.1:0/1299236200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ed0493c0 con 0x5648ed37d370 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb06295d640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb054035000 tx=0x7fb05402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60e4ed6927de926 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:51.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054034040 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb054003b70 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb05809bbe0 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb054056070 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb066799740 10 client.16335 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.895+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648ed38bb60 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb05809bbe0 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb054004490 con 0x5648ed37d370 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 10 client.16335 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 10 client.16335 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 20 client.16335 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed38d070 0x5648ed38f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 4 client.16335 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648ed2e5860 con 0x5648ed38d070 2024-09-12T02:33:51.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb06215c640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed38d070 0x5648ed38f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb045ffb640 10 client.16335 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.896+0000 7fb06215c640 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed38d070 0x5648ed38f4b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5bee4e3b04ec32f3 server_cookie=2f652eb47a269197 in_seq=0 out_seq=0 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb045ffb640 1 -- 172.21.15.1:0/1299236200 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648ed2e5860 con 0x5648ed38d070 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb045ffb640 10 client.16335 handle_command_reply: tid=0 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 client.16335 shutdown 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 msgr2=0x5648ed37a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb054035000 tx=0x7fb05402a950 comp rx=0 tx=0).stop 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 shutdown_connections 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed38d070 0x5648ed38f4b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed37d370 0x5648ed37a650 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb045ffb640 0 client.16335 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed373b40 0x5648ed37a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 --2- 172.21.15.1:0/1299236200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed37cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 >> 172.21.15.1:0/1299236200 conn(0x5648ed33b310 msgr2=0x5648ed374930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.897+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 shutdown_connections 2024-09-12T02:33:51.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.898+0000 7fb066799740 1 -- 172.21.15.1:0/1299236200 wait complete. 2024-09-12T02:33:51.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.898+0000 7fb066799740 20 client.16335 trim_cache size 0 max 16384 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 Processor -- start 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 -- start start 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed36ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed379900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1af840 con 0x5648ed373b40 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1b1380 con 0x5648ed3725d0 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb066799740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1aff10 con 0x5648ed37d370 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.911+0000 7fb06195b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45876/0 (socket says 172.21.15.1:45876) 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 -- 172.21.15.1:0/2045257871 learned_addr learned my addr 172.21.15.1:0/2045257871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06295d640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed379900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06215c640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed36ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 -- 172.21.15.1:0/2045257871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 msgr2=0x5648ed379900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed379900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 -- 172.21.15.1:0/2045257871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 msgr2=0x5648ed36ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed36ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 -- 172.21.15.1:0/2045257871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ed378ff0 con 0x5648ed373b40 2024-09-12T02:33:51.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06295d640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed379900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06215c640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed36ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb06195b640 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb05c102430 tx=0x7fb04c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d46c7f6312d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb047fff640 1 -- 172.21.15.1:0/2045257871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00be10 con 0x5648ed373b40 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb047fff640 1 -- 172.21.15.1:0/2045257871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c0035f0 con 0x5648ed373b40 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.912+0000 7fb047fff640 1 -- 172.21.15.1:0/2045257871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0106e0 con 0x5648ed373b40 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- 172.21.15.1:0/2045257871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 msgr2=0x5648ed3892e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb05c102430 tx=0x7fb04c012820 comp rx=0 tx=0).stop 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- 172.21.15.1:0/2045257871 shutdown_connections 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed3892e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed37d370 0x5648ed379900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 --2- 172.21.15.1:0/2045257871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed3725d0 0x5648ed36ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- 172.21.15.1:0/2045257871 >> 172.21.15.1:0/2045257871 conn(0x5648ed33b310 msgr2=0x5648ed36e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- 172.21.15.1:0/2045257871 shutdown_connections 2024-09-12T02:33:51.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- 172.21.15.1:0/2045257871 wait complete. 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.913+0000 7fb066799740 1 -- start start 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 Processor -- start 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed3725d0 0x5648ed385a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed37d370 0x5648ed377180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1b0cb0 con 0x5648ed373b40 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1b05e0 con 0x5648ed37d370 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c1ad820 con 0x5648ed3725d0 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb066799740 10 client.0 _ll_register_callbacks cb 0x7fb054005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45882/0 (socket says 172.21.15.1:45882) 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 -- 172.21.15.1:0/2169835077 learned_addr learned my addr 172.21.15.1:0/2169835077 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06295d640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed37d370 0x5648ed377180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06215c640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed3725d0 0x5648ed385a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 -- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed3725d0 msgr2=0x5648ed385a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed3725d0 0x5648ed385a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 -- 172.21.15.1:0/2169835077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed37d370 msgr2=0x5648ed377180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed37d370 0x5648ed377180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.914+0000 7fb06195b640 1 -- 172.21.15.1:0/2169835077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ed377820 con 0x5648ed373b40 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb06195b640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb04c003ee0 tx=0x7fb04c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8189bc946d528f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c021040 con 0x5648ed373b40 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb04c018070 con 0x5648ed373b40 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c0035f0 con 0x5648ed373b40 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb04c0037a0 con 0x5648ed373b40 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 10 client.16341 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:51.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648ed3f7b70 con 0x5648ed373b40 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c0035f0 con 0x5648ed373b40 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb04c024070 con 0x5648ed373b40 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 10 client.16341 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 10 client.16341 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 20 client.16341 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed3f8240 0x5648ed3fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 4 client.16341 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.915+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 --> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648ed2dfd70 con 0x5648ed3f8240 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb06215c640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed3f8240 0x5648ed3fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb06215c640 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed3f8240 0x5648ed3fa660 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1ca2f33a29919d70 server_cookie=ca0e632644e87abb in_seq=0 out_seq=0 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb045ffb640 10 client.16341 ms_handle_connect on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb045ffb640 1 -- 172.21.15.1:0/2169835077 <== mds.3 v2:172.21.15.173:6836/2489188498 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648ed2dfd70 con 0x5648ed3f8240 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb045ffb640 10 client.16341 handle_command_reply: tid=0 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 client.16341 shutdown 2024-09-12T02:33:51.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 msgr2=0x5648ed376c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb04c003ee0 tx=0x7fb04c003f10 comp rx=0 tx=0).stop 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 shutdown_connections 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:6836/2489188498,v1:172.21.15.173:6837/2489188498] conn(0x5648ed3f8240 0x5648ed3fa660 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5648ed373b40 0x5648ed376c40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648ed37d370 0x5648ed377180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 --2- 172.21.15.1:0/2169835077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648ed3725d0 0x5648ed385a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.916+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 >> 172.21.15.1:0/2169835077 conn(0x5648ed33b310 msgr2=0x5648ed36e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb045ffb640 0 client.16341 ms_handle_reset on v2:172.21.15.173:6836/2489188498 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 shutdown_connections 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb066799740 1 -- 172.21.15.1:0/2169835077 wait complete. 2024-09-12T02:33:51.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb066799740 20 client.16341 trim_cache size 0 max 16384 2024-09-12T02:33:51.932 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 msgr2=0x7fb0480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 0x7fb0480a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb054004af0 tx=0x7fb0540095c0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 msgr2=0x7fb05c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb05800d950 tx=0x7fb05800de10 comp rx=0 tx=0).stop 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 shutdown_connections 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb0480a2c00 0x7fb0480a50c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb05c10c170 0x7fb05c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05c103660 0x7fb05c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 --2- 172.21.15.1:0/1849824470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb05c102d40 0x7fb05c1009a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 >> 172.21.15.1:0/1849824470 conn(0x7fb05c0fc7a0 msgr2=0x7fb05c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 shutdown_connections 2024-09-12T02:33:51.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:51.917+0000 7fb0643c0640 1 -- 172.21.15.1:0/1849824470 wait complete. 2024-09-12T02:33:52.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:51 smithi001 ceph-mon[31252]: pgmap v430: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-12T02:33:52.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:51 smithi134 ceph-mon[35091]: pgmap v430: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-12T02:33:52.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:51 smithi173 ceph-mon[35036]: pgmap v430: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-12T02:33:52.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:33:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:53.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 -- 172.21.15.1:0/1889031935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc10c2f0 msgr2=0x7ff5bc10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 --2- 172.21.15.1:0/1889031935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc10e790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009ca0 tx=0x7ff5b402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 -- 172.21.15.1:0/1889031935 shutdown_connections 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 --2- 172.21.15.1:0/1889031935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc10e790 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 --2- 172.21.15.1:0/1889031935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc1037a0 0x7ff5bc10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 --2- 172.21.15.1:0/1889031935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc102df0 0x7ff5bc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 -- 172.21.15.1:0/1889031935 >> 172.21.15.1:0/1889031935 conn(0x7ff5bc0fc7d0 msgr2=0x7ff5bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 -- 172.21.15.1:0/1889031935 shutdown_connections 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.369+0000 7ff5c1220640 1 -- 172.21.15.1:0/1889031935 wait complete. 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.370+0000 7ff5c1220640 1 Processor -- start 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.370+0000 7ff5c1220640 1 -- start start 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc1037a0 0x7ff5bc100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc112190 con 0x7ff5bc102df0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc112010 con 0x7ff5bc1037a0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc112310 con 0x7ff5bc10c2f0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45904/0 (socket says 172.21.15.1:45904) 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 -- 172.21.15.1:0/700785855 learned_addr learned my addr 172.21.15.1:0/700785855 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc1037a0 0x7ff5bc100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 -- 172.21.15.1:0/700785855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 msgr2=0x7ff5bc1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 -- 172.21.15.1:0/700785855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc1037a0 msgr2=0x7ff5bc100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc1037a0 0x7ff5bc100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 -- 172.21.15.1:0/700785855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc1a6b00 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00b4a0 tx=0x7ff5ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5a3fff640 1 -- 172.21.15.1:0/700785855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac014070 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5a3fff640 1 -- 172.21.15.1:0/700785855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ac010af0 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc1a6df0 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.371+0000 7ff5a3fff640 1 -- 172.21.15.1:0/700785855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac017d10 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.372+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc1a72a0 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5a3fff640 1 -- 172.21.15.1:0/700785855 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff5ac017070 con 0x7ff5bc102df0 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 Processor -- start 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 -- start start 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e287715d0 0x559e28771a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e2877e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559e286d72f0 con 0x559e28772b40 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559e2867ecf0 con 0x559e2877c370 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559e286d32b0 con 0x559e287715d0 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5bb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5bb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45908/0 (socket says 172.21.15.1:45908) 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.374+0000 7ff5bb59e640 1 -- 172.21.15.1:0/1173009330 learned_addr learned my addr 172.21.15.1:0/1173009330 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e287715d0 0x559e28771a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e2877e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 -- 172.21.15.1:0/1173009330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e287715d0 msgr2=0x559e28771a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e287715d0 0x559e28771a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5a3fff640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 0x7ff5a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 -- 172.21.15.1:0/1173009330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 msgr2=0x559e2877e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e2877e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 -- 172.21.15.1:0/1173009330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e286633a0 con 0x559e28772b40 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5a3fff640 1 -- 172.21.15.1:0/700785855 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff5ac0ce470 con 0x7ff5bc102df0 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40098b0 tx=0x7ff5b40098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ab63381554aac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 0x7ff5a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5a17fa640 1 -- 172.21.15.1:0/1173009330 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4049040 con 0x559e28772b40 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5a17fa640 1 -- 172.21.15.1:0/1173009330 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b4036070 con 0x559e28772b40 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.375+0000 7ff5a17fa640 1 -- 172.21.15.1:0/1173009330 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b402f610 con 0x559e28772b40 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1173009330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 msgr2=0x559e28771090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 0x7ff5a40a5040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4044000 tx=0x7ff5b402fd80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40098b0 tx=0x7ff5b40098e0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1173009330 shutdown_connections 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e2877e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e287715d0 0x559e28771a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1173009330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e28772b40 0x559e28771090 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1173009330 >> 172.21.15.1:0/1173009330 conn(0x559e2873a310 msgr2=0x559e2876dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1173009330 shutdown_connections 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1173009330 wait complete. 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.376+0000 7ff5c35f9740 1 -- start start 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 Processor -- start 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28778f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28779490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559e2877f010 con 0x559e287715d0 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559e28692060 con 0x559e2877c370 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559e2877f190 con 0x559e28772b40 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5c35f9740 10 client.0 _ll_register_callbacks cb 0x559e283e58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45910/0 (socket says 172.21.15.1:45910) 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 -- 172.21.15.1:0/855450598 learned_addr learned my addr 172.21.15.1:0/855450598 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28779490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28778f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 -- 172.21.15.1:0/855450598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 msgr2=0x559e28778f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28778f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 -- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 msgr2=0x559e28779490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28779490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 -- 172.21.15.1:0/855450598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e284483c0 con 0x559e287715d0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00be60 tx=0x7ff5ac09ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937b2d7aa9e337bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.377+0000 7ff59eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac01e050 con 0x559e287715d0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff5ac010ca0 con 0x559e287715d0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5b4036070 con 0x559e287715d0 2024-09-12T02:33:53.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac09acb0 con 0x559e287715d0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 10 client.16353 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e2878aa60 con 0x559e287715d0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b4036070 con 0x559e287715d0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff5ac0ce0d0 con 0x559e287715d0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 10 client.16353 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 10 client.16353 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 20 client.16353 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e2878be70 0x559e2878e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 4 client.16353 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.378+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e286e4860 con 0x559e2878be70 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.379+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e2878be70 0x559e2878e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.379+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e2878be70 0x559e2878e2e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60d44abd1f9dfd33 server_cookie=9518865b25d9cbc8 in_seq=0 out_seq=0 2024-09-12T02:33:53.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.379+0000 7ff59eff5640 10 client.16353 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff59eff5640 1 -- 172.21.15.1:0/855450598 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e286e4860 con 0x559e2878be70 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff59eff5640 10 client.16353 handle_command_reply: tid=0 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 client.16353 shutdown 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 msgr2=0x559e2877bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00be60 tx=0x7ff5ac09ab80 comp rx=0 tx=0).stop 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 shutdown_connections 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e2878be70 0x559e2878e2e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28779490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28778f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/855450598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e2877bca0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 >> 172.21.15.1:0/855450598 conn(0x559e2873a310 msgr2=0x559e28773930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff59eff5640 0 client.16353 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 shutdown_connections 2024-09-12T02:33:53.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 1 -- 172.21.15.1:0/855450598 wait complete. 2024-09-12T02:33:53.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.380+0000 7ff5c35f9740 20 client.16353 trim_cache size 0 max 16384 2024-09-12T02:33:53.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 Processor -- start 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 -- start start 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e2876cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28793bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1af970 con 0x559e287715d0 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b14b0 con 0x559e2877c370 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b0040 con 0x559e28772b40 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.393+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45926/0 (socket says 172.21.15.1:45926) 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 -- 172.21.15.1:0/2507553580 learned_addr learned my addr 172.21.15.1:0/2507553580 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e2876cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 -- 172.21.15.1:0/2507553580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 msgr2=0x559e2876cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28793bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e2876cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 -- 172.21.15.1:0/2507553580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 msgr2=0x559e28793bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28793bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 -- 172.21.15.1:0/2507553580 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e28771be0 con 0x559e287715d0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e2876cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac097110 tx=0x7ff5ac0991c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a53973702b17da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2507553580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac01e070 con 0x559e287715d0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2507553580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ac0a3920 con 0x559e287715d0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.394+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2507553580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac09a1d0 con 0x559e287715d0 2024-09-12T02:33:53.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- 172.21.15.1:0/2507553580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 msgr2=0x559e28788310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac097110 tx=0x7ff5ac0991c0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- 172.21.15.1:0/2507553580 shutdown_connections 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28793bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e2876cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/2507553580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28788310 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- 172.21.15.1:0/2507553580 >> 172.21.15.1:0/2507553580 conn(0x559e2873a310 msgr2=0x559e2876c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- 172.21.15.1:0/2507553580 shutdown_connections 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- 172.21.15.1:0/2507553580 wait complete. 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 -- start start 2024-09-12T02:33:53.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 Processor -- start 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.395+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28776510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28776a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b0de0 con 0x559e287715d0 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b0710 con 0x559e2877c370 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ad950 con 0x559e28772b40 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 10 client.0 _ll_register_callbacks cb 0x7ff5ac0d1a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45928/0 (socket says 172.21.15.1:45928) 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 -- 172.21.15.1:0/1486845633 learned_addr learned my addr 172.21.15.1:0/1486845633 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28776a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28776510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 -- 172.21.15.1:0/1486845633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 msgr2=0x559e28776510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28776510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 -- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 msgr2=0x559e28776a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28776a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 -- 172.21.15.1:0/1486845633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e287f5c00 con 0x559e287715d0 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bb59e640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5bad9d640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac097680 tx=0x7ff5ac0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f49cb770e89042 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff59eff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b8060 con 0x559e287715d0 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff5ac097320 con 0x559e287715d0 2024-09-12T02:33:53.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ac0a3920 con 0x559e287715d0 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac01e070 con 0x559e287715d0 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 10 client.16359 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.396+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e287f6ee0 con 0x559e287715d0 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ac0a3920 con 0x559e287715d0 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff5ac096a90 con 0x559e287715d0 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 10 client.16359 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 10 client.16359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 20 client.16359 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e287f72c0 0x559e287f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 4 client.16359 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:53.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 --> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e286ded70 con 0x559e287f72c0 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.397+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e287f72c0 0x559e287f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5ba59c640 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e287f72c0 0x559e287f96b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e3ab0a6855d06c2 server_cookie=20073a02f4c6b05f in_seq=0 out_seq=0 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff59eff5640 10 client.16359 ms_handle_connect on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff59eff5640 1 -- 172.21.15.1:0/1486845633 <== mds.2 v2:172.21.15.134:6836/2931886461 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e286ded70 con 0x559e287f72c0 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff59eff5640 10 client.16359 handle_command_reply: tid=0 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 client.16359 shutdown 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 msgr2=0x559e28775fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac097680 tx=0x7ff5ac0047d0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 shutdown_connections 2024-09-12T02:33:53.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:6836/2931886461,v1:172.21.15.134:6837/2931886461] conn(0x559e287f72c0 0x559e287f96b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e2877c370 0x559e28776a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e28772b40 0x559e28776510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 --2- 172.21.15.1:0/1486845633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559e287715d0 0x559e28775fd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 >> 172.21.15.1:0/1486845633 conn(0x559e2873a310 msgr2=0x559e2877a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff59eff5640 0 client.16359 ms_handle_reset on v2:172.21.15.134:6836/2931886461 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 shutdown_connections 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 1 -- 172.21.15.1:0/1486845633 wait complete. 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.398+0000 7ff5c35f9740 20 client.16359 trim_cache size 0 max 16384 2024-09-12T02:33:53.408 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 msgr2=0x7ff5a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 0x7ff5a40a5040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4044000 tx=0x7ff5b402fd80 comp rx=0 tx=0).stop 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 msgr2=0x7ff5bc100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00b4a0 tx=0x7ff5ac00b960 comp rx=0 tx=0).stop 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 shutdown_connections 2024-09-12T02:33:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff5a40a2b80 0x7ff5a40a5040 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5bc10c2f0 0x7ff5bc1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5bc1037a0 0x7ff5bc100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 --2- 172.21.15.1:0/700785855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5bc102df0 0x7ff5bc100a50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 >> 172.21.15.1:0/700785855 conn(0x7ff5bc0fc7d0 msgr2=0x7ff5bc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 shutdown_connections 2024-09-12T02:33:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:53.399+0000 7ff5c1220640 1 -- 172.21.15.1:0/700785855 wait complete. 2024-09-12T02:33:54.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:53 smithi001 ceph-mon[31252]: pgmap v431: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:33:54.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:53 smithi134 ceph-mon[35091]: pgmap v431: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:33:54.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:53 smithi173 ceph-mon[35036]: pgmap v431: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:33:54.206 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:33:54.464 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:54.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 -- 172.21.15.1:0/2512104279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 msgr2=0x7f22f810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 --2- 172.21.15.1:0/2512104279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f810da40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009ca0 tx=0x7f22f002a950 comp rx=0 tx=0).stop 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 -- 172.21.15.1:0/2512104279 shutdown_connections 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 --2- 172.21.15.1:0/2512104279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f810da40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 --2- 172.21.15.1:0/2512104279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8102570 0x7f22f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 --2- 172.21.15.1:0/2512104279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8100e20 0x7f22f8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 -- 172.21.15.1:0/2512104279 >> 172.21.15.1:0/2512104279 conn(0x7f22f80fc7d0 msgr2=0x7f22f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 -- 172.21.15.1:0/2512104279 shutdown_connections 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.963+0000 7f22fc824640 1 -- 172.21.15.1:0/2512104279 wait complete. 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 Processor -- start 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 -- start start 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 0x7f22f8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8102570 0x7f22f81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8110ff0 con 0x7f22f8102ef0 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8110e70 con 0x7f22f8100e20 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22fc824640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8111170 con 0x7f22f8102570 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45938/0 (socket says 172.21.15.1:45938) 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 -- 172.21.15.1:0/1262043318 learned_addr learned my addr 172.21.15.1:0/1262043318 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8102570 0x7f22f81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f659c640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 0x7f22f8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 -- 172.21.15.1:0/1262043318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8102570 msgr2=0x7f22f81998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8102570 0x7f22f81998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 -- 172.21.15.1:0/1262043318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 msgr2=0x7f22f8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 0x7f22f8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f6d9d640 1 -- 172.21.15.1:0/1262043318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f81a4920 con 0x7f22f8102ef0 2024-09-12T02:33:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.964+0000 7f22f659c640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 0x7f22f8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22f6d9d640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f22f00098d0 tx=0x7f22f0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22e77fe640 1 -- 172.21.15.1:0/1262043318 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0034040 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f81a4af0 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22e77fe640 1 -- 172.21.15.1:0/1262043318 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22f002fe10 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22e77fe640 1 -- 172.21.15.1:0/1262043318 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0039450 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.965+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f81a4fa0 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.967+0000 7f22e77fe640 1 -- 172.21.15.1:0/1262043318 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f22f0037020 con 0x7f22f8102ef0 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.967+0000 7f22febfd740 1 Processor -- start 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 -- start start 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a34e80c2f0 con 0x55a34e8b5780 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a34e7b3cf0 con 0x55a34e8a7b40 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22febfd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a34e8082b0 con 0x55a34e8a65d0 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45954/0 (socket says 172.21.15.1:45954) 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f5d9b640 1 -- 172.21.15.1:0/2330422132 learned_addr learned my addr 172.21.15.1:0/2330422132 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22e77fe640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 0x7f22e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f659c640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f6d9d640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 0x7f22e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.968+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 -- 172.21.15.1:0/2330422132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 msgr2=0x55a34e8a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22e77fe640 1 -- 172.21.15.1:0/1262043318 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f22f00f01c0 con 0x7f22f8102ef0 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 -- 172.21.15.1:0/2330422132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 msgr2=0x55a34e8a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 -- 172.21.15.1:0/2330422132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34e7983a0 con 0x55a34e8b5780 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f659c640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00ae00 tx=0x7f22ec00a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fefd130f35ff42b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22f6d9d640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 0x7f22e00a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f22f00ee010 tx=0x7f22f004c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22e4ff9640 1 -- 172.21.15.1:0/2330422132 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec022070 con 0x55a34e8b5780 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22e4ff9640 1 -- 172.21.15.1:0/2330422132 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec01dd70 con 0x55a34e8b5780 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.969+0000 7f22e4ff9640 1 -- 172.21.15.1:0/2330422132 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec013370 con 0x55a34e8b5780 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- 172.21.15.1:0/2330422132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 msgr2=0x55a34e8b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00ae00 tx=0x7f22ec00a490 comp rx=0 tx=0).stop 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- 172.21.15.1:0/2330422132 shutdown_connections 2024-09-12T02:33:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8b7b70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 --2- 172.21.15.1:0/2330422132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- 172.21.15.1:0/2330422132 >> 172.21.15.1:0/2330422132 conn(0x55a34e86f310 msgr2=0x55a34e8a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- 172.21.15.1:0/2330422132 shutdown_connections 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- 172.21.15.1:0/2330422132 wait complete. 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 -- start start 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.970+0000 7f22febfd740 1 Processor -- start 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a65d0 0x55a34e8ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a7b40 0x55a34e8aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a34e8a9550 con 0x55a34e8b5780 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a34e7c7060 con 0x55a34e8a65d0 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a34e8a96d0 con 0x55a34e8a7b40 2024-09-12T02:33:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22febfd740 10 client.0 _ll_register_callbacks cb 0x55a34e51a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45970/0 (socket says 172.21.15.1:45970) 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 -- 172.21.15.1:0/1741772955 learned_addr learned my addr 172.21.15.1:0/1741772955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a65d0 0x55a34e8ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 -- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a7b40 msgr2=0x55a34e8aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a7b40 0x55a34e8aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 -- 172.21.15.1:0/1741772955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a65d0 msgr2=0x55a34e8ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a65d0 0x55a34e8ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 -- 172.21.15.1:0/1741772955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34e57d3c0 con 0x55a34e8b5780 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00afd0 tx=0x7f22ec014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb476cb9af88f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.971+0000 7f22ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec022070 con 0x55a34e8b5780 2024-09-12T02:33:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ec01dd70 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f22ec00fd80 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22ec031070 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22febfd740 10 client.16371 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a34e8bfb80 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec01dd70 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.972+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22ec028070 con 0x55a34e8b5780 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 10 client.16371 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 10 client.16371 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 20 client.16371 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e8c0f30 0x55a34e8c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 4 client.16371 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a34e819860 con 0x55a34e8c0f30 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22f659c640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e8c0f30 0x55a34e8c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22f659c640 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e8c0f30 0x55a34e8c3320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d82f07508e74ab server_cookie=b4499cb0487862a4 in_seq=0 out_seq=0 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.973+0000 7f22ddffb640 10 client.16371 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22ddffb640 1 -- 172.21.15.1:0/1741772955 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a34e819860 con 0x55a34e8c0f30 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22ddffb640 10 client.16371 handle_command_reply: tid=0 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 client.16371 shutdown 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 msgr2=0x55a34e8af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00afd0 tx=0x7f22ec014aa0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 shutdown_connections 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e8c0f30 0x55a34e8c3320 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8b5780 0x55a34e8af1b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a7b40 0x55a34e8aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 --2- 172.21.15.1:0/1741772955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a65d0 0x55a34e8ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22ddffb640 0 client.16371 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 >> 172.21.15.1:0/1741772955 conn(0x55a34e86f310 msgr2=0x55a34e8a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 shutdown_connections 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.974+0000 7f22febfd740 1 -- 172.21.15.1:0/1741772955 wait complete. 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.975+0000 7f22febfd740 20 client.16371 trim_cache size 0 max 16384 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.987+0000 7f22febfd740 1 Processor -- start 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.987+0000 7f22febfd740 1 -- start start 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8b5780 0x55a34e8c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81ab3c0 con 0x55a34e8a65d0 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81acf00 con 0x55a34e8a7b40 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22febfd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81aba90 con 0x55a34e8b5780 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45980/0 (socket says 172.21.15.1:45980) 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 -- 172.21.15.1:0/686632513 learned_addr learned my addr 172.21.15.1:0/686632513 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f659c640 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 -- 172.21.15.1:0/686632513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8b5780 msgr2=0x55a34e8c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8b5780 0x55a34e8c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 -- 172.21.15.1:0/686632513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 msgr2=0x55a34e8a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 -- 172.21.15.1:0/686632513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34e8a7750 con 0x55a34e8a65d0 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f659c640 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00a3b0 tx=0x7f22ec0134d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8265b483bd7294 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22dffff640 1 -- 172.21.15.1:0/686632513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec022070 con 0x55a34e8a65d0 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22dffff640 1 -- 172.21.15.1:0/686632513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec023040 con 0x55a34e8a65d0 2024-09-12T02:33:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.988+0000 7f22dffff640 1 -- 172.21.15.1:0/686632513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec013650 con 0x55a34e8a65d0 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- 172.21.15.1:0/686632513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 msgr2=0x55a34e8af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00a3b0 tx=0x7f22ec0134d0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- 172.21.15.1:0/686632513 shutdown_connections 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8b5780 0x55a34e8c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8a7b40 0x55a34e8a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 --2- 172.21.15.1:0/686632513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a65d0 0x55a34e8af000 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- 172.21.15.1:0/686632513 >> 172.21.15.1:0/686632513 conn(0x55a34e86f310 msgr2=0x55a34e8a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- 172.21.15.1:0/686632513 shutdown_connections 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- 172.21.15.1:0/686632513 wait complete. 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 -- start start 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.989+0000 7f22febfd740 1 Processor -- start 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8b5780 0x55a34e8ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81ac830 con 0x55a34e8a7b40 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81ac160 con 0x55a34e8b5780 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22f81a93a0 con 0x55a34e8a65d0 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22febfd740 10 client.0 _ll_register_callbacks cb 0x7f22ec020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45982/0 (socket says 172.21.15.1:45982) 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 -- 172.21.15.1:0/4019621128 learned_addr learned my addr 172.21.15.1:0/4019621128 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8b5780 0x55a34e8ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 -- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 msgr2=0x55a34e8bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 -- 172.21.15.1:0/4019621128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8b5780 msgr2=0x55a34e8ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:55.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8b5780 0x55a34e8ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 -- 172.21.15.1:0/4019621128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34e8ab8a0 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22f659c640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f22e800bb00 tx=0x7f22e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1665bb44883c87ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.990+0000 7f22ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e801a5b0 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f22e801a750 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ec023040 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22e8029050 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 10 client.16377 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a34e92b390 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec023040 con 0x55a34e8a7b40 2024-09-12T02:33:55.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f22e800f3c0 con 0x55a34e8a7b40 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 10 client.16377 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 10 client.16377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 20 client.16377 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e92bb00 0x55a34e92df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 4 client.16377 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 --> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a34e813d70 con 0x55a34e92bb00 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.991+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e92bb00 0x55a34e92df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22ddffb640 10 client.16377 ms_handle_connect on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22f5d9b640 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e92bb00 0x55a34e92df20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9bb74f03d09fcca server_cookie=4f0853b01b3fac6 in_seq=0 out_seq=0 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22ddffb640 1 -- 172.21.15.1:0/4019621128 <== mds.1 v2:172.21.15.173:6838/3274926052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a34e813d70 con 0x55a34e92bb00 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22ddffb640 10 client.16377 handle_command_reply: tid=0 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 client.16377 shutdown 2024-09-12T02:33:55.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 msgr2=0x55a34e8bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f22e800bb00 tx=0x7f22e8011810 comp rx=0 tx=0).stop 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 shutdown_connections 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:6838/3274926052,v1:172.21.15.173:6839/3274926052] conn(0x55a34e92bb00 0x55a34e92df20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a34e8a7b40 0x55a34e8bdb30 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a34e8b5780 0x55a34e8ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22ddffb640 0 client.16377 ms_handle_reset on v2:172.21.15.173:6838/3274926052 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 --2- 172.21.15.1:0/4019621128 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a34e8a65d0 0x55a34e8bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 >> 172.21.15.1:0/4019621128 conn(0x55a34e86f310 msgr2=0x55a34e8a2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 shutdown_connections 2024-09-12T02:33:55.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 1 -- 172.21.15.1:0/4019621128 wait complete. 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.992+0000 7f22febfd740 20 client.16377 trim_cache size 0 max 16384 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 msgr2=0x7f22e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 0x7f22e00a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f22f00ee010 tx=0x7f22f004c000 comp rx=0 tx=0).stop 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 msgr2=0x7f22f81a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f22f00098d0 tx=0x7f22f0003f10 comp rx=0 tx=0).stop 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 shutdown_connections 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f22e00a2b80 0x7f22e00a5040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22f8102ef0 0x7f22f81a43e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22f8102570 0x7f22f81998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 --2- 172.21.15.1:0/1262043318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f8100e20 0x7f22f8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:55.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 >> 172.21.15.1:0/1262043318 conn(0x7f22f80fc7d0 msgr2=0x7f22f81057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:55.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 shutdown_connections 2024-09-12T02:33:55.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:54.993+0000 7f22fc824640 1 -- 172.21.15.1:0/1262043318 wait complete. 2024-09-12T02:33:55.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:33:56.088 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:33:56.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:55 smithi001 ceph-mon[31252]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:33:56.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:55 smithi134 ceph-mon[35091]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:33:56.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:55 smithi173 ceph-mon[35036]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 -- 172.21.15.1:0/1409013858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 msgr2=0x7fb9e0110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/1409013858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e0110870 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009ca0 tx=0x7fb9d802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 -- 172.21.15.1:0/1409013858 shutdown_connections 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/1409013858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e0110870 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/1409013858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0101280 0x7fb9e010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/1409013858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e01008d0 0x7fb9e0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 -- 172.21.15.1:0/1409013858 >> 172.21.15.1:0/1409013858 conn(0x7fb9e00fc7a0 msgr2=0x7fb9e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 -- 172.21.15.1:0/1409013858 shutdown_connections 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.565+0000 7fb9e7df4640 1 -- 172.21.15.1:0/1409013858 wait complete. 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 Processor -- start 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 -- start start 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e01008d0 0x7fb9e019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e0101280 0x7fb9e019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0114160 con 0x7fb9e010e480 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0113fe0 con 0x7fb9e0101280 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.566+0000 7fb9e7df4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01142e0 con 0x7fb9e01008d0 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45998/0 (socket says 172.21.15.1:45998) 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 -- 172.21.15.1:0/3950721926 learned_addr learned my addr 172.21.15.1:0/3950721926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e01008d0 0x7fb9e019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e0101280 0x7fb9e019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 -- 172.21.15.1:0/3950721926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e01008d0 msgr2=0x7fb9e019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e01008d0 0x7fb9e019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 -- 172.21.15.1:0/3950721926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e0101280 msgr2=0x7fb9e019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e0101280 0x7fb9e019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 -- 172.21.15.1:0/3950721926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e019f690 con 0x7fb9e010e480 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e6391640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802ade0 tx=0x7fb9d80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9d6ffd640 1 -- 172.21.15.1:0/3950721926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8003c30 con 0x7fb9e010e480 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9d6ffd640 1 -- 172.21.15.1:0/3950721926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d8003dd0 con 0x7fb9e010e480 2024-09-12T02:33:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e019f920 con 0x7fb9e010e480 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9d6ffd640 1 -- 172.21.15.1:0/3950721926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d802fd60 con 0x7fb9e010e480 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.567+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01a7260 con 0x7fb9e010e480 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9d6ffd640 1 -- 172.21.15.1:0/3950721926 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb9d8004050 con 0x7fb9e010e480 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 Processor -- start 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 -- start start 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570a6bd82f0 con 0x5570a6c725d0 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5570a6b7fcf0 con 0x5570a6c7d370 2024-09-12T02:33:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5570a6bd42b0 con 0x5570a6c73b40 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46002/0 (socket says 172.21.15.1:46002) 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9e5b90640 1 -- 172.21.15.1:0/3407971719 learned_addr learned my addr 172.21.15.1:0/3407971719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.570+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 -- 172.21.15.1:0/3407971719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 msgr2=0x5570a6c72090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c72090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 -- 172.21.15.1:0/3407971719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 msgr2=0x5570a6c7f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 -- 172.21.15.1:0/3407971719 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a6b643a0 con 0x5570a6c725d0 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9d6ffd640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00ac20 tx=0x7fb9dc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d993a426f1b0d7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9d6ffd640 1 -- 172.21.15.1:0/3950721926 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9d80f04a0 con 0x7fb9e010e480 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9cbfff640 1 -- 172.21.15.1:0/3407971719 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc01d070 con 0x5570a6c725d0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9cbfff640 1 -- 172.21.15.1:0/3407971719 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9dc018b20 con 0x5570a6c725d0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.571+0000 7fb9cbfff640 1 -- 172.21.15.1:0/3407971719 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc010b50 con 0x5570a6c725d0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3407971719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 msgr2=0x5570a6c72a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5570a6c73070 tx=0x7fb9d0014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00ac20 tx=0x7fb9dc00f790 comp rx=0 tx=0).stop 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3407971719 shutdown_connections 2024-09-12T02:33:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c72a10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3407971719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3407971719 >> 172.21.15.1:0/3407971719 conn(0x5570a6c3b310 msgr2=0x5570a6c6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3407971719 shutdown_connections 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3407971719 wait complete. 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 -- start start 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.572+0000 7fb9ea1cd740 1 Processor -- start 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c7a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570a6c80070 con 0x5570a6c725d0 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5570a6b93060 con 0x5570a6c7d370 2024-09-12T02:33:56.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5570a6c801f0 con 0x5570a6c73b40 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9ea1cd740 10 client.0 _ll_register_callbacks cb 0x5570a68e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46018/0 (socket says 172.21.15.1:46018) 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1549868298 learned_addr learned my addr 172.21.15.1:0/1549868298 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e538f640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c7a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e6391640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1549868298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 msgr2=0x5570a6c7a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c7a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 msgr2=0x5570a6c7a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.573+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1549868298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a69493c0 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a760 tx=0x7fb9dc0104d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd1ad164a2fe26d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc01d050 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9dc010890 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc018b20 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc010a90 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 10 client.16389 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570a6c8ba80 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9dc018b20 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9dc0047e0 con 0x5570a6c725d0 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 10 client.16389 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:56.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 20 client.16389 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6c8ce80 0x5570a6c8f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 4 client.16389 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.574+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570a6be5860 con 0x5570a6c8ce80 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.575+0000 7fb9e538f640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6c8ce80 0x5570a6c8f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.575+0000 7fb9e538f640 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6c8ce80 0x5570a6c8f270 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cab246a5d1c6bf0 server_cookie=fb81f884b5c1b991 in_seq=0 out_seq=0 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.575+0000 7fb9c97fa640 10 client.16389 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9c97fa640 1 -- 172.21.15.1:0/1549868298 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570a6be5860 con 0x5570a6c8ce80 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9c97fa640 10 client.16389 handle_command_reply: tid=0 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 client.16389 shutdown 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 msgr2=0x5570a6c7cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a760 tx=0x7fb9dc0104d0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 shutdown_connections 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6c8ce80 0x5570a6c8f270 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c7a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c7a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9c97fa640 0 client.16389 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1549868298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c7cd60 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 >> 172.21.15.1:0/1549868298 conn(0x5570a6c3b310 msgr2=0x5570a6c74960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 shutdown_connections 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1549868298 wait complete. 2024-09-12T02:33:56.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.576+0000 7fb9ea1cd740 20 client.16389 trim_cache size 0 max 16384 2024-09-12T02:33:56.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.589+0000 7fb9ea1cd740 1 Processor -- start 2024-09-12T02:33:56.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.589+0000 7fb9ea1cd740 1 -- start start 2024-09-12T02:33:56.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c94900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01af890 con 0x5570a6c725d0 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01b13d0 con 0x5570a6c7d370 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01aff60 con 0x5570a6c73b40 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46030/0 (socket says 172.21.15.1:46030) 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1867687734 learned_addr learned my addr 172.21.15.1:0/1867687734 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e6391640 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c94900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e538f640 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1867687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 msgr2=0x5570a6c78ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c78ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1867687734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 msgr2=0x5570a6c94900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c94900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 -- 172.21.15.1:0/1867687734 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a6c6f960 con 0x5570a6c725d0 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.590+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a730 tx=0x7fb9dc0244d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbde3a47c61322d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/1867687734 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc03c020 con 0x5570a6c725d0 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/1867687734 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9dc029070 con 0x5570a6c725d0 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/1867687734 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc01d070 con 0x5570a6c725d0 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1867687734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 msgr2=0x5570a6c89310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00a730 tx=0x7fb9dc0244d0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1867687734 shutdown_connections 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c94900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c73b40 0x5570a6c78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/1867687734 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c725d0 0x5570a6c89310 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1867687734 >> 172.21.15.1:0/1867687734 conn(0x5570a6c3b310 msgr2=0x5570a6c788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1867687734 shutdown_connections 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.591+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/1867687734 wait complete. 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 -- start start 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 Processor -- start 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c725d0 0x5570a6c85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01b0d00 con 0x5570a6c73b40 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01b0630 con 0x5570a6c7d370 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01ad870 con 0x5570a6c725d0 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9ea1cd740 10 client.0 _ll_register_callbacks cb 0x7fb9dc01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9e538f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9e538f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46032/0 (socket says 172.21.15.1:46032) 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9e538f640 1 -- 172.21.15.1:0/3167859616 learned_addr learned my addr 172.21.15.1:0/3167859616 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9e6391640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.592+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c725d0 0x5570a6c85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 -- 172.21.15.1:0/3167859616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c725d0 msgr2=0x5570a6c85a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c725d0 0x5570a6c85a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 -- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 msgr2=0x5570a6c770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:56.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c770d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 -- 172.21.15.1:0/3167859616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a6c8f6d0 con 0x5570a6c73b40 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9e538f640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5570a6c7d340 tx=0x7fb9d000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8e402089f1ec29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d001fc40 con 0x5570a6c73b40 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb9d0019070 con 0x5570a6c73b40 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc029070 con 0x5570a6c73b40 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9d001fde0 con 0x5570a6c73b40 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9ea1cd740 10 client.16395 fetch_fsmap learned FSMap version 28 2024-09-12T02:33:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570a6cf75c0 con 0x5570a6c73b40 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.593+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9dc029070 con 0x5570a6c73b40 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9dc019ce0 con 0x5570a6c73b40 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 10 client.16395 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 20 client.16395 populate_metadata read hostname 'smithi001' 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6cf7d50 0x5570a6cfa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 4 client.16395 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 --> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570a6bdfd70 con 0x5570a6cf7d50 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6cf7d50 0x5570a6cfa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9c97fa640 10 client.16395 ms_handle_connect on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.594+0000 7fb9e5b90640 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6cf7d50 0x5570a6cfa170 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14671b5ca8ce94d1 server_cookie=1d349d415dae590b in_seq=0 out_seq=0 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9c97fa640 1 -- 172.21.15.1:0/3167859616 <== mds.0 v2:172.21.15.134:6838/3689768435 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570a6bdfd70 con 0x5570a6cf7d50 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9c97fa640 10 client.16395 handle_command_reply: tid=0 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 client.16395 shutdown 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 msgr2=0x5570a6c76b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5570a6c7d340 tx=0x7fb9d000b5b0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 shutdown_connections 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570a6c73b40 0x5570a6c76b90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:6838/3689768435,v1:172.21.15.134:6839/3689768435] conn(0x5570a6cf7d50 0x5570a6cfa170 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5570a6c7d370 0x5570a6c770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 --2- 172.21.15.1:0/3167859616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570a6c725d0 0x5570a6c85a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 >> 172.21.15.1:0/3167859616 conn(0x5570a6c3b310 msgr2=0x5570a6c79100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9c97fa640 0 client.16395 ms_handle_reset on v2:172.21.15.134:6838/3689768435 2024-09-12T02:33:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 shutdown_connections 2024-09-12T02:33:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 1 -- 172.21.15.1:0/3167859616 wait complete. 2024-09-12T02:33:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9ea1cd740 20 client.16395 trim_cache size 0 max 16384 2024-09-12T02:33:56.608 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-12T02:33:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 msgr2=0x7fb9cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x5570a6c73070 tx=0x7fb9d0014040 comp rx=0 tx=0).stop 2024-09-12T02:33:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 msgr2=0x7fb9e019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.595+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802ade0 tx=0x7fb9d80319f0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 shutdown_connections 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fb9cc0a2b80 0x7fb9cc0a5040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e010e480 0x7fb9e019efb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e0101280 0x7fb9e019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 --2- 172.21.15.1:0/3950721926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e01008d0 0x7fb9e019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 >> 172.21.15.1:0/3950721926 conn(0x7fb9e00fc7a0 msgr2=0x7fb9e00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 shutdown_connections 2024-09-12T02:33:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:56.596+0000 7fb9e7df4640 1 -- 172.21.15.1:0/3950721926 wait complete. 2024-09-12T02:33:57.458 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T02:33:57.459 INFO:tasks.fwd_scrub:done joining 2024-09-12T02:33:57.459 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:33:57.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:33:57.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 -- 172.21.15.1:0/417742085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 msgr2=0x7f53841049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 --2- 172.21.15.1:0/417742085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f53841049a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5380009900 tx=0x7f538002a410 comp rx=0 tx=0).stop 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 -- 172.21.15.1:0/417742085 shutdown_connections 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 --2- 172.21.15.1:0/417742085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 0x7f5384109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 --2- 172.21.15.1:0/417742085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 0x7f53841072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 --2- 172.21.15.1:0/417742085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f53841049a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 -- 172.21.15.1:0/417742085 >> 172.21.15.1:0/417742085 conn(0x7f53840fc1b0 msgr2=0x7f53840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 -- 172.21.15.1:0/417742085 shutdown_connections 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.585+0000 7f538b4e4640 1 -- 172.21.15.1:0/417742085 wait complete. 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 Processor -- start 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 -- start start 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 0x7f5384100560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 0x7f5384100aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f538410d810 con 0x7f53841025b0 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f538410d690 con 0x7f5384107810 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f538b4e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f538410d990 con 0x7f5384104ee0 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46046/0 (socket says 172.21.15.1:46046) 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 -- 172.21.15.1:0/2522856783 learned_addr learned my addr 172.21.15.1:0/2522856783 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5388a7f640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 0x7f5384100560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389a81640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 0x7f5384100aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 -- 172.21.15.1:0/2522856783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 msgr2=0x7f5384100560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 0x7f5384100560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 -- 172.21.15.1:0/2522856783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 msgr2=0x7f5384100aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 0x7f5384100aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 -- 172.21.15.1:0/2522856783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5384101330 con 0x7f53841025b0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.586+0000 7f5389280640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5380009230 tx=0x7f5380031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.587+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538003f030 con 0x7f53841025b0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.587+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5380003ad0 con 0x7f53841025b0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.587+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53841a1fe0 con 0x7f53841025b0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.587+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380035070 con 0x7f53841025b0 2024-09-12T02:33:57.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.587+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53841a23f0 con 0x7f53841025b0 2024-09-12T02:33:57.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.588+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53840fdca0 con 0x7f53841025b0 2024-09-12T02:33:57.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.590+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5380042030 con 0x7f53841025b0 2024-09-12T02:33:57.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.590+0000 7f537a7fc640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 0x7f53700a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.591+0000 7f5388a7f640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 0x7f53700a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.591+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f53800ef9c0 con 0x7f53841025b0 2024-09-12T02:33:57.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.591+0000 7f5388a7f640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 0x7f53700a5050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5384101c90 tx=0x7f5374005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.594+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53800bc8a0 con 0x7f53841025b0 2024-09-12T02:33:57.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.771+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f538402da10 con 0x7f53841025b0 2024-09-12T02:33:57.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.773+0000 7f537a7fc640 1 -- 172.21.15.1:0/2522856783 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7f53800bc1a0 con 0x7f53841025b0 2024-09-12T02:33:57.774 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:57.774 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 msgr2=0x7f53700a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 0x7f53700a5050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5384101c90 tx=0x7f5374005f90 comp rx=0 tx=0).stop 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 msgr2=0x7f5384101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5380009230 tx=0x7f5380031b60 comp rx=0 tx=0).stop 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 shutdown_connections 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f53700a2b90 0x7f53700a5050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5384107810 0x7f5384100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5384104ee0 0x7f5384100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 --2- 172.21.15.1:0/2522856783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53841025b0 0x7f5384101f20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 >> 172.21.15.1:0/2522856783 conn(0x7f53840fc1b0 msgr2=0x7f5384102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 shutdown_connections 2024-09-12T02:33:57.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.775+0000 7f538b4e4640 1 -- 172.21.15.1:0/2522856783 wait complete. 2024-09-12T02:33:57.787 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:24:10.372859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:28:48.794744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:28:50.955400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:33:57.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:33:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- 172.21.15.1:0/555718339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 msgr2=0x7f3524108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 --2- 172.21.15.1:0/555718339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f3524108e40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f351c009ca0 tx=0x7f351c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- 172.21.15.1:0/555718339 shutdown_connections 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 --2- 172.21.15.1:0/555718339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f3524108e40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 --2- 172.21.15.1:0/555718339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524101bf0 0x7f3524102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 --2- 172.21.15.1:0/555718339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524100a00 0x7f3524100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- 172.21.15.1:0/555718339 >> 172.21.15.1:0/555718339 conn(0x7f35240fc140 msgr2=0x7f35240fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- 172.21.15.1:0/555718339 shutdown_connections 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- 172.21.15.1:0/555718339 wait complete. 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 Processor -- start 2024-09-12T02:33:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.894+0000 7f35290ba640 1 -- start start 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 0x7f3524197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524101bf0 0x7f3524198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f352410c6b0 con 0x7f35241025b0 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f352410c530 con 0x7f3524101bf0 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f352410c830 con 0x7f3524100a00 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46062/0 (socket says 172.21.15.1:46062) 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 -- 172.21.15.1:0/3938868073 learned_addr learned my addr 172.21.15.1:0/3938868073 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f3522d9d640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 0x7f3524197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f351bfff640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524101bf0 0x7f3524198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 -- 172.21.15.1:0/3938868073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 msgr2=0x7f3524197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 0x7f3524197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 -- 172.21.15.1:0/3938868073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524101bf0 msgr2=0x7f3524198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524101bf0 0x7f3524198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 -- 172.21.15.1:0/3938868073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352419fa20 con 0x7f35241025b0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f3522d9d640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 0x7f3524197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f352359e640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f351c0319f0 tx=0x7f351c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c003c70 con 0x7f35241025b0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c003e10 con 0x7f35241025b0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352419fcb0 con 0x7f35241025b0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.895+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c02fd30 con 0x7f35241025b0 2024-09-12T02:33:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.896+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35241a01b0 con 0x7f35241025b0 2024-09-12T02:33:57.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.897+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35241a03e0 con 0x7f35241025b0 2024-09-12T02:33:57.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.898+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f351c004040 con 0x7f35241025b0 2024-09-12T02:33:57.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.898+0000 7f3520d99640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 0x7f35100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.899+0000 7f3522d9d640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 0x7f35100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.899+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f351c0f0720 con 0x7f35241025b0 2024-09-12T02:33:57.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.899+0000 7f3522d9d640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 0x7f35100a5050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3524101a50 tx=0x7f351400a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:57.903+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f351c0bd660 con 0x7f35241025b0 2024-09-12T02:33:58.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.080+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35241a05b0 con 0x7f35241025b0 2024-09-12T02:33:58.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.080+0000 7f3520d99640 1 -- 172.21.15.1:0/3938868073 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f351c0bcf60 con 0x7f35241025b0 2024-09-12T02:33:58.081 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 msgr2=0x7f35100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 0x7f35100a5050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3524101a50 tx=0x7f351400a560 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 msgr2=0x7f352419f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f351c0319f0 tx=0x7f351c02f450 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 shutdown_connections 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f35100a2b90 0x7f35100a5050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f35241025b0 0x7f352419f3b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3524101bf0 0x7f3524198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 --2- 172.21.15.1:0/3938868073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3524100a00 0x7f3524197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 >> 172.21.15.1:0/3938868073 conn(0x7f35240fc140 msgr2=0x7f35240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 shutdown_connections 2024-09-12T02:33:58.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.082+0000 7f35290ba640 1 -- 172.21.15.1:0/3938868073 wait complete. 2024-09-12T02:33:58.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:57 smithi001 ceph-mon[31252]: pgmap v433: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:33:58.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:57 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2522856783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:33:58.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:33:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:57 smithi134 ceph-mon[35091]: pgmap v433: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:33:58.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:57 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2522856783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:33:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:57 smithi173 ceph-mon[35036]: pgmap v433: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:33:58.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:57 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2522856783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:33:58.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.199+0000 7f12cc313640 1 -- 172.21.15.1:0/1319620941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c41036d0 msgr2=0x7f12c4109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.199+0000 7f12cc313640 1 --2- 172.21.15.1:0/1319620941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c41036d0 0x7f12c4109f60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009ca0 tx=0x7f12bc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.199+0000 7f12cc313640 1 -- 172.21.15.1:0/1319620941 shutdown_connections 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- 172.21.15.1:0/1319620941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c41036d0 0x7f12c4109f60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- 172.21.15.1:0/1319620941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c4102d10 0x7f12c4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- 172.21.15.1:0/1319620941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4101b20 0x7f12c4101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- 172.21.15.1:0/1319620941 >> 172.21.15.1:0/1319620941 conn(0x7f12c40fd2a0 msgr2=0x7f12c40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- 172.21.15.1:0/1319620941 shutdown_connections 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- 172.21.15.1:0/1319620941 wait complete. 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 Processor -- start 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- start start 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 0x7f12c4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c41036d0 0x7f12c419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410d7a0 con 0x7f12c4101b20 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410d620 con 0x7f12c4102d10 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12cc313640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410d920 con 0x7f12c41036d0 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12ca0af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12ca0af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46076/0 (socket says 172.21.15.1:46076) 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.200+0000 7f12ca0af640 1 -- 172.21.15.1:0/1120108848 learned_addr learned my addr 172.21.15.1:0/1120108848 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca8b0640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c41036d0 0x7f12c419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12c98ae640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 0x7f12c4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 -- 172.21.15.1:0/1120108848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c41036d0 msgr2=0x7f12c419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c41036d0 0x7f12c419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 -- 172.21.15.1:0/1120108848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 msgr2=0x7f12c4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 0x7f12c4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 -- 172.21.15.1:0/1120108848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c419fa40 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12c98ae640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 0x7f12c4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12ca0af640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d950 tx=0x7f12b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4017020 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b4009c30 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c419fd30 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b400f740 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.201+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c41a0210 con 0x7f12c4101b20 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.202+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c4108ee0 con 0x7f12c4101b20 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.203+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f12b401a020 con 0x7f12c4101b20 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.204+0000 7f12bb7fe640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 0x7f12b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.204+0000 7f12c98ae640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 0x7f12b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.204+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f12b40cee20 con 0x7f12c4101b20 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.205+0000 7f12c98ae640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 0x7f12b00a50d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12c4199330 tx=0x7f12c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.208+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12b4021070 con 0x7f12c4101b20 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.385+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f12c4062f30 con 0x7f12c4101b20 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.385+0000 7f12bb7fe640 1 -- 172.21.15.1:0/1120108848 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f12b4009de0 con 0x7f12c4101b20 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-12T02:33:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 msgr2=0x7f12b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 0x7f12b00a50d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12c4199330 tx=0x7f12c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:33:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 msgr2=0x7f12c4197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d950 tx=0x7f12b400de10 comp rx=0 tx=0).stop 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 shutdown_connections 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.387+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f12b00a2c10 0x7f12b00a50d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12c41036d0 0x7f12c419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c4102d10 0x7f12c4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 --2- 172.21.15.1:0/1120108848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12c4101b20 0x7f12c4197e20 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 >> 172.21.15.1:0/1120108848 conn(0x7f12c40fd2a0 msgr2=0x7f12c41060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 shutdown_connections 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.388+0000 7f12cc313640 1 -- 172.21.15.1:0/1120108848 wait complete. 2024-09-12T02:33:58.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:33:58.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 -- 172.21.15.1:0/4127797883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28100a30 msgr2=0x7f0b28100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 --2- 172.21.15.1:0/4127797883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28100a30 0x7f0b28100e30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009ca0 tx=0x7f0b1802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 -- 172.21.15.1:0/4127797883 shutdown_connections 2024-09-12T02:33:58.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 --2- 172.21.15.1:0/4127797883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b281025e0 0x7f0b28108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 --2- 172.21.15.1:0/4127797883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b28101c20 0x7f0b281020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 --2- 172.21.15.1:0/4127797883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28100a30 0x7f0b28100e30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 -- 172.21.15.1:0/4127797883 >> 172.21.15.1:0/4127797883 conn(0x7f0b280fc1b0 msgr2=0x7f0b280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 -- 172.21.15.1:0/4127797883 shutdown_connections 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.505+0000 7f0b30331640 1 -- 172.21.15.1:0/4127797883 wait complete. 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 Processor -- start 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 -- start start 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b28100a30 0x7f0b28196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b281025e0 0x7f0b2819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2810c710 con 0x7f0b28101c20 2024-09-12T02:33:58.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2810c590 con 0x7f0b281025e0 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b30331640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2810c890 con 0x7f0b28100a30 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46108/0 (socket says 172.21.15.1:46108) 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 -- 172.21.15.1:0/2305055492 learned_addr learned my addr 172.21.15.1:0/2305055492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2e8ce640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b281025e0 0x7f0b2819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2e0cd640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b28100a30 0x7f0b28196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 -- 172.21.15.1:0/2305055492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b28100a30 msgr2=0x7f0b28196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b28100a30 0x7f0b28196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 -- 172.21.15.1:0/2305055492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b281025e0 msgr2=0x7f0b2819e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b281025e0 0x7f0b2819e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.506+0000 7f0b2d8cc640 1 -- 172.21.15.1:0/2305055492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2819ea70 con 0x7f0b28101c20 2024-09-12T02:33:58.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b2d8cc640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00d950 tx=0x7f0b1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c017070 con 0x7f0b28101c20 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2819ed60 con 0x7f0b28101c20 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b1c009c30 con 0x7f0b28101c20 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00f6b0 con 0x7f0b28101c20 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.507+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2819f2a0 con 0x7f0b28101c20 2024-09-12T02:33:58.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.508+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b28107eb0 con 0x7f0b28101c20 2024-09-12T02:33:58.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.509+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0b1c0109d0 con 0x7f0b28101c20 2024-09-12T02:33:58.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.510+0000 7f0b277fe640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 0x7f0b100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.510+0000 7f0b2e0cd640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 0x7f0b100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.510+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0b1c0cecf0 con 0x7f0b28101c20 2024-09-12T02:33:58.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.510+0000 7f0b2e0cd640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 0x7f0b100a5050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b18000f80 tx=0x7f0b18009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.514+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b1c009de0 con 0x7f0b28101c20 2024-09-12T02:33:58.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.689+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b28062e90 con 0x7f0b28101c20 2024-09-12T02:33:58.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.690+0000 7f0b277fe640 1 -- 172.21.15.1:0/2305055492 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f0b1c09bbd0 con 0x7f0b28101c20 2024-09-12T02:33:58.690 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-12T02:33:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 msgr2=0x7f0b100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 0x7f0b100a5050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b18000f80 tx=0x7f0b18009360 comp rx=0 tx=0).stop 2024-09-12T02:33:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 msgr2=0x7f0b28197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00d950 tx=0x7f0b1c00de10 comp rx=0 tx=0).stop 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 shutdown_connections 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f0b100a2b90 0x7f0b100a5050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b28101c20 0x7f0b28197390 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b281025e0 0x7f0b2819e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 --2- 172.21.15.1:0/2305055492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b28100a30 0x7f0b28196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 >> 172.21.15.1:0/2305055492 conn(0x7f0b280fc1b0 msgr2=0x7f0b28105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 shutdown_connections 2024-09-12T02:33:58.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.692+0000 7f0b30331640 1 -- 172.21.15.1:0/2305055492 wait complete. 2024-09-12T02:33:58.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:33:58.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 -- 172.21.15.1:0/2765045894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 msgr2=0x7ff3001049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2765045894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff3001049a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009900 tx=0x7ff2f002a410 comp rx=0 tx=0).stop 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 -- 172.21.15.1:0/2765045894 shutdown_connections 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2765045894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 0x7ff300109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2765045894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 0x7ff3001072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2765045894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff3001049a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 -- 172.21.15.1:0/2765045894 >> 172.21.15.1:0/2765045894 conn(0x7ff3000fc1b0 msgr2=0x7ff3000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 -- 172.21.15.1:0/2765045894 shutdown_connections 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.806+0000 7ff305d6d640 1 -- 172.21.15.1:0/2765045894 wait complete. 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 Processor -- start 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 -- start start 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 0x7ff300198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 0x7ff30019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff30010d810 con 0x7ff3001025b0 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff30010d690 con 0x7ff300107810 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff305d6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff30010d990 con 0x7ff300104ee0 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff2ff7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff2ff7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46122/0 (socket says 172.21.15.1:46122) 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff2ff7fe640 1 -- 172.21.15.1:0/2809478022 learned_addr learned my addr 172.21.15.1:0/2809478022 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff2feffd640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 0x7ff300198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.807+0000 7ff2fffff640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 0x7ff30019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 -- 172.21.15.1:0/2809478022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 msgr2=0x7ff300198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 0x7ff300198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 -- 172.21.15.1:0/2809478022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 msgr2=0x7ff30019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 0x7ff30019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 -- 172.21.15.1:0/2809478022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30019fb10 con 0x7ff3001025b0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2ff7fe640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009230 tx=0x7ff2f0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f003f030 con 0x7ff3001025b0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30019fda0 con 0x7ff3001025b0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f0003ce0 con 0x7ff3001025b0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0035070 con 0x7ff3001025b0 2024-09-12T02:33:58.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.808+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001a0220 con 0x7ff3001025b0 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.809+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3000fdca0 con 0x7ff3001025b0 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.810+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff2f0042030 con 0x7ff3001025b0 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.811+0000 7ff2fcff9640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 0x7ff2e80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.811+0000 7ff2feffd640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 0x7ff2e80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.811+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff2f00efb60 con 0x7ff3001025b0 2024-09-12T02:33:58.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.811+0000 7ff2feffd640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 0x7ff2e80a5050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005fd0 tx=0x7ff2f4005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:58.814+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2f00bca40 con 0x7ff3001025b0 2024-09-12T02:33:59.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.045+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff300062e90 con 0x7ff3001025b0 2024-09-12T02:33:59.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.053+0000 7ff2fcff9640 1 -- 172.21.15.1:0/2809478022 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740363 (secure 0 0 0) 0x7ff2f00bc340 con 0x7ff3001025b0 2024-09-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 18, 2024-09-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3015676599 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3015676599 2024-09-12T02:33:59.068 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/3015676599", 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-12T02:21:53.871301+0000", 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-12T02:33:59.069 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24109, 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.071 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.072 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.074 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.075 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.076 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-12T02:33:59.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-12T02:33:59.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:33:59.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-12T02:33:59.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.096 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.099 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:33:59.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.108 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-12T02:33:59.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:33:59.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-12T02:33:59.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.119 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-12T02:33:59.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:33:59.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.130 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.132 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.134 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:33:59.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-12T02:33:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:33:59.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-12T02:33:59.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:33:59.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-12T02:33:59.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-12T02:33:59.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:33:59.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.156 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.157 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-12T02:33:59.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:33:59.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-12T02:33:59.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-12T02:33:59.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:33:59.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.173 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-12T02:33:59.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:33:59.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-12T02:33:59.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.184 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.188 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.189 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.192 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.194 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:33:59.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:33:59.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.198 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:33:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.205 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:33:59.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:33:59.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.216 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.221 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.228 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.235 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-12T02:33:59.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:33:59.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:33:59.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-12T02:33:59.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:33:59.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.255 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.258 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-12T02:33:59.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-12T02:33:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.268 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.270 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.278 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-12T02:33:59.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:33:59.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:33:59.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.287 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.290 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.293 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-12T02:33:59.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-12T02:33:59.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-12T02:33:59.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.311 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:33:59.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-12T02:33:59.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.317 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.319 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.322 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.324 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-12T02:33:59.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:33:59.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-12T02:33:59.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.341 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.342 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.345 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-12T02:33:59.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.349 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:33:59.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-12T02:33:59.353 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.354 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.357 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.367 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.369 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.370 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.372 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.378 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.383 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.388 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.389 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.396 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.399 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-12T02:33:59.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.404 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-12T02:33:59.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.423 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-12T02:33:59.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.431 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-12T02:33:59.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:33:59.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.459 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.462 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.466 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.471 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-12T02:33:59.475 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.479 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-12T02:33:59.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-12T02:33:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.495 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-12T02:33:59.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-12T02:33:59.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.500 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.506 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.507 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.510 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.511 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.513 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.514 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.517 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.521 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.523 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.529 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.532 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:33:59.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-12T02:33:59.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-12T02:33:59.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-12T02:33:59.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.547 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.550 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.551 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.556 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.561 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.567 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.568 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:33:59.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:33:59.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.574 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-12T02:33:59.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.588 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24119, 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.595 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-12T02:33:59.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-12T02:33:59.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-12T02:33:59.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-12T02:33:59.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.607 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-12T02:33:59.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.616 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.618 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.621 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.622 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:33:59.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.630 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.633 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-12T02:33:59.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.638 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-12T02:33:59.640 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.642 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:33:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-12T02:33:59.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:33:59.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:33:59.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-12T02:33:59.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:33:59.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-12T02:33:59.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.663 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:33:59.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-12T02:33:59.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:33:59.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:33:59.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.679 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.680 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:33:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-12T02:33:59.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:33:59.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-12T02:33:59.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-12T02:33:59.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.706 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.711 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.712 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.715 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-12T02:33:59.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-12T02:33:59.720 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:33:59.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:33:59.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:33:59.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.738 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:33:59.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.741 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.747 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:33:59.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:33:59.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:33:59.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:33:59.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.766 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:33:59.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-12T02:33:59.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:33:59.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-12T02:33:59.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.793 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.794 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-12T02:33:59.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-12T02:33:59.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.800 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.802 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.803 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-12T02:33:59.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.811 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:33:59.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-12T02:33:59.825 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.826 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.831 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.833 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.836 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-12T02:33:59.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-12T02:33:59.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.845 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.846 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.851 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.852 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.853 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.858 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:33:59.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.867 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-12T02:33:59.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:33:59.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:33:59.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-12T02:33:59.884 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.889 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.891 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-12T02:33:59.898 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.916 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.919 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.929 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.931 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.932 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.934 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.935 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:33:59.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-12T02:33:59.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.943 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.944 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:33:59.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.948 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-12T02:33:59.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.961 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:33:59.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.966 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.968 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.971 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.972 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.977 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.988 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.992 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:33:59.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.994 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:33:59.998 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:33:59.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.002 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-12T02:34:00.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.011 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-12T02:34:00.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.018 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-12T02:34:00.019 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.033 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.034 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.035 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.037 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.038 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.041 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.044 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-12T02:34:00.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.050 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-12T02:34:00.055 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.060 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:34:00.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-12T02:34:00.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-12T02:34:00.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.072 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.073 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.075 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.077 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:34:00.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-12T02:34:00.081 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.082 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.088 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.089 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.092 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.104 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.107 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-12T02:34:00.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-12T02:34:00.113 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.116 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.118 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.119 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-12T02:34:00.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-12T02:34:00.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.125 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-12T02:34:00.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.127 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.132 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.133 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-12T02:34:00.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:34:00.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-12T02:34:00.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:34:00.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.142 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.143 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.145 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-12T02:34:00.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-12T02:34:00.149 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-12T02:34:00.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-12T02:34:00.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:34:00.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-12T02:34:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.161 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-12T02:34:00.163 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-12T02:34:00.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:34:00.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:34:00.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-12T02:34:00.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:34:00.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-12T02:34:00.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.178 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:34:00.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.184 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:34:00.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-12T02:34:00.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:34:00.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:34:00.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:34:00.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-12T02:34:00.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.199 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.200 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.204 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.205 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-12T02:34:00.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-12T02:34:00.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-12T02:34:00.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-12T02:34:00.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-12T02:34:00.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-12T02:34:00.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.225 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:34:00.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.231 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.234 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.237 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-12T02:34:00.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.241 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.243 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:34:00.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.249 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:34:00.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:34:00.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:34:00.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.262 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.266 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:34:00.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:34:00.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.273 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:34:00.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:34:00.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:34:00.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:34:00.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.300 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.301 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.303 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-12T02:34:00.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.314 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-12T02:34:00.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.316 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.319 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.322 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-12T02:34:00.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:34:00.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:34:00.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.331 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.343 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.349 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.352 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.354 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.358 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-12T02:34:00.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-12T02:34:00.362 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.363 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.366 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.367 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.370 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.371 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.373 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-12T02:34:00.375 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.382 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.384 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-12T02:34:00.385 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.387 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.390 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-12T02:34:00.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:34:00.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.398 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.399 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.402 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.406 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.409 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.418 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.420 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.421 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.423 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.424 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.427 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.435 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.438 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.440 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-12T02:34:00.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-12T02:34:00.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-12T02:34:00.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.469 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.472 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:34:00.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.483 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.486 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.492 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.497 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.500 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.507 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.509 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.510 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.514 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.517 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.521 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.522 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.523 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-12T02:34:00.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-12T02:34:00.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-12T02:34:00.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-12T02:34:00.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.541 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-12T02:34:00.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.552 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.553 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.556 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.560 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.561 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.566 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.569 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.572 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-12T02:34:00.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-12T02:34:00.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.600 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.601 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.603 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.604 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.616 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-12T02:34:00.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.619 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-12T02:34:00.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-12T02:34:00.631 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-12T02:34:00.632 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-12T02:34:00.633 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-12T02:34:00.634 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-12T02:34:00.635 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-12T02:34:00.636 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-12T02:34:00.637 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2569775057 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-12T02:34:00.638 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2749367897 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-12T02:34:00.639 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2385808398 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-12T02:34:00.640 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1941168838 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-12T02:34:00.641 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:34:00.643 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:58 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3938868073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.694 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:58 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1120108848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.694 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:58 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2305055492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.694 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:59 smithi173 ceph-mon[35036]: pgmap v434: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:00.694 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:33:59 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2809478022' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:00.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:58 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3938868073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:58 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1120108848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:58 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2305055492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:59 smithi134 ceph-mon[35091]: pgmap v434: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:00.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:33:59 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2809478022' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.058+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 msgr2=0x7ff2e80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.058+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 0x7ff2e80a5050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005fd0 tx=0x7ff2f4005e20 comp rx=0 tx=0).stop 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 msgr2=0x7ff300197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009230 tx=0x7ff2f0004360 comp rx=0 tx=0).stop 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 shutdown_connections 2024-09-12T02:34:00.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b90 0x7ff2e80a5050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300107810 0x7ff30019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300104ee0 0x7ff300198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 --2- 172.21.15.1:0/2809478022 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001025b0 0x7ff300197ef0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 >> 172.21.15.1:0/2809478022 conn(0x7ff3000fc1b0 msgr2=0x7ff300103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 shutdown_connections 2024-09-12T02:34:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:33:59.059+0000 7ff305d6d640 1 -- 172.21.15.1:0/2809478022 wait complete. 2024-09-12T02:34:00.696 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:58 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3938868073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.696 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:58 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1120108848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.697 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:58 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2305055492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:34:00.758 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:34:00.758 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:34:00.759 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:59 smithi001 ceph-mon[31252]: pgmap v434: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:00.759 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:33:59 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2809478022' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:01.028 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 600, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 600, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 181713, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 189977, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 6, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:01.573 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.052419021, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.016265627, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.015517950, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.015260357, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 599, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.023110708, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000038582 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.574 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 104, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 100, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 466526, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 56318, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.016649923, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006602853, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.013876213, 2024-09-12T02:34:01.575 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000160799, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 99, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.007436306, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000075114 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 465136, 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 55296 2024-09-12T02:34:01.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 2, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 69, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 428, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 195390, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.006193820, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.004023516, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001523424, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000023208, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 67, 2024-09-12T02:34:01.577 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003527107, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000052643 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 195072 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 1, 2024-09-12T02:34:01.578 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-MDSRank": { 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1193, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.029965102, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000025117 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.579 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": { 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "request": 0, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "reply": 0, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "reply_latency": { 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_reply": 0, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "forward": 0, 2024-09-12T02:34:01.580 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_commit": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_split": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_merge": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_top": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_bottom": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pinned": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_expired": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": 0, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "subtrees": 1, 2024-09-12T02:34:01.581 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_hit": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_forward": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_discover": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_lock": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "load_cent": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "q": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "exported": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "exported_inodes": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "imported": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "imported_inodes": 0, 2024-09-12T02:34:01.582 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rfiles": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rbytes": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rsnaps": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:01.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "process_request_cap_release": 0 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache": { 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update": 0, 2024-09-12T02:34:01.584 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_try_discover": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_send_discover": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_created": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_enqueued": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_migrated": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:01.585 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_started": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_completed": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_flush": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_inodestats": 0 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log": { 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "evlrg": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "evadd": 0, 2024-09-12T02:34:01.586 INFO:teuthology.orchestra.run.smithi001.stdout: "evex": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "evtrm": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "ev": 2, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "evexg": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "evexd": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segadd": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segex": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segtrm": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "seg": 2, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segmjr": 2, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segexg": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "segexd": 0, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "expos": 4194304, 2024-09-12T02:34:01.587 INFO:teuthology.orchestra.run.smithi001.stdout: "wrpos": 4194892, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "rdpos": 4194352, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "jlat": { 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "replayed": 2 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mem": { 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "ino": 3, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "ino+": 3, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "ino-": 0, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "dir": 1, 2024-09-12T02:34:01.588 INFO:teuthology.orchestra.run.smithi001.stdout: "dir+": 1, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dir-": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dn": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dn+": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dn-": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "cap": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "cap+": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "cap-": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "rss": 50628, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "heap": 215328 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_server": { 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:01.589 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_request": 0, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_session": 0, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_peer_request": 0, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "req_create_latency": { 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getattr_latency": { 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:01.590 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "req_link_latency": { 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookup_latency": { 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupino_latency": { 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupname_latency": { 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.592 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lssnap_latency": { 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.593 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mkdir_latency": { 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mknod_latency": { 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.594 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mksnap_latency": { 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "req_open_latency": { 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "req_readdir_latency": { 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rename_latency": { 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.596 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmdir_latency": { 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:01.597 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setattr_latency": { 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.598 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setlayout_latency": { 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setxattr_latency": { 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "req_symlink_latency": { 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "req_unlink_latency": { 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:01.600 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessions": { 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "session_count": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "session_add": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "session_remove": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_open": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_stale": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "total_load": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "average_load": 0, 2024-09-12T02:34:01.601 INFO:teuthology.orchestra.run.smithi001.stdout: "avg_session_uptime": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:01.602 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:01.603 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 189239, 2024-09-12T02:34:01.604 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 48, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 158, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:01.605 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 8512, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 13, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter": { 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "op_active": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "op_laggy": 0, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send": 600, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send_bytes": 21, 2024-09-12T02:34:01.606 INFO:teuthology.orchestra.run.smithi001.stdout: "op_resend": 3, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op_reply": 600, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op_latency": { 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 600, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.396994986, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000661658 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op_inflight": 0, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "oplen_avg": { 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 600, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 601 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op": 600, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op_r": 600, 2024-09-12T02:34:01.607 INFO:teuthology.orchestra.run.smithi001.stdout: "op_w": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "op_rmw": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "op_pg": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_stat": 297, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_create": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_read": 301, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_write": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writefull": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writesame": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_append": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_zero": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_truncate": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_delete": 0, 2024-09-12T02:34:01.608 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_mapext": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_getxattr": 1, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_setxattr": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_call": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_watch": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_notify": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:01.609 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_other": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_active": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_send": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_resend": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ping": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_active": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_send": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_resend": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_active": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_send": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_resend": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_active": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_send": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_resend": 0, 2024-09-12T02:34:01.610 INFO:teuthology.orchestra.run.smithi001.stdout: "command_active": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "command_send": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "command_resend": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "map_epoch": 82, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "map_full": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "map_inc": 2, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_sessions": 5, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_open": 5, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_close": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_laggy": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_wr": 0, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_rd": 2, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_del": 0 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "oft": { 2024-09-12T02:34:01.611 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_objs": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_updates": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_removes": 0 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "osd-slow-ops": { 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_ops_count": 0 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "purge_queue": { 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:01.612 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 702, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 577309, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 702, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:01.613 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 702, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 577309, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:01.614 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 600, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 593, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 600, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 593, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 1024, 2024-09-12T02:34:01.615 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 600, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 600, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 600, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 600, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.616 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle-0x559256580b40": { 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:01.619 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:34:02.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:01 smithi134 ceph-mon[35091]: pgmap v435: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:02.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:01 smithi173 ceph-mon[35036]: pgmap v435: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:02.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:01 smithi001 ceph-mon[31252]: pgmap v435: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:02.518 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T02:34:02.518 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T02:34:02.518 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:34:02.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:34:02.781 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 98, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 95, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 443232, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 57296, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-12T02:34:03.335 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.016705480, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006138226, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.013052332, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 94, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.005427278, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000057737 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:03.336 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 443232, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 57296 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 72, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 91152, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:03.337 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.005971944, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.004173642, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001049515, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 70, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003171274, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000045303 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:03.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 91152 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-12T02:34:03.339 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.002390304, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000073258, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002320410, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004113711, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001371237 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:03.340 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:03.341 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:03.342 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:03.343 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148823, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 27, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:03.344 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-12T02:34:03.345 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 99, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 429413, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:03.346 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 99, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 99, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 429413, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:03.347 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:34:04.125 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T02:34:04.125 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T02:34:04.125 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:34:04.126 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:34:04.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:03 smithi001 ceph-mon[31252]: pgmap v436: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:04.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:03 smithi134 ceph-mon[35091]: pgmap v436: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:04.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:03 smithi173 ceph-mon[35036]: pgmap v436: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:04.383 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 301, 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 302, 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 101179, 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 95401, 2024-09-12T02:34:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 6, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.033023924, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.014037961, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.007283589, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.007713503, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 300, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.015062003, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000050206 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.884 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 529, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 595, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 138334, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 364001, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 5, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:04.885 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.037069983, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.011881967, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.011127445, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.011248902, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 594, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.021703356, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000036537 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 197312 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 106, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 102, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 467028, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 57541, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.015827824, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006657234, 2024-09-12T02:34:04.887 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.012614132, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000068334, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 101, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.006628063, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000065624 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 465680, 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 56576 2024-09-12T02:34:04.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 1, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-MDSRank": { 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 1416, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.032020301, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000022613 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.889 INFO:teuthology.orchestra.run.smithi001.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "queue_len": 0, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "complete_latency": { 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": { 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "request": 0, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "reply": 0, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "reply_latency": { 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.890 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_reply": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "forward": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_commit": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_split": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_merge": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_top": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_bottom": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:04.891 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_pinned": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_expired": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "subtrees": 1, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_hit": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_forward": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_discover": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "traverse_lock": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "load_cent": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "q": 0, 2024-09-12T02:34:04.892 INFO:teuthology.orchestra.run.smithi001.stdout: "exported": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "exported_inodes": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "imported": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "imported_inodes": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rfiles": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rbytes": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "root_rsnaps": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:04.893 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: "process_request_cap_release": 0 2024-09-12T02:34:04.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_cache": { 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_try_discover": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_send_discover": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_created": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_enqueued": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "strays_migrated": 0, 2024-09-12T02:34:04.895 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_started": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "recovery_completed": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_flush": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "ireq_inodestats": 0 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.896 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_log": { 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evlrg": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evadd": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evex": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evtrm": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "ev": 5, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evexg": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "evexd": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segadd": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segex": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segtrm": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "seg": 2, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segmjr": 2, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segexg": 0, 2024-09-12T02:34:04.897 INFO:teuthology.orchestra.run.smithi001.stdout: "segexd": 0, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "expos": 4194304, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "wrpos": 4195734, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "rdpos": 4195426, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "jlat": { 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "replayed": 5 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_mem": { 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "ino": 3, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "ino+": 3, 2024-09-12T02:34:04.898 INFO:teuthology.orchestra.run.smithi001.stdout: "ino-": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dir": 1, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dir+": 1, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dir-": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dn": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dn+": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "dn-": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "cap": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "cap+": 0, 2024-09-12T02:34:04.899 INFO:teuthology.orchestra.run.smithi001.stdout: "cap-": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "rss": 47924, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "heap": 215328 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_server": { 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_request": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_client_session": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "handle_peer_request": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "req_create_latency": { 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getattr_latency": { 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "req_link_latency": { 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookup_latency": { 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupino_latency": { 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupname_latency": { 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "req_lssnap_latency": { 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mkdir_latency": { 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mknod_latency": { 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.904 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "req_mksnap_latency": { 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "req_open_latency": { 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "req_readdir_latency": { 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.905 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rename_latency": { 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.906 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmdir_latency": { 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.907 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setattr_latency": { 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.908 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setlayout_latency": { 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "req_setxattr_latency": { 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "req_symlink_latency": { 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "req_unlink_latency": { 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:04.910 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_sessions": { 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "session_count": 1, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "session_add": 2, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "session_remove": 1, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_open": 1, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "sessions_stale": 0, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "total_load": 0, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "average_load": 0, 2024-09-12T02:34:04.911 INFO:teuthology.orchestra.run.smithi001.stdout: "avg_session_uptime": 1202, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:04.912 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:04.913 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 197359, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 53, 2024-09-12T02:34:04.914 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 158, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 8512, 2024-09-12T02:34:04.915 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 13, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "objecter": { 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_active": 0, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_laggy": 0, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send": 827, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_send_bytes": 21, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_resend": 3, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_reply": 827, 2024-09-12T02:34:04.916 INFO:teuthology.orchestra.run.smithi001.stdout: "op_latency": { 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 827, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.958987937, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001159598 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op_inflight": 0, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "oplen_avg": { 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 827, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 828 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op": 827, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op_r": 827, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op_w": 0, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op_rmw": 0, 2024-09-12T02:34:04.917 INFO:teuthology.orchestra.run.smithi001.stdout: "op_pg": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_stat": 519, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_create": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_read": 306, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_write": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writefull": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_writesame": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_append": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_zero": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_truncate": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_delete": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_mapext": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_getxattr": 1, 2024-09-12T02:34:04.918 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_setxattr": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_call": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_watch": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_notify": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "osdop_other": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_active": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_send": 0, 2024-09-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_resend": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "linger_ping": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_active": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_send": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolop_resend": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_active": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_send": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "poolstat_resend": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_active": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_send": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "statfs_resend": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "command_active": 0, 2024-09-12T02:34:04.920 INFO:teuthology.orchestra.run.smithi001.stdout: "command_send": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "command_resend": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "map_epoch": 82, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "map_full": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "map_inc": 2, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_sessions": 6, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_open": 6, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_session_close": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_laggy": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_wr": 0, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_rd": 2, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_del": 0 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "oft": { 2024-09-12T02:34:04.921 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_objs": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_updates": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "omap_total_removes": 0 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "osd-slow-ops": { 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "slow_ops_count": 0 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "purge_queue": { 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:04.922 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_executed": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 932, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 614379, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 932, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:04.923 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 932, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 614379, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:04.924 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 827, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 1435, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 827, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 1435, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:04.925 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 1024, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 827, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 827, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 827, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 827, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.926 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-12T02:34:04.927 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-write_buf_throttle-0x55d8344d4b40": { 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 3758096384, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:04.928 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:04.929 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:34:05.792 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T02:34:05.792 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T02:34:05.792 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:34:05.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:34:06.098 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:06.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:05 smithi001 ceph-mon[31252]: pgmap v437: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:06.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:05 smithi134 ceph-mon[35091]: pgmap v437: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:06.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:05 smithi173 ceph-mon[35036]: pgmap v437: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:06.643 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-12T02:34:06.643 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.001396184, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:34:06.644 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000247116, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:06.645 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 104, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 99, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 446768, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 59040, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-12T02:34:06.646 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.017428984, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.006668200, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.014187275, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 99, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.008916740, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000090068 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:06.647 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 446768, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 59040 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 74, 2024-09-12T02:34:06.648 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 91504, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.006709803, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.004775450, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001067278, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 72, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003333549, 2024-09-12T02:34:06.649 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000046299 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 91504 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-12T02:34:06.650 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:06.651 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:06.652 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:06.652 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:06.652 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:06.652 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:06.653 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:06.654 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:06.655 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148823, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 27, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:06.656 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:06.657 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-12T02:34:06.658 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 101, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 429673, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 101, 2024-09-12T02:34:06.659 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 101, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 429673, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-12T02:34:06.660 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-12T02:34:07.457 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:34:07.457 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:34:07.457 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:34:07.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:34:07.712 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:07 smithi134 ceph-mon[35091]: pgmap v438: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:07 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:34:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:07 smithi173 ceph-mon[35036]: pgmap v438: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:08.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:07 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1112, 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 850, 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 381771, 2024-09-12T02:34:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 891313, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 15, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 7, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.109752761, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.031151477, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.047565350, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.028168150, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 842, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.209856828, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000249236 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1035, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000214803, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000207 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 52128, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 29744 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 540, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 534, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 146389, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 400531, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 11, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-12T02:34:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.046833344, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.017127652, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.023813428, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.008110644, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 536, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.499325072, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000931576 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 362, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000080732, 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000223 2024-09-12T02:34:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 203472 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 900, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 797, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 701115, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 1106555, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 75, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 7, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.093819871, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.027970019, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.070587845, 2024-09-12T02:34:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.005988185, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 799, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.254151114, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000318086 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 904, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000184471, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000204 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 500208, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 66160 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 499, 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.101819835, 2024-09-12T02:34:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000204047 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 85, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002697529, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000031735 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 57, 2024-09-12T02:34:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 57, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 57, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.060281986, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001057578 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 58, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 25, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 5, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 20, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 17, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 2, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 2, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 2, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 88, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 79, 2024-09-12T02:34:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 69, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 69, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 41, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 5, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 36, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 28, 2024-09-12T02:34:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 1, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 26, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 44, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 100, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 67, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 5, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 28 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 6, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 1, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 6, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 5, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 2, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 29, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 5, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 155, 2024-09-12T02:34:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 126, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 126, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 29, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 13, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 12, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 11, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 11, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 1, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 1, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 1, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4639145, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4744856, 2024-09-12T02:34:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 129, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.267744841, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002075541 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 24, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 34, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 10, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 19, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 20, 2024-09-12T02:34:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 1, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 25, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 35, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 10, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 2, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 21, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 19, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 53192, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 231712 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 76, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 57, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 10, 2024-09-12T02:34:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.006802612, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000850326 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 15, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002814855, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000187657 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001576146, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000315229 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000214817, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000214817 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T02:34:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8, 2024-09-12T02:34:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.012232585, 2024-09-12T02:34:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001529073 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T02:34:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000202602, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000202602 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001321878, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000440626 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003312463, 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001656231 2024-09-12T02:34:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-12T02:34:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.007827312, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.003913656 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T02:34:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001151585, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001151585 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 7, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.017775615, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002539373 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 4, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.005049516, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001262379 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 19, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 19, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 199, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T02:34:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 302540, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 103, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 99170, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 727, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 962, 2024-09-12T02:34:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 623945, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 32, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 962, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 962, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 18.861529500, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.019606579 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 962, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1128 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 962, 2024-09-12T02:34:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 81, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 881, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 38, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 28, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 7, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 131, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 47, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T02:34:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 580, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 74, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 56, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T02:34:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T02:34:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-09-12T02:34:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 152, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 15 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 31 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 64, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 4, 2024-09-12T02:34:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 68, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 5, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 2548, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 983639, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 2548, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2548, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 983639, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 962, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 624450, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 962, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 624450, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 962, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 962, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 962, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 962, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 5, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 505, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 5, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 505, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55dff4634960": { 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 155, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 550552, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 155, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 129, 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 550552, 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:08.271 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T02:34:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:07 smithi001 ceph-mon[31252]: pgmap v438: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:08.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:08.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:07 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' 2024-09-12T02:34:09.153 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-12T02:34:09.154 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T02:34:09.154 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:34:09.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:34:09.400 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:34:09.929 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T02:34:09.929 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:09.929 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 687, 2024-09-12T02:34:09.929 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 689, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 752505, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 218476, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 6, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.060634551, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.023881284, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.014570795, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.016086494, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 687, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.024580940, 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000035780 2024-09-12T02:34:09.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 9, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 79, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 4808, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 200970, 2024-09-12T02:34:09.931 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.007425333, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.003096676, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.003441478, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000091993, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 78, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.012207319, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000156504 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.932 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 199632 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 410, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 406, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 541291, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 155333, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:09.933 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.040853585, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013952536, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.020574869, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.009157380, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 405, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.014685799, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000036261 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.934 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 466928, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 59296 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1669, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.039094576, 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000023423 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T02:34:09.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 21, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 4, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 17, 2024-09-12T02:34:09.937 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 14, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 2, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T02:34:09.938 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:09.939 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-12T02:34:09.940 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-12T02:34:09.941 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:09.942 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 155, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T02:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 12, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4639145, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4744856, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 4744257, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 155 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.944 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 15, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 20, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 5, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 10, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 11, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 1, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 21, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 25, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 4, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 47404, 2024-09-12T02:34:09.945 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215328 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.947 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.950 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.951 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T02:34:09.954 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.955 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.956 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1422, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.958 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:09.959 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 189293, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 50, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 61410, 2024-09-12T02:34:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 366, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 993, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 26, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 4, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 993, 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T02:34:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 993, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.393990165, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000396767 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 993, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 994 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 993, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 993, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T02:34:09.964 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 606, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 384, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:09.965 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 2, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T02:34:09.966 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T02:34:09.967 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 5, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 5, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T02:34:09.968 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-12T02:34:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 1102, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1190888, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 1102, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1102, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1190888, 2024-09-12T02:34:09.970 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:09.971 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 993, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 550562, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 993, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 550562, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T02:34:09.972 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 993, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 993, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 993, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 993, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T02:34:09.974 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55802d890b40": { 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:09.975 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T02:34:10.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:09 smithi134 ceph-mon[35091]: pgmap v439: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:10.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:09 smithi173 ceph-mon[35036]: pgmap v439: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:10.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:09 smithi001 ceph-mon[31252]: pgmap v439: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:10.704 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T02:34:10.704 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T02:34:10.704 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:34:10.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:34:10.948 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:34:11.473 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T02:34:11.473 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:11.473 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 53, 2024-09-12T02:34:11.473 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 55, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 19050, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 192652, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 25, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.012555468, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.001317458, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.008417348, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000356239, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 53, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.021696310, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000409364 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.474 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 51, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000008534, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000167 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 736 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 176, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 164, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 508315, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 111229, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 9, 2024-09-12T02:34:11.475 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.023102725, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.007819179, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.019247559, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000348830, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 164, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.025768497, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000157124 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 28, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000005808, 2024-09-12T02:34:11.476 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000207 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 493232, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 63424 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 172, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 313, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 55214, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 272550, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 8, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.030650425, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.015011346, 2024-09-12T02:34:11.477 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.012814519, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.001515281, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 311, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.024433612, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000078564 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 393, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000111453, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000283 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 200624 2024-09-12T02:34:11.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 52, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001111901, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000021382 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:11.479 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000029531, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000014765 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.480 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 11, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 10, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 10, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 10, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-12T02:34:11.481 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 1, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 4, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 4, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-12T02:34:11.482 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 8, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 269505890, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:11.483 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:11.484 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 1, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:11.485 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 2, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 2, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 4, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 4, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T02:34:11.487 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4195426, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.005324832, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001774944 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 13, 2024-09-12T02:34:11.488 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 13, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 0, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 11, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 12, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 1, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 10, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 10, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 0, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 48944, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223520 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T02:34:11.489 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 4, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.490 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.492 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.493 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T02:34:11.494 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.495 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:11.496 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.497 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.498 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T02:34:11.500 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.501 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 0, 2024-09-12T02:34:11.502 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 73, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:11.503 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:11.504 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:11.505 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 254199, 2024-09-12T02:34:11.506 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 83, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:11.507 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 50872, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 198, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T02:34:11.508 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 38, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 11334, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 31, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 38, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 38, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.214994677, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.005657754 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T02:34:11.509 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 38, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 60 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 38, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 0, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 38, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-09-12T02:34:11.510 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 0, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 3, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 6, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 6, 2024-09-12T02:34:11.511 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T02:34:11.512 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T02:34:11.513 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 8, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 8, 2024-09-12T02:34:11.514 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 14, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 1 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.515 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 4 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.516 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 397, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 536679, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 397, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 397, 2024-09-12T02:34:11.517 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 536679, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:11.518 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 38, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 11334, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 38, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 11334, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.519 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:11.520 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 38, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 38, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 38, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 38, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.521 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T02:34:11.522 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x565166054960": { 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 4, 2024-09-12T02:34:11.523 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1122, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 4, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1122, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:11.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:11.525 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T02:34:12.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:11 smithi134 ceph-mon[35091]: pgmap v440: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:12.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:11 smithi173 ceph-mon[35036]: pgmap v440: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:12.256 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T02:34:12.256 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T02:34:12.256 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:34:12.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:34:12.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:11 smithi001 ceph-mon[31252]: pgmap v440: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:12.502 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:34:13.008 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 420, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 416, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 572240, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 159976, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.052911772, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.021782558, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.023341013, 2024-09-12T02:34:13.009 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.008949137, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 415, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.023107269, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000055680 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 468752, 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 62032 2024-09-12T02:34:13.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 7, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 80, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 3708, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 202474, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.007601950, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.003359553, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.003352629, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000067453, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 79, 2024-09-12T02:34:13.011 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.009751857, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000123441 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 201776 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 518, 2024-09-12T02:34:13.012 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 520, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 133897, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 164731, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.033766312, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.008900309, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.009816710, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.012609690, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 518, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.015890837, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000030677 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.013 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-12T02:34:13.014 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1434, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.034549164, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000024092 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:13.016 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 1, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-09-12T02:34:13.017 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:13.020 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:34:13.021 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 3, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-12T02:34:13.022 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4195200, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 4194892, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 3 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 3, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 3, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 1, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 1, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-12T02:34:13.024 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 47796, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215328 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.028 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.029 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-12T02:34:13.030 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.031 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.033 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.034 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:13.035 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 0, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-12T02:34:13.036 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1427, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:13.037 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:13.038 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:13.039 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 181159, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 44, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:13.040 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 8512, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 13, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-12T02:34:13.041 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 828, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 21, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 3, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 828, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 828, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.439989011, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000531387 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 828, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 829 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.042 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 828, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 828, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 513, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 313, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-12T02:34:13.043 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 1, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-12T02:34:13.044 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-12T02:34:13.045 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 4, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 4, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-09-12T02:34:13.046 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:13.047 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 941, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 616418, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:13.048 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 941, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 941, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 616418, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-12T02:34:13.049 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 828, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 901, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 828, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 901, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 828, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 828, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 828, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 828, 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:13.051 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:13.052 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x560523a88b40": { 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-12T02:34:13.053 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-12T02:34:13.054 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-12T02:34:13.684 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T02:34:13.684 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T02:34:13.684 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:34:13.685 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:34:13.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:13 smithi134 ceph-mon[35091]: pgmap v441: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:13.942 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:13.999 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:13 smithi173 ceph-mon[35036]: pgmap v441: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:14.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:13 smithi001 ceph-mon[31252]: pgmap v441: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 55, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 55, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 27811, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 80456, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 14, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-09-12T02:34:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.010287145, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.001951602, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.005953543, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000558643, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 55, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.024127895, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000438689 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 58, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000011168, 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000192 2024-09-12T02:34:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 174, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 162, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 503210, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 81350, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.024200124, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.008248667, 2024-09-12T02:34:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.021465405, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000446065, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 164, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.025813200, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000157397 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 33, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000012945, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000392 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 488624, 2024-09-12T02:34:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 64384 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 168, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 315, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 46769, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 407059, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 20, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 8, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.033228975, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.012445465, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.016815659, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.002233809, 2024-09-12T02:34:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 309, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.020950811, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000067801 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 375, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000108540, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000289 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 202416 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 42, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001511384, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000035985 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000007019, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000003509 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 11, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 10, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 10, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 10, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T02:34:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 4, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 4, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T02:34:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 8, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 269505890, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T02:34:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 1, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 2, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 2, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T02:34:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 2, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 2, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 2, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 2, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T02:34:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 4194892, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001291323, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001291323 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 13, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 13, 2024-09-12T02:34:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 11, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 12, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 1, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 10, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 10, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 0, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 52800, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-12T02:34:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 237959, 2024-09-12T02:34:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 75, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 50872, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 198, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 35, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 10710, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 33, 2024-09-12T02:34:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 35, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 35, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.197995480, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005657013 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 35, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 57 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 35, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 0, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 35, 2024-09-12T02:34:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 5, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 6, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T02:34:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T02:34:14.518 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 82, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 14, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 1 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-12T02:34:14.519 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 4 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T02:34:14.520 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 393, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 532372, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 393, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 393, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 532372, 2024-09-12T02:34:14.521 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 35, 2024-09-12T02:34:14.522 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 10710, 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 35, 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 10710, 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.523 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 35, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 35, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 35, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 35, 2024-09-12T02:34:14.524 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:14.525 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55fc4ab90960": { 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:14.526 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 588, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 588, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:14.527 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T02:34:15.391 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:34:15.391 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T02:34:15.391 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:34:15.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:34:15.644 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:16.109 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:15 smithi173 ceph-mon[35036]: pgmap v442: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:16.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:15 smithi134 ceph-mon[35091]: pgmap v442: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 349, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 389, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 548915, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 171318, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 9, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.048952277, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.017644220, 2024-09-12T02:34:16.213 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.031927931, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.002552605, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 389, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.034141026, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000087766 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 433, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000136509, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000315 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 481952, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 64864 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.214 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 52, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 123, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 27129, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 261108, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 11, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.011462752, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.004941036, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.005932986, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000198294, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 123, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.021482842, 2024-09-12T02:34:16.215 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000174657 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 76, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000015077, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000198 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 204032 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 38, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 42, 2024-09-12T02:34:16.216 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 8217, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 181431, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 23, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 7, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.010946115, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.001440708, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.008328453, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000470752, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 38, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.019077848, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000502048 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:16.217 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 22, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000003162, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000143 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 52, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001334162, 2024-09-12T02:34:16.218 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000025656 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000009075, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000004537 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 3, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 2, 2024-09-12T02:34:16.219 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000380902, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000190451 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 1, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 11, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 11, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 11, 2024-09-12T02:34:16.220 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 10, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 1, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 1, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 8, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 6, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 1, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T02:34:16.221 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 1000, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 1, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 8, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 269505890, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:16.222 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 1, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 1, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:16.223 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 1 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 2, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T02:34:16.224 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 2, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 4, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:16.225 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 5, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 5, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 2, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 2, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T02:34:16.226 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 4195734, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007613685, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001903421 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 14, 2024-09-12T02:34:16.227 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 14, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 12, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 13, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 1, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 11, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 11, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 0, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 1, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 2, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 1, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 52420, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.228 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 4, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 3, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 7, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T02:34:16.229 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000222228, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000222228 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.230 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000158674, 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000158674 2024-09-12T02:34:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.232 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T02:34:16.233 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.234 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.236 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.237 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 2, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 1, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 1, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 183, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:16.242 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:16.243 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 255107, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 91, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T02:34:16.244 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 55440, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 214, 2024-09-12T02:34:16.245 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 40, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 11732, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 28, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 40, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 40, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.221994964, 2024-09-12T02:34:16.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005549874 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 40, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 62 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 40, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 0, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 40, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-12T02:34:16.247 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 4, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 7, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 6, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:16.248 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T02:34:16.249 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 82, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-09-12T02:34:16.250 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 9, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 9, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 14, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 1 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 6 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:16.252 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 435, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 535016, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 435, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 435, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 535016, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.253 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 40, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 11732, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 40, 2024-09-12T02:34:16.254 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 11732, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:16.255 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 40, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 40, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 40, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 40, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:16.256 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x5604d3176960": { 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 5, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 1430, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 5, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1430, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:16.258 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:16.259 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:16.259 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.259 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:16.259 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T02:34:16.376 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:15 smithi001 ceph-mon[31252]: pgmap v442: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:34:16.959 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:34:16.959 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:34:16.959 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:34:16.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:34:17.206 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T02:34:17.879 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:17.880 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 282, 2024-09-12T02:34:17.880 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 299, 2024-09-12T02:34:17.880 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 88016, 2024-09-12T02:34:17.880 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 106770, 2024-09-12T02:34:17.880 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 10, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.034771461, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.011318337, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.018754413, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.002569285, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 298, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.034846802, 2024-09-12T02:34:17.881 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000116935 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 527, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000126678, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000240 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:17.882 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 185, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 178, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 512102, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 134352, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 12, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.026768377, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009538967, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.021300712, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000244685, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 177, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.024748487, 2024-09-12T02:34:17.883 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000139821 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 54, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000013341, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000247 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 494912, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 64416 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 42, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 113, 2024-09-12T02:34:17.884 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 16581, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 371185, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 20, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.014607192, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.004433680, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.007384034, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.001500591, 2024-09-12T02:34:17.885 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 111, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.013916024, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000125369 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 44, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000040939, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000930 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 202240 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 34, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001907214, 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000056094 2024-09-12T02:34:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000135097, 2024-09-12T02:34:17.888 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000067548 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 2, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 1, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000888506, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000888506 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T02:34:17.889 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 1, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 11, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 14, 2024-09-12T02:34:17.890 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 14, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 14, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 1, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 1, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 7, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 5, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 1, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:17.891 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 1000, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 1, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 8, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 269505890, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-12T02:34:17.892 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 4, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 5, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:17.893 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 1 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 2, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:17.894 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 2, 2024-09-12T02:34:17.895 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 10, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 3, 2024-09-12T02:34:17.896 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 3, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 2, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 2, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T02:34:17.897 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 4195200, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.003447974, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001723987 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 17, 2024-09-12T02:34:17.898 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 17, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 15, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 16, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 1, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 14, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 14, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 0, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 1, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 1, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 50988, 2024-09-12T02:34:17.899 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 3, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 2, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 3, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.900 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000888506, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000888506 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.902 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T02:34:17.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.905 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.905 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.905 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T02:34:17.905 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T02:34:17.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.909 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.910 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:17.912 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T02:34:17.913 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 1, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 1, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 210, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:17.914 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:17.915 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:17.916 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:17.917 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:17.917 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:17.917 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:17.917 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T02:34:17.917 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 246511, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 81, 2024-09-12T02:34:17.918 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:17.919 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:17.919 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T02:34:17.919 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T02:34:17.919 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:17.919 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:17.920 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:17.920 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:17.920 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:17.920 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-09-12T02:34:17.920 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 68037, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 288, 2024-09-12T02:34:17.921 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:17.922 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T02:34:17.922 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:17.922 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T02:34:17.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.922 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 41, 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 11710, 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 32, 2024-09-12T02:34:17.923 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 41, 2024-09-12T02:34:17.924 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T02:34:17.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 41, 2024-09-12T02:34:17.924 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.237994591, 2024-09-12T02:34:17.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005804746 2024-09-12T02:34:17.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 41, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 67 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 41, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 0, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 41, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T02:34:17.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 2, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 6, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 6, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:17.926 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T02:34:17.927 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T02:34:17.928 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 82, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 9, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 9, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 21, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 2 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.929 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 12 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:17.930 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 505, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 561009, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 505, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:17.931 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 505, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 561009, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:17.932 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 41, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 11710, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 41, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 11710, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:17.933 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 41, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 41, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 41, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 41, 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:17.934 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:17.935 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55cb0838e960": { 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 3, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 896, 2024-09-12T02:34:17.936 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 3, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 896, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T02:34:18.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:17 smithi134 ceph-mon[35091]: pgmap v443: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:18.178 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:17 smithi001 ceph-mon[31252]: pgmap v443: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:18.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:17 smithi173 ceph-mon[35036]: pgmap v443: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-12T02:34:18.703 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T02:34:18.703 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-12T02:34:18.703 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:34:18.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:34:18.948 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 115, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 111, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 470130, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 63636, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.019108310, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.007481269, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.015948936, 2024-09-12T02:34:19.466 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000019814, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 110, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007895237, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000071774 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 469296, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 63312 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:34:19.467 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 242, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 316, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 61476, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 277323, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.030988331, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009869328, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.008641365, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.009449154, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 315, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.019756223, 2024-09-12T02:34:19.468 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000062718 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 201952 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 633, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 635, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 190223, 2024-09-12T02:34:19.469 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 201352, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.063434263, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.019584062, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.017483888, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.020647368, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 633, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.026759541, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000042274 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:34:19.470 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:19.471 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1454, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.043333466, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000029802 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T02:34:19.472 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T02:34:19.473 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T02:34:19.474 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-09-12T02:34:19.475 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:34:19.476 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T02:34:19.477 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T02:34:19.478 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 4, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T02:34:19.479 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 2, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 4195426, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 4195285, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 4 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T02:34:19.480 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 3, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 3, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 1, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 1, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 48752, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215328 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-12T02:34:19.481 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.482 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T02:34:19.483 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.484 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.485 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T02:34:19.486 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.487 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.488 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.490 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.491 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:34:19.492 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 0, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-12T02:34:19.493 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1195, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:34:19.494 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:34:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:34:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 189217, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 48, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7688, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:34:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 8512, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 13, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 871, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-09-12T02:34:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 871, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 871, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.428990218, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000492526 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 871, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 872 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 871, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 871, 2024-09-12T02:34:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 549, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 320, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T02:34:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T02:34:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T02:34:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 82, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 5, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 5, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-09-12T02:34:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T02:34:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 986, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 624248, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 986, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 986, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 624248, 2024-09-12T02:34:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 871, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 1127, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 871, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1127, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 871, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 871, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 871, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 871, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55dcc74c0b40": { 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T02:34:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T02:34:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T02:34:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T02:34:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T02:34:19.511 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T02:34:20.160 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:19 smithi173 ceph-mon[35036]: pgmap v444: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:20.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:19 smithi134 ceph-mon[35091]: pgmap v444: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:20.187 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T02:34:20.187 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T02:34:20.187 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:34:20.204 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:34:20.204 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:34:20.204 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:20.227 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-12T02:34:20.227 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:34:20.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:34:20.356 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:19 smithi001 ceph-mon[31252]: pgmap v444: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:34:20.600 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 -- 172.21.15.1:0/362554258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c112b90 msgr2=0x7fce4c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 --2- 172.21.15.1:0/362554258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c112b90 0x7fce4c114f80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ca0 tx=0x7fce4402a950 comp rx=0 tx=0).stop 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 -- 172.21.15.1:0/362554258 shutdown_connections 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 --2- 172.21.15.1:0/362554258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c112b90 0x7fce4c114f80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 --2- 172.21.15.1:0/362554258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c074eb0 0x7fce4c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 --2- 172.21.15.1:0/362554258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 -- 172.21.15.1:0/362554258 >> 172.21.15.1:0/362554258 conn(0x7fce4c0fd8c0 msgr2=0x7fce4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 -- 172.21.15.1:0/362554258 shutdown_connections 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.147+0000 7fce53877640 1 -- 172.21.15.1:0/362554258 wait complete. 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 Processor -- start 2024-09-12T02:34:21.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 -- start start 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c112b90 0x7fce4c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c118560 con 0x7fce4c074eb0 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1183e0 con 0x7fce4c112b90 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce53877640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1186e0 con 0x7fce4c074590 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce50e12640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce50e12640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34116/0 (socket says 172.21.15.1:34116) 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce50e12640 1 -- 172.21.15.1:0/2948963173 learned_addr learned my addr 172.21.15.1:0/2948963173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.148+0000 7fce51613640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 -- 172.21.15.1:0/2948963173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 msgr2=0x7fce4c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce51e14640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c112b90 0x7fce4c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 -- 172.21.15.1:0/2948963173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c112b90 msgr2=0x7fce4c19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c112b90 0x7fce4c19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 -- 172.21.15.1:0/2948963173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c19efc0 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce51613640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce50e12640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00d950 tx=0x7fce3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c017070 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce3c009c30 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c19f2b0 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00f6b0 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.149+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1ab5a0 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.150+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce4c074970 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.151+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fce3c0109d0 con 0x7fce4c074eb0 2024-09-12T02:34:21.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.152+0000 7fce427fc640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 0x7fce380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:21.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.152+0000 7fce51613640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 0x7fce380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:21.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.152+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fce3c0ced00 con 0x7fce4c074eb0 2024-09-12T02:34:21.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.152+0000 7fce51613640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 0x7fce380a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fce480058c0 tx=0x7fce48005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:21.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.156+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce3c009de0 con 0x7fce4c074eb0 2024-09-12T02:34:21.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.345+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce4c1ab890 con 0x7fce4c074eb0 2024-09-12T02:34:21.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.346+0000 7fce427fc640 1 -- 172.21.15.1:0/2948963173 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+578 (secure 0 0 0) 0x7fce3c09bbe0 con 0x7fce4c074eb0 2024-09-12T02:34:21.346 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/556592053 2024-09-13T02:21:53.871193+0000 2024-09-12T02:34:21.346 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3443797048 2024-09-13T02:21:53.871193+0000 2024-09-12T02:34:21.346 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/556592053 2024-09-13T02:21:53.871193+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2237441020 2024-09-13T02:21:29.692093+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3479905526 2024-09-13T02:21:29.692093+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3977745193 2024-09-13T02:21:53.871193+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3479905526 2024-09-13T02:21:29.692093+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/434649045 2024-09-13T02:21:29.692093+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3314773164 2024-09-13T02:21:53.871193+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/331955324 2024-09-13T02:21:29.692093+0000 2024-09-12T02:34:21.347 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-12T02:34:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 msgr2=0x7fce380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 0x7fce380a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fce480058c0 tx=0x7fce48005d50 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 msgr2=0x7fce4c1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00d950 tx=0x7fce3c00de10 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 shutdown_connections 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7fce380a2b80 0x7fce380a5040 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce4c074eb0 0x7fce4c1a4c10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce4c112b90 0x7fce4c19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 --2- 172.21.15.1:0/2948963173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce4c074590 0x7fce4c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 >> 172.21.15.1:0/2948963173 conn(0x7fce4c0fd8c0 msgr2=0x7fce4c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 shutdown_connections 2024-09-12T02:34:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:21.348+0000 7fce53877640 1 -- 172.21.15.1:0/2948963173 wait complete. 2024-09-12T02:34:22.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:21 smithi001 ceph-mon[31252]: pgmap v445: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:22.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:21 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2948963173' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:34:22.141 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:34:22.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:22.142 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:34:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:21 smithi134 ceph-mon[35091]: pgmap v445: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:22.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:21 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2948963173' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:34:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:21 smithi173 ceph-mon[35036]: pgmap v445: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T02:34:22.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:21 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2948963173' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:34:22.225 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:34:22.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:22.225 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:34:22.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:22.288 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-12T02:34:22.345 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:34:22.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:22.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:34:22.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:34:22.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-12T02:34:22.506 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:34:22.517 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:34:22.517 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:34:22.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:22.778 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 -- 172.21.15.1:0/2864778291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340102ef0 msgr2=0x7f134010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 --2- 172.21.15.1:0/2864778291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340102ef0 0x7f134010da40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1338009ca0 tx=0x7f133802a950 comp rx=0 tx=0).stop 2024-09-12T02:34:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 -- 172.21.15.1:0/2864778291 shutdown_connections 2024-09-12T02:34:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 --2- 172.21.15.1:0/2864778291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340102ef0 0x7f134010da40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 --2- 172.21.15.1:0/2864778291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102570 0x7f13401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 --2- 172.21.15.1:0/2864778291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340100e20 0x7f1340101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 -- 172.21.15.1:0/2864778291 >> 172.21.15.1:0/2864778291 conn(0x7f13400fc7d0 msgr2=0x7f13400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 -- 172.21.15.1:0/2864778291 shutdown_connections 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.249+0000 7f13480fb640 1 -- 172.21.15.1:0/2864778291 wait complete. 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 Processor -- start 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 -- start start 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 0x7f1340199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 0x7f13401a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1340110f80 con 0x7f1340100e20 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1340110e00 con 0x7f1340102570 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f13480fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1340111100 con 0x7f1340102ef0 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1345e97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1345e97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34138/0 (socket says 172.21.15.1:34138) 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1345e97640 1 -- 172.21.15.1:0/2216929914 learned_addr learned my addr 172.21.15.1:0/2216929914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1345696640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 0x7f1340199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1345e97640 1 -- 172.21.15.1:0/2216929914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 msgr2=0x7f13401a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.250+0000 7f1346698640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 0x7f13401a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345e97640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 0x7f13401a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345e97640 1 -- 172.21.15.1:0/2216929914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 msgr2=0x7f1340199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345e97640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 0x7f1340199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345e97640 1 -- 172.21.15.1:0/2216929914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13401a48b0 con 0x7f1340100e20 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345696640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 0x7f1340199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1346698640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 0x7f13401a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1345e97640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e9f0 tx=0x7f133c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c00cd80 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f133c010910 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13401a4a80 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c018990 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.251+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13401a4f90 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.252+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1340101200 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.253+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f133c010ac0 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.254+0000 7f1336ffd640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 0x7f132c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.254+0000 7f1345696640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 0x7f132c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.254+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f133c0cf900 con 0x7f1340100e20 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.254+0000 7f1345696640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 0x7f132c0a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f134006aac0 tx=0x7f1330005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.257+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f133c09c7e0 con 0x7f1340100e20 2024-09-12T02:34:23.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.468+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13401a51c0 con 0x7f1340100e20 2024-09-12T02:34:23.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.469+0000 7f1336ffd640 1 -- 172.21.15.1:0/2216929914 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7f133c09c0e0 con 0x7f1340100e20 2024-09-12T02:34:23.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:34:23.469 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:34:23.470 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:34:23.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 msgr2=0x7f132c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 0x7f132c0a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f134006aac0 tx=0x7f1330005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:23.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 msgr2=0x7f13401992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:23.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e9f0 tx=0x7f133c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 shutdown_connections 2024-09-12T02:34:23.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f132c0a2b80 0x7f132c0a5040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1340102ef0 0x7f13401a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1340102570 0x7f1340199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 --2- 172.21.15.1:0/2216929914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1340100e20 0x7f13401992f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 >> 172.21.15.1:0/2216929914 conn(0x7f13400fc7d0 msgr2=0x7f1340106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 shutdown_connections 2024-09-12T02:34:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:23.471+0000 7f13480fb640 1 -- 172.21.15.1:0/2216929914 wait complete. 2024-09-12T02:34:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:23 smithi134 ceph-mon[35091]: pgmap v446: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:24.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:23 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2216929914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:24.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:23 smithi173 ceph-mon[35036]: pgmap v446: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:24.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:23 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2216929914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:24.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:23 smithi001 ceph-mon[31252]: pgmap v446: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T02:34:24.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:23 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2216929914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:24.291 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:25.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/1204394331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa081002f0 msgr2=0x7ffa081006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/1204394331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa081002f0 0x7ffa081006d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009930 tx=0x7ff9fc02a420 comp rx=0 tx=0).stop 2024-09-12T02:34:25.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/1204394331 shutdown_connections 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/1204394331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 0x7ffa0810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/1204394331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa08100ca0 0x7ffa08106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/1204394331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa081002f0 0x7ffa081006d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/1204394331 >> 172.21.15.1:0/1204394331 conn(0x7ffa08077210 msgr2=0x7ffa080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/1204394331 shutdown_connections 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.050+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/1204394331 wait complete. 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 Processor -- start 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 -- start start 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 0x7ffa081984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 0x7ffa0819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08112000 con 0x7ffa08100ca0 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08111e80 con 0x7ffa081002f0 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ecf0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08112180 con 0x7ffa08106f50 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34158/0 (socket says 172.21.15.1:34158) 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 -- 172.21.15.1:0/2605902595 learned_addr learned my addr 172.21.15.1:0/2605902595 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0d28d640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 0x7ffa0819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ca8c640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 0x7ffa081984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 -- 172.21.15.1:0/2605902595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 msgr2=0x7ffa0819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 0x7ffa0819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 -- 172.21.15.1:0/2605902595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 msgr2=0x7ffa081984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 0x7ffa081984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa07fff640 1 -- 172.21.15.1:0/2605902595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0819d490 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.051+0000 7ffa0ca8c640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 0x7ffa081984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa07fff640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400b450 tx=0x7ff9f400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4015020 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0819d780 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9f4011d70 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400f340 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.052+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa081a5060 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.053+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa081006d0 con 0x7ffa08100ca0 2024-09-12T02:34:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.054+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff9f4018020 con 0x7ffa08100ca0 2024-09-12T02:34:25.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.055+0000 7ffa05ffb640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 0x7ff9f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.055+0000 7ffa0ca8c640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 0x7ff9f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.055+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7ff9f40ceb20 con 0x7ffa08100ca0 2024-09-12T02:34:25.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.055+0000 7ffa0ca8c640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 0x7ff9f80a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc000c00 tx=0x7ff9fc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.059+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9f401f020 con 0x7ffa08100ca0 2024-09-12T02:34:25.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.271+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa0802d7c0 con 0x7ffa08100ca0 2024-09-12T02:34:25.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.272+0000 7ffa05ffb640 1 -- 172.21.15.1:0/2605902595 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11961 (secure 0 0 0) 0x7ff9f400d040 con 0x7ffa08100ca0 2024-09-12T02:34:25.273 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:34:25.273 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-12T02:30:48:729185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1949670850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1949670850},{"type":"v1","addr":"172.21.15.1:6835","nonce":1949670850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/732674726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":732674726},{"type":"v1","addr":"172.21.15.1:6837","nonce":732674726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:28:52.748371+0000","modified":"2024-09-12T02:30:48.047449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24470,"mds_3":24457,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6839/1207631170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1207631170},{"type":"v1","addr":"172.21.15.1:6839","nonce":1207631170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.1:6841/2292917282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2292917282},{"type":"v1","addr":"172.21.15.1:6841","nonce":2292917282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24415":{"gid":24415,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/743947684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":743947684},{"type":"v1","addr":"172.21.15.173:6833","nonce":743947684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/1137270315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1137270315},{"type":"v1","addr":"172.21.15.134:6833","nonce":1137270315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4061904482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4061904482},{"type":"v1","addr":"172.21.15.134:6835","nonce":4061904482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.173:6835/7391882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":7391882},{"type":"v1","addr":"172.21.15.173:6835","nonce":7391882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/2489188498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2489188498},{"type":"v1","addr":"172.21.15.173:6837","nonce":2489188498}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2931886461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2931886461},{"type":"v1","addr":"172.21.15.134:6837","nonce":2931886461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/3274926052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":3274926052},{"type":"v1","addr":"172.21.15.173:6839","nonce":3274926052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/3689768435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":3689768435},{"type":"v1","addr":"172.21.15.134:6839","nonce":3689768435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24451,24457,24470,24475,24494]},"id":1}]} 2024-09-12T02:34:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 msgr2=0x7ff9f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 0x7ff9f80a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc000c00 tx=0x7ff9fc032d50 comp rx=0 tx=0).stop 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 msgr2=0x7ffa08198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400b450 tx=0x7ff9f400b910 comp rx=0 tx=0).stop 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 shutdown_connections 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff9f80a2b80 0x7ff9f80a5040 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa08100ca0 0x7ffa08198a20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa08106f50 0x7ffa0819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 --2- 172.21.15.1:0/2605902595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa081002f0 0x7ffa081984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.274+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 >> 172.21.15.1:0/2605902595 conn(0x7ffa08077210 msgr2=0x7ffa08105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.275+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 shutdown_connections 2024-09-12T02:34:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:25.275+0000 7ffa0ecf0640 1 -- 172.21.15.1:0/2605902595 wait complete. 2024-09-12T02:34:26.074 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:25 smithi001 ceph-mon[31252]: pgmap v447: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:34:26.074 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:25 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2605902595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:26.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:34:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:25 smithi134 ceph-mon[35091]: pgmap v447: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:34:26.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:25 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2605902595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:25 smithi173 ceph-mon[35036]: pgmap v447: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T02:34:26.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:25 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2605902595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 -- 172.21.15.1:0/2674259320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8106f10 msgr2=0x7feee810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 --2- 172.21.15.1:0/2674259320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8106f10 0x7feee810ea90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feee0009ca0 tx=0x7feee002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 -- 172.21.15.1:0/2674259320 shutdown_connections 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 --2- 172.21.15.1:0/2674259320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8106f10 0x7feee810ea90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 --2- 172.21.15.1:0/2674259320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 0x7feee81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 --2- 172.21.15.1:0/2674259320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8101de0 0x7feee81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 -- 172.21.15.1:0/2674259320 >> 172.21.15.1:0/2674259320 conn(0x7feee80fd8c0 msgr2=0x7feee80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 -- 172.21.15.1:0/2674259320 shutdown_connections 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.867+0000 7feeedec3640 1 -- 172.21.15.1:0/2674259320 wait complete. 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 Processor -- start 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 -- start start 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 0x7feee819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8106f10 0x7feee819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feee8111f70 con 0x7feee8101de0 2024-09-12T02:34:26.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feee8111df0 con 0x7feee8106f10 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feeedec3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feee81120f0 con 0x7feee8102790 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.868+0000 7feee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34166/0 (socket says 172.21.15.1:34166) 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 -- 172.21.15.1:0/1739487365 learned_addr learned my addr 172.21.15.1:0/1739487365 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee6ffd640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 0x7feee819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee7fff640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8106f10 0x7feee819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 -- 172.21.15.1:0/1739487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 msgr2=0x7feee819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 0x7feee819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 -- 172.21.15.1:0/1739487365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8106f10 msgr2=0x7feee819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8106f10 0x7feee819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 -- 172.21.15.1:0/1739487365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee819f5e0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee77fe640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feed800d950 tx=0x7feed800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8017070 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feed8009c30 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee819f8d0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed800f6b0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.869+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a71b0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.870+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee81021c0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.872+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7feed80109d0 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.872+0000 7feee4ff9640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 0x7feed40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.873+0000 7feee6ffd640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 0x7feed40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.873+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7feed80cec50 con 0x7feee8101de0 2024-09-12T02:34:26.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.873+0000 7feee6ffd640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 0x7feed40a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feee80fddc0 tx=0x7feed000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:26.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:26.875+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feed8009de0 con 0x7feee8101de0 2024-09-12T02:34:27.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.051+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee81a73b0 con 0x7feee8101de0 2024-09-12T02:34:27.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.053+0000 7feee4ff9640 1 -- 172.21.15.1:0/1739487365 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22699 (secure 0 0 0) 0x7feed809b4e0 con 0x7feee8101de0 2024-09-12T02:34:27.054 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-12T02:34:27.054 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":82,"fsid":"877143dc-70ad-11ef-bcea-c7b262605968","created":"2024-09-12T02:21:05.451779+0000","modified":"2024-09-12T02:29:55.578131+0000","last_up_change":"2024-09-12T02:27:59.698018+0000","last_in_change":"2024-09-12T02:27:36.063371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:24:10.372859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:28:48.794744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:28:50.955400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f91edd80-c796-47b3-a871-e6ebadc51a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6803","nonce":2377919946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6805","nonce":2377919946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6809","nonce":2377919946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2377919946},{"type":"v1","addr":"172.21.15.1:6807","nonce":2377919946}]},"public_addr":"172.21.15.1:6803/2377919946","cluster_addr":"172.21.15.1:6805/2377919946","heartbeat_back_addr":"172.21.15.1:6809/2377919946","heartbeat_front_addr":"172.21.15.1:6807/2377919946","state":["exists","up"]},{"osd":1,"uuid":"32978f3c-0f78-4c37-97a5-9dbb4297a1fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6801","nonce":3734137838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6803","nonce":3734137838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6807","nonce":3734137838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3734137838},{"type":"v1","addr":"172.21.15.134:6805","nonce":3734137838}]},"public_addr":"172.21.15.134:6801/3734137838","cluster_addr":"172.21.15.134:6803/3734137838","heartbeat_back_addr":"172.21.15.134:6807/3734137838","heartbeat_front_addr":"172.21.15.134:6805/3734137838","state":["exists","up"]},{"osd":2,"uuid":"47693d9e-18db-46ef-9f0d-a712049351bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6801","nonce":396057210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6803","nonce":396057210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6807","nonce":396057210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":396057210},{"type":"v1","addr":"172.21.15.173:6805","nonce":396057210}]},"public_addr":"172.21.15.173:6801/396057210","cluster_addr":"172.21.15.173:6803/396057210","heartbeat_back_addr":"172.21.15.173:6807/396057210","heartbeat_front_addr":"172.21.15.173:6805/396057210","state":["exists","up"]},{"osd":3,"uuid":"8878132e-22e5-4e0c-ab90-ea0d92368b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6811","nonce":203292465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6813","nonce":203292465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6817","nonce":203292465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":203292465},{"type":"v1","addr":"172.21.15.1:6815","nonce":203292465}]},"public_addr":"172.21.15.1:6811/203292465","cluster_addr":"172.21.15.1:6813/203292465","heartbeat_back_addr":"172.21.15.1:6817/203292465","heartbeat_front_addr":"172.21.15.1:6815/203292465","state":["exists","up"]},{"osd":4,"uuid":"5480c4ef-a2ee-44d0-8030-755ba1d6ffb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6809","nonce":2124784542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6811","nonce":2124784542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6815","nonce":2124784542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2124784542},{"type":"v1","addr":"172.21.15.134:6813","nonce":2124784542}]},"public_addr":"172.21.15.134:6809/2124784542","cluster_addr":"172.21.15.134:6811/2124784542","heartbeat_back_addr":"172.21.15.134:6815/2124784542","heartbeat_front_addr":"172.21.15.134:6813/2124784542","state":["exists","up"]},{"osd":5,"uuid":"3d4ea8b6-b7b6-4658-8f9a-270ee7a34436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6809","nonce":2198908508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6811","nonce":2198908508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6815","nonce":2198908508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2198908508},{"type":"v1","addr":"172.21.15.173:6813","nonce":2198908508}]},"public_addr":"172.21.15.173:6809/2198908508","cluster_addr":"172.21.15.173:6811/2198908508","heartbeat_back_addr":"172.21.15.173:6815/2198908508","heartbeat_front_addr":"172.21.15.173:6813/2198908508","state":["exists","up"]},{"osd":6,"uuid":"3c293b2c-d037-45c2-968d-37a64f6a85cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6819","nonce":2324171883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6821","nonce":2324171883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6825","nonce":2324171883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2324171883},{"type":"v1","addr":"172.21.15.1:6823","nonce":2324171883}]},"public_addr":"172.21.15.1:6819/2324171883","cluster_addr":"172.21.15.1:6821/2324171883","heartbeat_back_addr":"172.21.15.1:6825/2324171883","heartbeat_front_addr":"172.21.15.1:6823/2324171883","state":["exists","up"]},{"osd":7,"uuid":"92cb0e9b-e3fc-4825-8aa8-68673d91e7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6817","nonce":1939894500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6819","nonce":1939894500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6823","nonce":1939894500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1939894500},{"type":"v1","addr":"172.21.15.134:6821","nonce":1939894500}]},"public_addr":"172.21.15.134:6817/1939894500","cluster_addr":"172.21.15.134:6819/1939894500","heartbeat_back_addr":"172.21.15.134:6823/1939894500","heartbeat_front_addr":"172.21.15.134:6821/1939894500","state":["exists","up"]},{"osd":8,"uuid":"08fe1c54-4fe9-48b4-b42f-4adb8e930d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6817","nonce":4264302819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6819","nonce":4264302819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6823","nonce":4264302819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4264302819},{"type":"v1","addr":"172.21.15.173:6821","nonce":4264302819}]},"public_addr":"172.21.15.173:6817/4264302819","cluster_addr":"172.21.15.173:6819/4264302819","heartbeat_back_addr":"172.21.15.173:6823/4264302819","heartbeat_front_addr":"172.21.15.173:6821/4264302819","state":["exists","up"]},{"osd":9,"uuid":"6d65f975-c4d8-4fcd-bfbd-d4ecaa380371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6827","nonce":1141465152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6829","nonce":1141465152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6833","nonce":1141465152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1141465152},{"type":"v1","addr":"172.21.15.1:6831","nonce":1141465152}]},"public_addr":"172.21.15.1:6827/1141465152","cluster_addr":"172.21.15.1:6829/1141465152","heartbeat_back_addr":"172.21.15.1:6833/1141465152","heartbeat_front_addr":"172.21.15.1:6831/1141465152","state":["exists","up"]},{"osd":10,"uuid":"19f01a8b-155b-4108-9167-20ebbc3d0e97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6825","nonce":1157717766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6827","nonce":1157717766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6831","nonce":1157717766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1157717766},{"type":"v1","addr":"172.21.15.134:6829","nonce":1157717766}]},"public_addr":"172.21.15.134:6825/1157717766","cluster_addr":"172.21.15.134:6827/1157717766","heartbeat_back_addr":"172.21.15.134:6831/1157717766","heartbeat_front_addr":"172.21.15.134:6829/1157717766","state":["exists","up"]},{"osd":11,"uuid":"f4ce2444-9e0f-4787-acb8-0594c4671e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6825","nonce":948409302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6827","nonce":948409302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6831","nonce":948409302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":948409302},{"type":"v1","addr":"172.21.15.173:6829","nonce":948409302}]},"public_addr":"172.21.15.173:6825/948409302","cluster_addr":"172.21.15.173:6827/948409302","heartbeat_back_addr":"172.21.15.173:6831/948409302","heartbeat_front_addr":"172.21.15.173:6829/948409302","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:16.712047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:23:41.911643+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:06.826565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:32.202782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:24:57.835286+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:23.190785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:25:49.794805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:15.282238+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:26:40.729538+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:06.095800+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:32.064644+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:27:58.149894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6801/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/3443797048":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/556592053":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/2237441020":"2024-09-13T02:21:29.692093+0000","172.21.15.1:6801/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3977745193":"2024-09-13T02:21:53.871193+0000","172.21.15.1:6800/3479905526":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/434649045":"2024-09-13T02:21:29.692093+0000","172.21.15.1:0/3314773164":"2024-09-13T02:21:53.871193+0000","172.21.15.1:0/331955324":"2024-09-13T02:21:29.692093+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 msgr2=0x7feed40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 0x7feed40a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feee80fddc0 tx=0x7feed000b390 comp rx=0 tx=0).stop 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 msgr2=0x7feee819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feed800d950 tx=0x7feed800de10 comp rx=0 tx=0).stop 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 shutdown_connections 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7feed40a2b80 0x7feed40a5040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8106f10 0x7feee819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:27.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feee8102790 0x7feee819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:27.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 --2- 172.21.15.1:0/1739487365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feee8101de0 0x7feee819a630 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:27.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 >> 172.21.15.1:0/1739487365 conn(0x7feee80fd8c0 msgr2=0x7feee80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:27.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 shutdown_connections 2024-09-12T02:34:27.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:27.055+0000 7feeedec3640 1 -- 172.21.15.1:0/1739487365 wait complete. 2024-09-12T02:34:27.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:34:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:27 smithi001 ceph-mon[31252]: pgmap v448: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:34:28.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:27 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1739487365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:27 smithi173 ceph-mon[35036]: pgmap v448: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:34:28.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:27 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1739487365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:28.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:27 smithi134 ceph-mon[35091]: pgmap v448: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T02:34:28.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:27 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1739487365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:28.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 -- 172.21.15.1:0/1333123914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c102790 msgr2=0x7f422c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 --2- 172.21.15.1:0/1333123914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c102790 0x7f422c1067e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4220009900 tx=0x7f422002a410 comp rx=0 tx=0).stop 2024-09-12T02:34:28.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 -- 172.21.15.1:0/1333123914 shutdown_connections 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 --2- 172.21.15.1:0/1333123914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c102790 0x7f422c1067e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 --2- 172.21.15.1:0/1333123914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c106f10 0x7f422c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 --2- 172.21.15.1:0/1333123914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 0x7f422c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 -- 172.21.15.1:0/1333123914 >> 172.21.15.1:0/1333123914 conn(0x7f422c0fd8c0 msgr2=0x7f422c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 -- 172.21.15.1:0/1333123914 shutdown_connections 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.614+0000 7f423201f640 1 -- 172.21.15.1:0/1333123914 wait complete. 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 Processor -- start 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 -- start start 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 0x7f422c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c102790 0x7f422c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f422c111f70 con 0x7f422c106f10 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f422c111df0 con 0x7f422c101de0 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f423201f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f422c1120f0 con 0x7f422c102790 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f422bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f422bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34182/0 (socket says 172.21.15.1:34182) 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f422bfff640 1 -- 172.21.15.1:0/1226581020 learned_addr learned my addr 172.21.15.1:0/1226581020 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f422affd640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c102790 0x7f422c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.615+0000 7f422b7fe640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 0x7f422c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 -- 172.21.15.1:0/1226581020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c102790 msgr2=0x7f422c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c102790 0x7f422c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 -- 172.21.15.1:0/1226581020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 msgr2=0x7f422c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 0x7f422c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 -- 172.21.15.1:0/1226581020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c19d430 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f422bfff640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4224009fd0 tx=0x7f422400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224017070 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4224003e50 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240106c0 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422c19d720 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.616+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422c1a5000 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.617+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422c1021c0 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.618+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4224003970 con 0x7f422c106f10 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.619+0000 7f4228ff9640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 0x7f42140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.619+0000 7f422b7fe640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 0x7f42140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.619+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f42240cee30 con 0x7f422c106f10 2024-09-12T02:34:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.620+0000 7f422b7fe640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 0x7f42140a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f421c0058c0 tx=0x7f421c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.623+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f422409bd10 con 0x7f422c106f10 2024-09-12T02:34:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.840+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f422c10a150 con 0x7f422c106f10 2024-09-12T02:34:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.842+0000 7f4228ff9640 1 -- 172.21.15.1:0/1226581020 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f422409b610 con 0x7f422c106f10 2024-09-12T02:34:28.842 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 msgr2=0x7f42140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 0x7f42140a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f421c0058c0 tx=0x7f421c00a4c0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 msgr2=0x7f422c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4224009fd0 tx=0x7f422400b260 comp rx=0 tx=0).stop 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 shutdown_connections 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f42140a2b80 0x7f42140a5040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f422c106f10 0x7f422c19cd50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f422c102790 0x7f422c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 --2- 172.21.15.1:0/1226581020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422c101de0 0x7f422c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:28.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.845+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 >> 172.21.15.1:0/1226581020 conn(0x7f422c0fd8c0 msgr2=0x7f422c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:28.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.846+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 shutdown_connections 2024-09-12T02:34:28.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:28.846+0000 7f423201f640 1 -- 172.21.15.1:0/1226581020 wait complete. 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a[31248]: 2024-09-12T02:34:28.840+0000 7f5d9d40c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:34:29.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mon[31252]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mds[69689]: -- 172.21.15.1:0/3013415933 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623c4009860 con 0x5623c3fe6800 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: starting mds.g at 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-mds[70064]: -- 172.21.15.1:0/3923892007 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556813499860 con 0x556813477400 2024-09-12T02:34:29.127 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:34:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: starting mds.a at 2024-09-12T02:34:29.163 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.163 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.163 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mds[64693]: -- 172.21.15.134:0/2692529815 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56193b111860 con 0x56193b0ee800 2024-09-12T02:34:29.163 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: starting mds.h at 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mon[35091]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.164 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mds[65006]: -- 172.21.15.134:0/4190255860 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561844a23860 con 0x561844a01000 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: starting mds.b at 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mds[64076]: -- 172.21.15.134:0/2087927126 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565227c6f860 con 0x565227c4d000 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: starting mds.k at 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.165 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-mds[64391]: -- 172.21.15.134:0/513339174 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f31ae5c20 con 0x557f31ac3000 2024-09-12T02:34:29.166 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:34:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: starting mds.e at 2024-09-12T02:34:29.197 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mds[65037]: -- 172.21.15.173:0/236892503 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55958e875860 con 0x55958e852800 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: starting mds.c at 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mds[64739]: -- 172.21.15.173:0/4164966651 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b41d08f860 con 0x55b41d06d000 2024-09-12T02:34:29.198 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: starting mds.f at 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mds[65341]: -- 172.21.15.173:0/2082402350 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa88fc5860 con 0x55fa88fa2800 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: starting mds.i at 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:34:29.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/1226581020' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mon[35036]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: ignoring --setuser ceph since I am not root 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: ignoring --setgroup ceph since I am not root 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-mds[64438]: -- 172.21.15.173:0/796722750 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccc40d1860 con 0x55ccc40ae800 2024-09-12T02:34:29.200 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:34:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: starting mds.l at 2024-09-12T02:34:29.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:34:29.941 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:30.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: pgmap v449: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6833/3922926473,v1:172.21.15.134:6835/3922926473] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6832/231202773,v1:172.21.15.134:6834/231202773] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6839/2497325911,v1:172.21.15.1:6841/2497325911] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.1:6838/3157986476,v1:172.21.15.1:6840/3157986476] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6837/2967063703,v1:172.21.15.134:6839/2967063703] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.134:6836/2587560002,v1:172.21.15.134:6838/2587560002] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6832/2314584556,v1:172.21.15.173:6834/2314584556] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6833/3131584324,v1:172.21.15.173:6837/3131584324] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6835/2610440179,v1:172.21.15.173:6838/2610440179] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: mds.? [v2:172.21.15.173:6836/2837748320,v1:172.21.15.173:6839/2837748320] up:boot 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:34:30.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:30.199 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:29 smithi173 ceph-mon[35036]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: pgmap v449: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6833/3922926473,v1:172.21.15.134:6835/3922926473] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6832/231202773,v1:172.21.15.134:6834/231202773] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6839/2497325911,v1:172.21.15.1:6841/2497325911] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.1:6838/3157986476,v1:172.21.15.1:6840/3157986476] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6837/2967063703,v1:172.21.15.134:6839/2967063703] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.134:6836/2587560002,v1:172.21.15.134:6838/2587560002] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6832/2314584556,v1:172.21.15.173:6834/2314584556] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6833/3131584324,v1:172.21.15.173:6837/3131584324] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6835/2610440179,v1:172.21.15.173:6838/2610440179] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: mds.? [v2:172.21.15.173:6836/2837748320,v1:172.21.15.173:6839/2837748320] up:boot 2024-09-12T02:34:30.254 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:30.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:29 smithi001 ceph-mon[31252]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: pgmap v449: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T02:34:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6833/3922926473,v1:172.21.15.134:6835/3922926473] up:boot 2024-09-12T02:34:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6832/231202773,v1:172.21.15.134:6834/231202773] up:boot 2024-09-12T02:34:30.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6839/2497325911,v1:172.21.15.1:6841/2497325911] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.1:6838/3157986476,v1:172.21.15.1:6840/3157986476] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6837/2967063703,v1:172.21.15.134:6839/2967063703] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.134:6836/2587560002,v1:172.21.15.134:6838/2587560002] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6832/2314584556,v1:172.21.15.173:6834/2314584556] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6833/3131584324,v1:172.21.15.173:6837/3131584324] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6835/2610440179,v1:172.21.15.173:6838/2610440179] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: mds.? [v2:172.21.15.173:6836/2837748320,v1:172.21.15.173:6839/2837748320] up:boot 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:30.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:30.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:30.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:30.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:30.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:30.415 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:29 smithi134 ceph-mon[35091]: from='mgr.14150 172.21.15.1:0/2925182966' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:30.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 -- 172.21.15.1:0/1565072853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff300106ba0 msgr2=0x7ff300106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 --2- 172.21.15.1:0/1565072853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff300106ba0 0x7ff300106f80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009ca0 tx=0x7ff2f002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 -- 172.21.15.1:0/1565072853 shutdown_connections 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 --2- 172.21.15.1:0/1565072853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff30010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 --2- 172.21.15.1:0/1565072853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3001000d0 0x7ff300100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 --2- 172.21.15.1:0/1565072853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff300106ba0 0x7ff300106f80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 -- 172.21.15.1:0/1565072853 >> 172.21.15.1:0/1565072853 conn(0x7ff300077210 msgr2=0x7ff3000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 -- 172.21.15.1:0/1565072853 shutdown_connections 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.483+0000 7ff307ae1640 1 -- 172.21.15.1:0/1565072853 wait complete. 2024-09-12T02:34:30.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 Processor -- start 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 -- start start 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff3001988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300106ba0 0x7ff30019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112090 con 0x7ff3001000d0 2024-09-12T02:34:30.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff300111f10 con 0x7ff300100a70 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff307ae1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff300112210 con 0x7ff300106ba0 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff30587d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff30587d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34250/0 (socket says 172.21.15.1:34250) 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff30587d640 1 -- 172.21.15.1:0/3803817096 learned_addr learned my addr 172.21.15.1:0/3803817096 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.484+0000 7ff30607e640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300106ba0 0x7ff30019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30507c640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff3001988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 -- 172.21.15.1:0/3803817096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300106ba0 msgr2=0x7ff30019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300106ba0 0x7ff30019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 -- 172.21.15.1:0/3803817096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 msgr2=0x7ff3001988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff3001988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 -- 172.21.15.1:0/3803817096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30019d360 con 0x7ff3001000d0 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30507c640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff3001988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff30587d640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0006010 tx=0x7ff2f0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00317d0 con 0x7ff3001000d0 2024-09-12T02:34:30.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30019d5f0 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f0031970 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0030d70 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.485+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001a4f30 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.486+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300100530 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.487+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff2f0004040 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.488+0000 7ff2feffd640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 0x7ff2e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.488+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8699+0+0 (secure 0 0 0) 0x7ff2f00f0870 con 0x7ff3001000d0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.488+0000 7ff30507c640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 0x7ff2e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.488+0000 7ff30507c640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 0x7ff2e80a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ff6a0 tx=0x7ff2f4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.492+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2f00bd5a0 con 0x7ff3001000d0 2024-09-12T02:34:30.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.704+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff3001a5100 con 0x7ff3001000d0 2024-09-12T02:34:30.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.925+0000 7ff2feffd640 1 -- 172.21.15.1:0/3803817096 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7ff2f00bcea0 con 0x7ff3001000d0 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 msgr2=0x7ff2e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 0x7ff2e80a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ff6a0 tx=0x7ff2f4005d90 comp rx=0 tx=0).stop 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 msgr2=0x7ff3001983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0006010 tx=0x7ff2f0003f80 comp rx=0 tx=0).stop 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 shutdown_connections 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7ff2e80a2b80 0x7ff2e80a5040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff300106ba0 0x7ff30019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff300100a70 0x7ff3001988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 --2- 172.21.15.1:0/3803817096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3001000d0 0x7ff3001983b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.927+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 >> 172.21.15.1:0/3803817096 conn(0x7ff300077210 msgr2=0x7ff300104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.928+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 shutdown_connections 2024-09-12T02:34:30.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:30.928+0000 7ff307ae1640 1 -- 172.21.15.1:0/3803817096 wait complete. 2024-09-12T02:34:31.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:30 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:34:31.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:30 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:34:31.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:30 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:34:31.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:34:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: pgmap v451: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: Cluster is now healthy 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:34:32.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:31 smithi001 ceph-mon[31252]: fsmap 12 up:standby 2024-09-12T02:34:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: pgmap v451: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:34:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:34:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: Cluster is now healthy 2024-09-12T02:34:32.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:34:32.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:31 smithi173 ceph-mon[35036]: fsmap 12 up:standby 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: pgmap v451: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: Cluster is now healthy 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/3803817096' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:34:32.414 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:31 smithi134 ceph-mon[35091]: fsmap 12 up:standby 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 -- 172.21.15.1:0/1857395562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 msgr2=0x7f53b01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/1857395562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b01021c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac02a410 comp rx=0 tx=0).stop 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 -- 172.21.15.1:0/1857395562 shutdown_connections 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/1857395562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 0x7f53b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/1857395562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 0x7f53b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/1857395562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b01021c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 -- 172.21.15.1:0/1857395562 >> 172.21.15.1:0/1857395562 conn(0x7f53b00fd8c0 msgr2=0x7f53b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 -- 172.21.15.1:0/1857395562 shutdown_connections 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.493+0000 7f53b7fb1640 1 -- 172.21.15.1:0/1857395562 wait complete. 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 Processor -- start 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 -- start start 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 0x7f53b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 0x7f53b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111fc0 con 0x7f53b0101de0 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0111e40 con 0x7f53b0106f10 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b7fb1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0112140 con 0x7f53b0102790 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b5d4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:32.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b5d4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47670/0 (socket says 172.21.15.1:47670) 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.494+0000 7f53b5d4d640 1 -- 172.21.15.1:0/624076374 learned_addr learned my addr 172.21.15.1:0/624076374 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b554c640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 0x7f53b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b654e640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 0x7f53b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 -- 172.21.15.1:0/624076374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 msgr2=0x7f53b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 0x7f53b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 -- 172.21.15.1:0/624076374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 msgr2=0x7f53b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 0x7f53b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 -- 172.21.15.1:0/624076374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b01a68c0 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b5d4d640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f53ac006010 tx=0x7f53ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac03f070 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac031c90 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b01a6b50 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac035030 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.495+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b01a7030 con 0x7f53b0101de0 2024-09-12T02:34:32.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.496+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b01021c0 con 0x7f53b0101de0 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.498+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f53ac042070 con 0x7f53b0101de0 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.498+0000 7f53a6ffd640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 0x7f539c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.499+0000 7f53b554c640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 0x7f539c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.499+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8699+0+0 (secure 0 0 0) 0x7f53ac0efa40 con 0x7f53b0101de0 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.499+0000 7f53b554c640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 0x7f539c0a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f53b0075f80 tx=0x7f53a000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:32.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.503+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53ac0bc180 con 0x7f53b0101de0 2024-09-12T02:34:32.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.679+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53b010a0f0 con 0x7f53b0101de0 2024-09-12T02:34:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.928+0000 7f53a6ffd640 1 -- 172.21.15.1:0/624076374 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f53ac0c0480 con 0x7f53b0101de0 2024-09-12T02:34:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 msgr2=0x7f539c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 0x7f539c0a5040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f53b0075f80 tx=0x7f53a000a250 comp rx=0 tx=0).stop 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 msgr2=0x7f53b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f53ac006010 tx=0x7f53ac003ba0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 shutdown_connections 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f539c0a2b80 0x7f539c0a5040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53b0106f10 0x7f53b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53b0102790 0x7f53b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 --2- 172.21.15.1:0/624076374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f53b0101de0 0x7f53b00744f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.931+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 >> 172.21.15.1:0/624076374 conn(0x7f53b00fd8c0 msgr2=0x7f53b00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:32.933 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:32 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.932+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 shutdown_connections 2024-09-12T02:34:32.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:32.932+0000 7f53b7fb1640 1 -- 172.21.15.1:0/624076374 wait complete. 2024-09-12T02:34:33.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:32 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:33.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:32 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:33.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 877143dc-70ad-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:34:34.033 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:33 smithi001 ceph-mon[31252]: pgmap v452: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:33 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:34.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:33 smithi001 ceph-mon[31252]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:34:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:33 smithi173 ceph-mon[35036]: pgmap v452: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:33 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:34.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:33 smithi173 ceph-mon[35036]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:34:34.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:33 smithi134 ceph-mon[35091]: pgmap v452: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-12T02:34:34.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:33 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/624076374' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:34.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:33 smithi134 ceph-mon[35091]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:34:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 -- 172.21.15.1:0/3256647602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 msgr2=0x7f82f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 --2- 172.21.15.1:0/3256647602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f0101200 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009900 tx=0x7f82e002a480 comp rx=0 tx=0).stop 2024-09-12T02:34:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 -- 172.21.15.1:0/3256647602 shutdown_connections 2024-09-12T02:34:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 --2- 172.21.15.1:0/3256647602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 0x7f82f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 --2- 172.21.15.1:0/3256647602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 0x7f82f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 --2- 172.21.15.1:0/3256647602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f0101200 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 -- 172.21.15.1:0/3256647602 >> 172.21.15.1:0/3256647602 conn(0x7f82f00fc7d0 msgr2=0x7f82f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 -- 172.21.15.1:0/3256647602 shutdown_connections 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.521+0000 7f82f6630640 1 -- 172.21.15.1:0/3256647602 wait complete. 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 Processor -- start 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 -- start start 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 0x7f82f010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 0x7f82f010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82f01120a0 con 0x7f82f0100e20 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0111f20 con 0x7f82f0102ef0 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82f6630640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0112220 con 0x7f82f0102570 2024-09-12T02:34:34.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47684/0 (socket says 172.21.15.1:47684) 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.522+0000 7f82effff640 1 -- 172.21.15.1:0/2734248752 learned_addr learned my addr 172.21.15.1:0/2734248752 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82f4bcd640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 0x7f82f010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82ef7fe640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 0x7f82f010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 -- 172.21.15.1:0/2734248752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 msgr2=0x7f82f010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 0x7f82f010ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 -- 172.21.15.1:0/2734248752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 msgr2=0x7f82f010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 0x7f82f010ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 -- 172.21.15.1:0/2734248752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01a6a60 con 0x7f82f0100e20 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82effff640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006010 tx=0x7f82e0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e003f070 con 0x7f82f0100e20 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82e0031c30 con 0x7f82f0100e20 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f01a6cf0 con 0x7f82f0100e20 2024-09-12T02:34:34.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0035030 con 0x7f82f0100e20 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.523+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a7180 con 0x7f82f0100e20 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.524+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0101200 con 0x7f82f0100e20 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.525+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f82e0042070 con 0x7f82f0100e20 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.526+0000 7f82ed7fa640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 0x7f82d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.526+0000 7f82ef7fe640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 0x7f82d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.526+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8116+0+0 (secure 0 0 0) 0x7f82e00efca0 con 0x7f82f0100e20 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.526+0000 7f82ef7fe640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 0x7f82d80a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82e4005fd0 tx=0x7f82e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.530+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82e0031de0 con 0x7f82f0100e20 2024-09-12T02:34:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.705+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82f0109090 con 0x7f82f0100e20 2024-09-12T02:34:34.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.934+0000 7f82ed7fa640 1 -- 172.21.15.1:0/2734248752 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f82e00bcca0 con 0x7f82f0100e20 2024-09-12T02:34:34.935 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-12T02:34:34.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.937+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 msgr2=0x7f82d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.937+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 0x7f82d80a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82e4005fd0 tx=0x7f82e4005850 comp rx=0 tx=0).stop 2024-09-12T02:34:34.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.937+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 msgr2=0x7f82f010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.937+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006010 tx=0x7f82e0003c10 comp rx=0 tx=0).stop 2024-09-12T02:34:34.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 shutdown_connections 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:6800/3015676599,v1:172.21.15.1:6801/3015676599] conn(0x7f82d80a2b80 0x7f82d80a5040 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82f0102ef0 0x7f82f010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f0102570 0x7f82f010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 --2- 172.21.15.1:0/2734248752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82f0100e20 0x7f82f010e4d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 >> 172.21.15.1:0/2734248752 conn(0x7f82f00fc7d0 msgr2=0x7f82f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 shutdown_connections 2024-09-12T02:34:34.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-12T02:34:34.938+0000 7f82f6630640 1 -- 172.21.15.1:0/2734248752 wait complete. 2024-09-12T02:34:35.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:34 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:35.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:34 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:35.314 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:34 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:34:35.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:35.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:35.762 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:35.794 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:34:35.794 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:34:35.812 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:34:35.827 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:34:35.851 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:34:35.852 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:34:35.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:34:35.937 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:35 smithi001 systemd[1]: Stopping Ceph mon.a for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:35 smithi173 ceph-mon[35036]: pgmap v454: 65 pgs: 65 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:35 smithi173 ceph-mon[35036]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:36.197 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:35 smithi173 ceph-mon[35036]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:34:36.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:35 smithi001 ceph-mon[31252]: pgmap v454: 65 pgs: 65 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:36.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:35 smithi001 ceph-mon[31252]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:36.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:35 smithi001 ceph-mon[31252]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:34:36.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a[31248]: 2024-09-12T02:34:36.178+0000 7f5da2c17640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:36.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a[31248]: 2024-09-12T02:34:36.178+0000 7f5da2c17640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:34:36.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:35 smithi134 ceph-mon[35091]: pgmap v454: 65 pgs: 65 active+clean; 577 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:36.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:35 smithi134 ceph-mon[35091]: from='client.? 172.21.15.1:0/2734248752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:34:36.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:35 smithi134 ceph-mon[35091]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:34:36.539 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:36 smithi001 podman[93524]: 2024-09-12 02:34:36.220360081 +0000 UTC m=+0.169377843 container died 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:34:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:36 smithi001 podman[93524]: 2024-09-12 02:34:36.721586242 +0000 UTC m=+0.670604053 container cleanup 13f59d83b3d26022fa200c848e5b9d125704eb0d04203e8276be3e6ee2f9ca5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:34:36.876 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 12 02:34:36 smithi001 bash[93524]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:34:37.118 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:34:37.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:37.169 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:34:37.169 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:34:37.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:34:37.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:37 smithi134 systemd[1]: Stopping Ceph mon.b for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-b[35087]: 2024-09-12T02:34:37.500+0000 7fed12086640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:37.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-b[35087]: 2024-09-12T02:34:37.500+0000 7fed12086640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:34:37.914 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:37 smithi134 podman[67910]: 2024-09-12 02:34:37.746257285 +0000 UTC m=+0.377215491 container died 3a31a3aa4ef4a97ec63a220d2c23aef222719a78bb4f21e30a3b5b55ca27cb22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:34:38.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:38 smithi134 podman[67910]: 2024-09-12 02:34:38.118207905 +0000 UTC m=+0.749166099 container cleanup 3a31a3aa4ef4a97ec63a220d2c23aef222719a78bb4f21e30a3b5b55ca27cb22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:34:38.413 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 12 02:34:38 smithi134 bash[67910]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:34:38.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:34:38.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:38.647 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:34:38.647 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:34:38.647 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:34:38.947 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:38 smithi173 systemd[1]: Stopping Ceph mon.c for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:39.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c[35032]: 2024-09-12T02:34:39.055+0000 7fdbd1654640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:39.447 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c[35032]: 2024-09-12T02:34:39.055+0000 7fdbd1654640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:34:39.448 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 podman[68276]: 2024-09-12 02:34:39.159078268 +0000 UTC m=+0.316595558 container died 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:34:39.800 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 podman[68276]: 2024-09-12 02:34:39.573928204 +0000 UTC m=+0.731445498 container cleanup 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:34:39.800 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 bash[68276]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:34:40.054 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 02:34:39 smithi173 podman[68288]: 2024-09-12 02:34:39.800494633 +0000 UTC m=+0.643597351 container remove 41adee92a20fa4135e6d78cf89a336e0607eeeb18b50b5642f810a4c1c9ba20a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T02:34:40.059 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:34:40.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:40.107 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:34:40.107 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:34:40.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:34:40.463 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:40 smithi001 systemd[1]: Stopping Ceph mgr.x for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:40.802 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:40 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x[31476]: 2024-09-12T02:34:40.462+0000 7fd1e61ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:40.803 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:40 smithi001 podman[93644]: 2024-09-12 02:34:40.494878123 +0000 UTC m=+0.187659825 container died b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:34:41.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 podman[93644]: 2024-09-12 02:34:41.030331371 +0000 UTC m=+0.723113060 container cleanup b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:41.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 bash[93644]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:34:41.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:34:41.533 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 podman[93656]: 2024-09-12 02:34:41.265681151 +0000 UTC m=+0.768623235 container remove b9ec5984e02b0379fbe6a8c7f365a9dbe3f5760c65c8caf0853b2a661aa0b3bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:34:41.533 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-12T02:34:41.533 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 systemd[1]: Stopped Ceph mgr.x for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:34:41.533 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 12 02:34:41 smithi001 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.x.service: Consumed 42.449s CPU time. 2024-09-12T02:34:41.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:41.548 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:34:41.548 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:34:41.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:34:41.885 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:34:41 smithi134 systemd[1]: Stopping Ceph mgr.y for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:42.163 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:34:41 smithi134 podman[68034]: 2024-09-12 02:34:41.886176327 +0000 UTC m=+0.141893426 container died 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:34:42.534 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:34:42 smithi134 podman[68034]: 2024-09-12 02:34:42.265957954 +0000 UTC m=+0.521675054 container cleanup 72a7fb2405b75da11a874c4c9a80e974b2961afc3f4d5d179573221ca0df4d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:34:42.534 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 12 02:34:42 smithi134 bash[68034]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:34:42.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:34:42.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:42.726 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:34:42.726 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:34:42.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:34:43.083 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:34:42 smithi173 systemd[1]: Stopping Ceph mgr.z for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:43.381 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:34:43 smithi173 podman[68399]: 2024-09-12 02:34:43.083734664 +0000 UTC m=+0.161659689 container died 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:34:43.697 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:34:43 smithi173 podman[68399]: 2024-09-12 02:34:43.471905449 +0000 UTC m=+0.549830465 container cleanup 9e8706c71b19328b93fb589523b2a0355d5f5e85e9c5ad948488c333f00fd77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:34:43.697 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 02:34:43 smithi173 bash[68399]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:34:43.953 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:34:43.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:43.986 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:34:43.987 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:34:43.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:34:44.301 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:44 smithi001 systemd[1]: Stopping Ceph osd.0 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:44.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:34:44.301+0000 7fa813593640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:44.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:34:44.301+0000 7fa813593640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-12T02:34:44.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0[42867]: 2024-09-12T02:34:44.301+0000 7fa813593640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:34:49.995 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:49 smithi001 podman[93765]: 2024-09-12 02:34:49.699802514 +0000 UTC m=+5.514929913 container died 52c2fd2b9e5eed8345d0b4747071731b7fe62afa91d859d8ef09ad0cbbd01528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:34:50.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:50 smithi001 podman[93765]: 2024-09-12 02:34:50.160843809 +0000 UTC m=+5.975971249 container cleanup 52c2fd2b9e5eed8345d0b4747071731b7fe62afa91d859d8ef09ad0cbbd01528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:50.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:50 smithi001 bash[93765]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:34:50.804 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:50 smithi001 podman[93781]: 2024-09-12 02:34:50.438030741 +0000 UTC m=+0.728126774 container remove 52c2fd2b9e5eed8345d0b4747071731b7fe62afa91d859d8ef09ad0cbbd01528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:34:51.100 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:50 smithi001 podman[93871]: 2024-09-12 02:34:50.707538364 +0000 UTC m=+0.016483865 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:51.100 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:50 smithi001 podman[93871]: 2024-09-12 02:34:50.830554782 +0000 UTC m=+0.139500282 container create a72ed129190f6a0756b988d2b7e90ad3ecb9345ac1f372d1706997bb4294fdff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:51.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:51 smithi001 podman[93871]: 2024-09-12 02:34:51.09997316 +0000 UTC m=+0.408918678 container init a72ed129190f6a0756b988d2b7e90ad3ecb9345ac1f372d1706997bb4294fdff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:51.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:51 smithi001 podman[93871]: 2024-09-12 02:34:51.104198319 +0000 UTC m=+0.413143822 container start a72ed129190f6a0756b988d2b7e90ad3ecb9345ac1f372d1706997bb4294fdff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:34:51.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:51 smithi001 podman[93871]: 2024-09-12 02:34:51.233652506 +0000 UTC m=+0.542598020 container attach a72ed129190f6a0756b988d2b7e90ad3ecb9345ac1f372d1706997bb4294fdff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:51.376 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 12 02:34:51 smithi001 podman[93871]: 2024-09-12 02:34:51.297804244 +0000 UTC m=+0.606749744 container died a72ed129190f6a0756b988d2b7e90ad3ecb9345ac1f372d1706997bb4294fdff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:34:52.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:34:52.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:52.137 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:34:52.137 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:34:52.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:34:52.495 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:52 smithi134 systemd[1]: Stopping Ceph osd.1 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:34:52.913 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:34:52.494+0000 7f31c9388640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:52.913 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:34:52.494+0000 7f31c9388640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-12T02:34:52.913 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1[39567]: 2024-09-12T02:34:52.494+0000 7f31c9388640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:34:58.104 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:57 smithi134 podman[68162]: 2024-09-12 02:34:57.80068614 +0000 UTC m=+5.465542836 container died 405baf79f015f11b372d0537aa9fda47787eeedd8f9af7a3ed056ee0f8aa0dae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:34:58.413 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:58 smithi134 podman[68162]: 2024-09-12 02:34:58.203426317 +0000 UTC m=+5.868283016 container cleanup 405baf79f015f11b372d0537aa9fda47787eeedd8f9af7a3ed056ee0f8aa0dae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:34:58.413 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:58 smithi134 bash[68162]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:34:58.825 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:58 smithi134 podman[68177]: 2024-09-12 02:34:58.463514869 +0000 UTC m=+0.658568447 container remove 405baf79f015f11b372d0537aa9fda47787eeedd8f9af7a3ed056ee0f8aa0dae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:34:59.100 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:58 smithi134 podman[68264]: 2024-09-12 02:34:58.72857737 +0000 UTC m=+0.015946860 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:59.100 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:58 smithi134 podman[68264]: 2024-09-12 02:34:58.872841479 +0000 UTC m=+0.160210996 container create a6a53f75444e842727b366012c8e3a1dec55b1c136ab144dfe5ad50321ff9ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:34:59.416 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:59 smithi134 podman[68264]: 2024-09-12 02:34:59.10060975 +0000 UTC m=+0.387979234 container init a6a53f75444e842727b366012c8e3a1dec55b1c136ab144dfe5ad50321ff9ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:34:59.416 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:59 smithi134 podman[68264]: 2024-09-12 02:34:59.104172577 +0000 UTC m=+0.391542053 container start a6a53f75444e842727b366012c8e3a1dec55b1c136ab144dfe5ad50321ff9ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:34:59.416 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:59 smithi134 podman[68264]: 2024-09-12 02:34:59.184102862 +0000 UTC m=+0.471472355 container attach a6a53f75444e842727b366012c8e3a1dec55b1c136ab144dfe5ad50321ff9ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T02:34:59.417 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 12 02:34:59 smithi134 podman[68264]: 2024-09-12 02:34:59.297404264 +0000 UTC m=+0.584773739 container died a6a53f75444e842727b366012c8e3a1dec55b1c136ab144dfe5ad50321ff9ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:35:00.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:35:00.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:00.123 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:35:00.123 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:35:00.123 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:35:00.447 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:00 smithi173 systemd[1]: Stopping Ceph osd.2 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:00.947 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:35:00.459+0000 7f2aed6b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:00.947 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:35:00.459+0000 7f2aed6b0640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-12T02:35:00.947 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2[39991]: 2024-09-12T02:35:00.459+0000 7f2aed6b0640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:06.120 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:05 smithi173 podman[68535]: 2024-09-12 02:35:05.818163541 +0000 UTC m=+5.492400925 container died 07ef06c689a39c0a5d981a25a8b66166b0b811bebb703f56f7924532964d8956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:35:06.447 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:06 smithi173 podman[68535]: 2024-09-12 02:35:06.219095573 +0000 UTC m=+5.893332956 container cleanup 07ef06c689a39c0a5d981a25a8b66166b0b811bebb703f56f7924532964d8956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:35:06.447 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:06 smithi173 bash[68535]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:35:06.835 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:06 smithi173 podman[68551]: 2024-09-12 02:35:06.491018913 +0000 UTC m=+0.667910818 container remove 07ef06c689a39c0a5d981a25a8b66166b0b811bebb703f56f7924532964d8956 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:35:07.141 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:06 smithi173 podman[68641]: 2024-09-12 02:35:06.738813913 +0000 UTC m=+0.015889694 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:07.141 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:06 smithi173 podman[68641]: 2024-09-12 02:35:06.871882538 +0000 UTC m=+0.148958309 container create cb1594ca1f470395a748e2ae05dcbe9c37ea2f1fa922d887eccca521d0d69731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:35:07.448 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:07 smithi173 podman[68641]: 2024-09-12 02:35:07.141640616 +0000 UTC m=+0.418716388 container init cb1594ca1f470395a748e2ae05dcbe9c37ea2f1fa922d887eccca521d0d69731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:35:07.448 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:07 smithi173 podman[68641]: 2024-09-12 02:35:07.145120818 +0000 UTC m=+0.422196593 container start cb1594ca1f470395a748e2ae05dcbe9c37ea2f1fa922d887eccca521d0d69731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:35:07.448 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:07 smithi173 podman[68641]: 2024-09-12 02:35:07.225299197 +0000 UTC m=+0.502374968 container attach cb1594ca1f470395a748e2ae05dcbe9c37ea2f1fa922d887eccca521d0d69731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:35:07.448 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 02:35:07 smithi173 podman[68641]: 2024-09-12 02:35:07.341562756 +0000 UTC m=+0.618638527 container died cb1594ca1f470395a748e2ae05dcbe9c37ea2f1fa922d887eccca521d0d69731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:08.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:35:08.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:08.067 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:35:08.067 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:35:08.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:35:08.376 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:08 smithi001 systemd[1]: Stopping Ceph osd.3 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:08.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:08 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:35:08.399+0000 7fb861c27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:08.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:08 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:35:08.399+0000 7fb861c27640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-12T02:35:08.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:08 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3[49762]: 2024-09-12T02:35:08.399+0000 7fb861c27640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:11.447 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:11.172+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:11.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:11 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:11.618+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:12.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:11 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:11.751+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:12.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:12.213+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:12.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:12 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:12.610+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:13.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:12 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:12.708+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:13.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:13.222+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:13.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:13.452+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:13.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:13 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:13.621+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:13.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:13 smithi001 podman[93986]: 2024-09-12 02:35:13.871852604 +0000 UTC m=+5.594275060 container died 86e4c89b02ba5579f8a81f469635fc1fb0f1d3d994b27bc0d92962bce99021a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:35:14.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:13 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:13.679+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:14.460 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:14.200+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:14.575 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:14 smithi001 podman[93986]: 2024-09-12 02:35:14.358534432 +0000 UTC m=+6.080956940 container cleanup 86e4c89b02ba5579f8a81f469635fc1fb0f1d3d994b27bc0d92962bce99021a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:35:14.575 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:14 smithi001 bash[93986]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:35:14.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:14.575+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:14.876 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:14 smithi001 podman[94001]: 2024-09-12 02:35:14.660355172 +0000 UTC m=+0.781664342 container remove 86e4c89b02ba5579f8a81f469635fc1fb0f1d3d994b27bc0d92962bce99021a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:35:14.877 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:14 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:14.782+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:14.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:14.460+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:15.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:14 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:14.682+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:15.264 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:14 smithi001 podman[94088]: 2024-09-12 02:35:14.880086044 +0000 UTC m=+0.016368502 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:15.264 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:15 smithi001 podman[94088]: 2024-09-12 02:35:15.003005322 +0000 UTC m=+0.139287770 container create 757ab063cf248287f655293b4a41699a1eaa00e067f19222dfdc980c820f2a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:35:15.264 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:15 smithi001 podman[94088]: 2024-09-12 02:35:15.264209745 +0000 UTC m=+0.400492196 container init 757ab063cf248287f655293b4a41699a1eaa00e067f19222dfdc980c820f2a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:15.596 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:15 smithi001 podman[94088]: 2024-09-12 02:35:15.267631179 +0000 UTC m=+0.403913637 container start 757ab063cf248287f655293b4a41699a1eaa00e067f19222dfdc980c820f2a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:35:15.597 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:15 smithi001 podman[94088]: 2024-09-12 02:35:15.355777599 +0000 UTC m=+0.492060284 container attach 757ab063cf248287f655293b4a41699a1eaa00e067f19222dfdc980c820f2a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:35:15.597 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 12 02:35:15 smithi001 podman[94088]: 2024-09-12 02:35:15.460944527 +0000 UTC m=+0.597226976 container died 757ab063cf248287f655293b4a41699a1eaa00e067f19222dfdc980c820f2a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:15.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:15.222+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:15.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:15.419+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:15.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:15.596+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:15.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:15 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:15.756+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:16.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:15 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:15.667+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:16.175 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:35:16.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:16.220 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:35:16.220 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:35:16.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:35:16.524 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:16 smithi134 systemd[1]: Stopping Ceph osd.4 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:16.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:16.213+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:16.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:16.373+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:16.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:16 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:16.550+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:16.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:16 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:16.714+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:16.913 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:16 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:35:16.524+0000 7f0bcb678640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:16.913 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:16 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:35:16.524+0000 7f0bcb678640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-12T02:35:16.913 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:16 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:35:16.524+0000 7f0bcb678640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:16.914 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:16 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:16.678+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:17.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:17 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:17.411+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:17.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:17 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:17.198+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:17.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:17.521+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:17.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:17 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:17.737+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:18.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:17 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:17.681+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:18.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:18 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:18.226+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:18.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:18 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:18.427+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:18.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:18.753+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:18.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:18.534+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:18.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:18 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:18.534+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:19.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:18 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:18.713+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:19.441 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:19 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:19.189+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:19.441 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:19 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:19.189+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:19.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:19 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:19.441+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:19.793 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:19.762+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:19.793 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:19.762+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:19.793 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:19.538+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:19.793 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:19.538+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:20.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:19 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:19.711+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:20.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:20 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:20.202+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:20.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:20 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:20.202+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:20.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:20 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:20.437+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:20.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:20 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:20.437+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:20.784 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:20 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:20.517+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:20.785 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:20 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:20.517+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:20.913 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:20 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:20.632+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:20.913 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:20 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:20.749+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:21.066 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:20 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:20.784+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:21.067 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:20 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:20.784+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:21.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:21 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:21.226+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:21.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:21 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:21.226+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:21.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:21 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:21.445+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:21.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:21 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:21.445+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:21.777 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:21 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4[46189]: 2024-09-12T02:35:21.443+0000 7f0bc3c86640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:57.216864+0000 front 2024-09-12T02:34:57.216890+0000 (oldest deadline 2024-09-12T02:35:20.717019+0000) 2024-09-12T02:35:21.777 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:21 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:21.659+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:21.827 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:21 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:21.477+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:21.828 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:21 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:21.477+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:22.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:21 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:21.827+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:22.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:21 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:21.827+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:22.163 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:22 smithi134 podman[68379]: 2024-09-12 02:35:22.005838068 +0000 UTC m=+5.593033501 container died 920b89fc9830bf4127a052bb3ab4f70b54fd80628c3337d9dd6f675ceb861328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:35:22.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:21 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:21.777+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:22.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:21 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:21.777+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:22.663 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:22 smithi134 podman[68379]: 2024-09-12 02:35:22.399729375 +0000 UTC m=+5.986924805 container cleanup 920b89fc9830bf4127a052bb3ab4f70b54fd80628c3337d9dd6f675ceb861328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:35:22.663 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:22 smithi134 bash[68379]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:35:22.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:22.274+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:22.698 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:22.245+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:22.698 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:22.245+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:22.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:22.462+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:22.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:22 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:22.462+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:22.821 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:22.470+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:22.821 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:22.470+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:22.993 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:22 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:22.669+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:22.994 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:22 smithi134 podman[68393]: 2024-09-12 02:35:22.667823316 +0000 UTC m=+0.664340658 container remove 920b89fc9830bf4127a052bb3ab4f70b54fd80628c3337d9dd6f675ceb861328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:35:22.994 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:22 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:22.769+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:22.994 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:22 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:22.769+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:23.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:22.820+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:23.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:22.820+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:23.325 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:22 smithi134 podman[68485]: 2024-09-12 02:35:22.994080788 +0000 UTC m=+0.091695546 container create 885d607cb75f906ea7e533d6fff68d39d05a420179aff7353a4e05c306827358 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:35:23.325 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:23 smithi134 podman[68485]: 2024-09-12 02:35:22.918139807 +0000 UTC m=+0.015754540 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:23.325 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:23 smithi134 podman[68485]: 2024-09-12 02:35:23.230068202 +0000 UTC m=+0.327682926 container init 885d607cb75f906ea7e533d6fff68d39d05a420179aff7353a4e05c306827358 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T02:35:23.325 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:23 smithi134 podman[68485]: 2024-09-12 02:35:23.233338797 +0000 UTC m=+0.330953514 container start 885d607cb75f906ea7e533d6fff68d39d05a420179aff7353a4e05c306827358 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:35:23.325 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:23 smithi134 podman[68485]: 2024-09-12 02:35:23.321696453 +0000 UTC m=+0.419311183 container attach 885d607cb75f906ea7e533d6fff68d39d05a420179aff7353a4e05c306827358 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:35:23.663 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 12 02:35:23 smithi134 podman[68485]: 2024-09-12 02:35:23.427639959 +0000 UTC m=+0.525254678 container died 885d607cb75f906ea7e533d6fff68d39d05a420179aff7353a4e05c306827358 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:35:23.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:23.252+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:23.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:23.252+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:23.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:23.306+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:23.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:23.464+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:23.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:23 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:23.464+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:23.871 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:23 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:23.451+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:23.871 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:23 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:23.451+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:24.100 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:23 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:23.725+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:24.101 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:23 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:23.725+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:24.101 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:23 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:23.666+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:24.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:23 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:23.870+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:24.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:23 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:23.870+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:24.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:35:24.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:24.169 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:35:24.169 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:35:24.169 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:35:24.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:24.271+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:24.447 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:24.218+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:24.447 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:24.218+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:24.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 systemd[1]: Stopping Ceph osd.5 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:24.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:24.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:24.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:24.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:24.947 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:24.506+0000 7f08cd1cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:24.947 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:24.506+0000 7f08cd1cb640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-12T02:35:24.947 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:24.506+0000 7f08cd1cb640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:24.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:24.462+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:24.948 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:24 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:24.462+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:25.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:24 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:24.713+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:25.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:24 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:24.767+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:25.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:24 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:24.767+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:25.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:24.879+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:25.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:24.879+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:25.432 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:25 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:25.170+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:25.432 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:25 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:25.170+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:25.432 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:25 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:25.308+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:25.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:25 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:25.431+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:25.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:25 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:25.431+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:25.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:25.459+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:25.876 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:25.459+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:26.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:25 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:25.690+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:26.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:25 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:25.790+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:26.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:25 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:25.790+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:26.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:25.909+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:26.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:25 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:25.909+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:26.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:26 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:26.351+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:26.447 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:26 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:26.168+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:26.447 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:26 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:26.168+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:26.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:26 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:26.415+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:26.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:26 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:26.415+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:26.860 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:26.462+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:26.861 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:26.462+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:27.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:26.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:27.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:26 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:26.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:27.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:26 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:26.830+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:27.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:26 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:26.830+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:27.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:26 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:26.734+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:27.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:27.395+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:27.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:27.395+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:27.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:27.183+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:27.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:27.183+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:27.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:27.183+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.122987+0000 front 2024-09-12T02:35:04.123088+0000 (oldest deadline 2024-09-12T02:35:27.023173+0000) 2024-09-12T02:35:27.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:27.390+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:27.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:27 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:27.390+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:27.853 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:27.442+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:27.853 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:27.442+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:28.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:27.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:28.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:27 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:27.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:28.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:27 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:27.775+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:28.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:27 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:27.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:28.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:27 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:27.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:28.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:27 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:27.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:28.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:28.434+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:28.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:28.434+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:28.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:28.419+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:28.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:28.419+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:28.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:28.192+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:28.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:28.192+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:28.448 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:28 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:28.192+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.122987+0000 front 2024-09-12T02:35:04.123088+0000 (oldest deadline 2024-09-12T02:35:27.023173+0000) 2024-09-12T02:35:28.849 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:28.485+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:28.849 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:28.485+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:28.849 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:28.485+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:29.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:28.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:29.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:28.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:29.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:28 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:28.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:29.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:28.737+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:29.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:28.737+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:29.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:28.834+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:29.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:28.834+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:29.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:28 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:28.834+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:29.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:29.236+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:47.320176+0000 front 2024-09-12T02:34:47.320315+0000 (oldest deadline 2024-09-12T02:35:10.820193+0000) 2024-09-12T02:35:29.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:29.236+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.621701+0000 front 2024-09-12T02:34:56.621855+0000 (oldest deadline 2024-09-12T02:35:18.321844+0000) 2024-09-12T02:35:29.697 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5[46894]: 2024-09-12T02:35:29.236+0000 7f08c97e1640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.122987+0000 front 2024-09-12T02:35:04.123088+0000 (oldest deadline 2024-09-12T02:35:27.023173+0000) 2024-09-12T02:35:29.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:29.481+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:29.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:29.481+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:29.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:29.451+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:29.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:29 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:29.451+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:29.814 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:29.471+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:29.815 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:29.471+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:29.815 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:29.471+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:30.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:29.814+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:30.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:29.814+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:30.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:29.814+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:30.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:29 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:29.755+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:30.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:29 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:29.755+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:30.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:29 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:29.835+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:30.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:29 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:29.835+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:30.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:29 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:29.835+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:30.342 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:30 smithi173 podman[68756]: 2024-09-12 02:35:30.050039572 +0000 UTC m=+5.681908751 container died a6f8a9a303eb876782b429e02acc99101e99be7bbf072582f67fc4dbd3f9f6a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:35:30.684 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:30 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:30.432+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:30.684 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:30 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:30.432+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:30.685 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:30 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:30.499+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:30.685 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:30 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:30.499+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:30.685 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:30 smithi173 podman[68756]: 2024-09-12 02:35:30.441260413 +0000 UTC m=+6.073129589 container cleanup a6f8a9a303eb876782b429e02acc99101e99be7bbf072582f67fc4dbd3f9f6a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:35:30.685 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:30 smithi173 bash[68756]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:35:30.824 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:30.478+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:30.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:30.478+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:30.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:30.478+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:30.947 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:30 smithi173 podman[68771]: 2024-09-12 02:35:30.684460109 +0000 UTC m=+0.629746133 container remove a6f8a9a303eb876782b429e02acc99101e99be7bbf072582f67fc4dbd3f9f6a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:35:31.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:30.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:31.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:30.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:31.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:30 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:30.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:31.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:30.758+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:31.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:30.758+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:31.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:30.788+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:31.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:30.788+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:31.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:30 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:30.788+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:31.246 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:30 smithi173 podman[68858]: 2024-09-12 02:35:30.895304143 +0000 UTC m=+0.015555623 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:31.246 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:31 smithi173 podman[68858]: 2024-09-12 02:35:31.010227507 +0000 UTC m=+0.130478976 container create ac99fd25698ed69c3181da7282ea5ef306541c20d5f162afed1f67af8e82e419 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:35:31.529 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:31 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:31.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:31.529 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:31 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:31.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:31.529 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:31 smithi173 podman[68858]: 2024-09-12 02:35:31.246615676 +0000 UTC m=+0.366867144 container init ac99fd25698ed69c3181da7282ea5ef306541c20d5f162afed1f67af8e82e419 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T02:35:31.530 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:31 smithi173 podman[68858]: 2024-09-12 02:35:31.249945437 +0000 UTC m=+0.370196914 container start ac99fd25698ed69c3181da7282ea5ef306541c20d5f162afed1f67af8e82e419 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-12T02:35:31.530 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:31 smithi173 podman[68858]: 2024-09-12 02:35:31.355153902 +0000 UTC m=+0.475405389 container attach ac99fd25698ed69c3181da7282ea5ef306541c20d5f162afed1f67af8e82e419 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:35:31.530 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 02:35:31 smithi173 podman[68858]: 2024-09-12 02:35:31.440218783 +0000 UTC m=+0.560470252 container died ac99fd25698ed69c3181da7282ea5ef306541c20d5f162afed1f67af8e82e419 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:35:31.862 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:31.447+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:31.863 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:31.447+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:31.863 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:31.447+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:31.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:31 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:31.528+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:31.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:31 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:31.528+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:31.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:31 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:31.528+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:32.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:35:32.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:31.862+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:32.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:31.862+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:32.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:31 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:31.862+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:32.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:32.160 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:35:32.160 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:35:32.161 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:35:32.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:31.738+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:32.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:31.738+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:32.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:31.825+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:32.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:31.825+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:32.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:31 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:31.825+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:32.372 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:32.371+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:32.372 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:32.371+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 systemd[1]: Stopping Ceph osd.6 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.428+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.428+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.428+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.496+0000 7f45034a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.496+0000 7f45034a8640 -1 osd.6 85 *** Got signal Terminated *** 2024-09-12T02:35:32.497 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:32.496+0000 7f45034a8640 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:32.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:32.500+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:32.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:32.500+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:32.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:32 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:32.500+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:33.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:32.857+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:33.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:32.857+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:33.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:32 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:32.857+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:33.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:32.870+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:33.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:32.870+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:33.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:32.870+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:33.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:32.775+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:33.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:32.775+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:33.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:33 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:33.416+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:33.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:33 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:33.416+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:33.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:33 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:33.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:33.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:33 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:33.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:33.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:33 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:33.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:33.839 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:33.425+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:33.840 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:33.425+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:33.840 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:33.425+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:34.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:33.839+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:34.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:33.839+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:34.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:33 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:33.839+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:34.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:33.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:34.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:33.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:34.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:33.864+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:34.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:33.864+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:34.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:33 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:33.864+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:34.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:34 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:34.401+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:34.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:34 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:34.401+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:34.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:34 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:34.502+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:34.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:34 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:34.502+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:34.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:34 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:34.502+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:34.873 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:34.398+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:34.873 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:34.398+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:34.873 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:34.398+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:35.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:34.873+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:35.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:34.873+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:35.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:34 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:34.873+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:35.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:34 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:34.821+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:35.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:34 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:34.821+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:35.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:34 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:34.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:35.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:34 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:34.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:35.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:34 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:34.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:35.867 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:35.440+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:35.867 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:35.440+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:35.867 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:35.440+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:35.867 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:35.440+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:08.655788+0000 front 2024-09-12T02:35:08.655839+0000 (oldest deadline 2024-09-12T02:35:34.556023+0000) 2024-09-12T02:35:35.947 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:35 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:35.447+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:35.947 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:35 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:35.447+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:35.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:35 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:35.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:35.948 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:35 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:35.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:35.948 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:35 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:35.459+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:36.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:35.867+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:36.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:35.867+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:36.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:35 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:35.867+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:36.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:35.951+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:36.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:35.951+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:36.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:35.951+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:36.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:35.865+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:36.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:35.865+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:36.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:35 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:35.865+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:36.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:36.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:36.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:36.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:36.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:36.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:36.825 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:36.490+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:08.655788+0000 front 2024-09-12T02:35:08.655839+0000 (oldest deadline 2024-09-12T02:35:34.556023+0000) 2024-09-12T02:35:36.947 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:36 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:36.450+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:36.947 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:36 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:36.450+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:36.947 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:36 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:36.455+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:36.948 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:36 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:36.455+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:36.948 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:36 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:36.455+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:37.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:36.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:37.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:36.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:37.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:36 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:36.824+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:37.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:36.870+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:37.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:36.870+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:37.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:36.870+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:37.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:36.936+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:37.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:36.936+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:37.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:36.936+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:37.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:36 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:36.936+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:37.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:37.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:37.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:37.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:37.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:37.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:37.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:37.477+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:37.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:37.477+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:37.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:37 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:37.477+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:37.839 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:37.457+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.552303+0000 front 2024-09-12T02:34:46.552344+0000 (oldest deadline 2024-09-12T02:35:10.652500+0000) 2024-09-12T02:35:37.839 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:37.457+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.853824+0000 front 2024-09-12T02:34:55.853949+0000 (oldest deadline 2024-09-12T02:35:18.153983+0000) 2024-09-12T02:35:37.840 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:37.457+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:02.255010+0000 front 2024-09-12T02:35:02.255087+0000 (oldest deadline 2024-09-12T02:35:27.555031+0000) 2024-09-12T02:35:37.840 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6[56652]: 2024-09-12T02:35:37.457+0000 7f44ffabe640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:08.655788+0000 front 2024-09-12T02:35:08.655839+0000 (oldest deadline 2024-09-12T02:35:34.556023+0000) 2024-09-12T02:35:38.098 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:37 smithi001 podman[94202]: 2024-09-12 02:35:37.839646068 +0000 UTC m=+5.468802723 container died c6112d2b4a1d203a82d1050f2a97e8a6056496b607fb6ff2ba661fc376c0f51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:35:38.099 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:37.846+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:38.099 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:37.846+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:38.099 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:37 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:37.846+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:38.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:37.835+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:38.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:37.835+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:38.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:37.835+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:38.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:37.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:38.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:37.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:38.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:37.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:38.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:37 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:37.914+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:38.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:38 smithi001 podman[94202]: 2024-09-12 02:35:38.297018746 +0000 UTC m=+5.926175397 container cleanup c6112d2b4a1d203a82d1050f2a97e8a6056496b607fb6ff2ba661fc376c0f51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:35:38.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:38 smithi001 bash[94202]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:35:38.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:38.378+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:38.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:38.378+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:38.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:38.378+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:38.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:38.474+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:38.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:38.474+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:38.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:38 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:38.474+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:38.860 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:38 smithi001 podman[94218]: 2024-09-12 02:35:38.565257184 +0000 UTC m=+0.719432036 container remove c6112d2b4a1d203a82d1050f2a97e8a6056496b607fb6ff2ba661fc376c0f51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:35:39.115 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:38 smithi001 podman[94309]: 2024-09-12 02:35:38.827470885 +0000 UTC m=+0.016880323 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:39.141 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:38 smithi001 podman[94309]: 2024-09-12 02:35:38.957838089 +0000 UTC m=+0.147247512 container create 9783f434617935768e8a2dfda4da831fd31e918beef98ab2e1433e67ed9222ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:39.141 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:38 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:38.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:39.141 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:38 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:38.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:39.142 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:38 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:38.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:39.142 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:38 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:38.860+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:39.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:38.814+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:39.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:38.814+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:39.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:38.814+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:39.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:38.865+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:39.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:38.865+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:39.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:38.865+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:39.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:38.865+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:39.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:39 smithi001 podman[94309]: 2024-09-12 02:35:39.226939769 +0000 UTC m=+0.416349200 container init 9783f434617935768e8a2dfda4da831fd31e918beef98ab2e1433e67ed9222ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T02:35:39.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:39 smithi001 podman[94309]: 2024-09-12 02:35:39.230347019 +0000 UTC m=+0.419756446 container start 9783f434617935768e8a2dfda4da831fd31e918beef98ab2e1433e67ed9222ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:35:39.376 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:39 smithi001 podman[94309]: 2024-09-12 02:35:39.327015428 +0000 UTC m=+0.516424853 container attach 9783f434617935768e8a2dfda4da831fd31e918beef98ab2e1433e67ed9222ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:35:39.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:39.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:39.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:39.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:39.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:39.423+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:39.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:39.428+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:39.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:39.428+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:39.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:39 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:39.428+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:39.705 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 12 02:35:39 smithi001 podman[94309]: 2024-09-12 02:35:39.428318128 +0000 UTC m=+0.617727551 container died 9783f434617935768e8a2dfda4da831fd31e918beef98ab2e1433e67ed9222ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:35:40.081 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:39 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:39.910+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:40.081 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:39 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:39.910+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:40.081 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:39 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:39.910+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:40.081 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:39 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:39.910+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:40.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:35:40.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:40.161 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:35:40.161 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:35:40.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:35:40.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:39.800+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:40.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:39.800+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:40.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:39.800+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:40.165 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:39.821+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:40.165 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:39.821+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:40.165 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:39.821+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:40.165 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:39 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:39.821+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:40.461 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 systemd[1]: Stopping Ceph osd.7 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:40.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:40.389+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:40.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:40.389+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:40.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:40.389+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:40.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:40.440+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:40.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:40.441+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:40.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:40 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:40.441+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:40.778 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.460+0000 7fde7728d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:40.778 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.460+0000 7fde7728d640 -1 osd.7 85 *** Got signal Terminated *** 2024-09-12T02:35:40.778 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.460+0000 7fde7728d640 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:40.778 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.777+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:40.778 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.777+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:41.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:40.777+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:41.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:40.846+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:41.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:40.846+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:41.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:40.846+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:41.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:40 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:40.846+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:41.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:40 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:40.945+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:41.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:40 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:40.945+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:41.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:40 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:40.945+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:41.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:40 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:40.945+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:41.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:41.359+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:41.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:41.359+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:41.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:41.359+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:41.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:41.396+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:41.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:41.396+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:41.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:41 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:41.396+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:42.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:41.732+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:41.732+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:41.732+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:41.894+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:41.894+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:41.894+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:42.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:41 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:41.894+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:42.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:41 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:41.901+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:42.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:41 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:41.901+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:42.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:41 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:41.901+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:42.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:41 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:41.901+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:42.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:42.407+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:42.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:42.407+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:42.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:42.407+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:42.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:42.330+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:42.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:42.330+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:42.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:42.330+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:42.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:42 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:42.330+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:43.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:42 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:42.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:43.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:42 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:42.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:43.127 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:42 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:42.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:43.127 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:42 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:42.852+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:43.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:42.774+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:43.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:42.774+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:43.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:42.774+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:43.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:42.867+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:43.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:42.867+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:43.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:42.867+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:43.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:42.867+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:43.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:43.401+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:43.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:43.401+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:43.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:43.401+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:43.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:43.319+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:43.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:43.319+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:43.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:43.319+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:43.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:43 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:43.319+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:44.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:43 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:43.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:44.127 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:43 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:43.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:44.127 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:43 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:43.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:44.127 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:43 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:43.848+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:44.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:43.780+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:44.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:43.780+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:44.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:43.780+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:44.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:43.780+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:20.989776+0000 front 2024-09-12T02:35:20.989824+0000 (oldest deadline 2024-09-12T02:35:43.289829+0000) 2024-09-12T02:35:44.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:43.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:44.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:43.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:44.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:43.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:44.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:43 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:43.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:44.598 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:44.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:44.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:44.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:44.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:44.300+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:44.300+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:44.300+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:44.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:44 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:44.300+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:45.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:44.863+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:45.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:44.863+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:45.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:44.863+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:45.126 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:44 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:44.863+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:45.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:44.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.986255+0000 front 2024-09-12T02:34:55.986452+0000 (oldest deadline 2024-09-12T02:35:20.086368+0000) 2024-09-12T02:35:45.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:44.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.087865+0000 front 2024-09-12T02:35:04.087837+0000 (oldest deadline 2024-09-12T02:35:28.187626+0000) 2024-09-12T02:35:45.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:44.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.488613+0000 front 2024-09-12T02:35:10.488646+0000 (oldest deadline 2024-09-12T02:35:35.788435+0000) 2024-09-12T02:35:45.164 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7[52838]: 2024-09-12T02:35:44.781+0000 7fde738a3640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:20.989776+0000 front 2024-09-12T02:35:20.989824+0000 (oldest deadline 2024-09-12T02:35:43.289829+0000) 2024-09-12T02:35:45.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:44.906+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:45.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:44.906+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:45.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:44.906+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:45.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:44 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:44.906+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:45.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:45.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:45.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:45.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:45.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:45.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:45.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:45.361+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:45.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:45.259+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:45.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:45.259+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:45.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:45.259+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:45.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:45 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:45.259+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:46.163 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:45 smithi134 podman[68587]: 2024-09-12 02:35:45.986573766 +0000 UTC m=+5.631133235 container died 7627f385679f809fbc128fc88e5de2856352dcc4bba469a18f670f26f9125bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:35:46.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:45 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:45.886+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:46.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:45 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:45.886+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:46.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:45 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:45.886+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:46.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:45 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:45.886+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:46.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:45 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:45.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:46.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:45 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:45.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:46.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:45 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:45.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:46.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:45 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:45.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:46.662 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:46 smithi134 podman[68587]: 2024-09-12 02:35:46.386595798 +0000 UTC m=+6.031155266 container cleanup 7627f385679f809fbc128fc88e5de2856352dcc4bba469a18f670f26f9125bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:35:46.662 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:46 smithi134 bash[68587]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:35:46.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:46.312+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:46.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:46.312+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:46.312+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:46.312+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:46.266+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:46.266+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:46.266+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:46.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:46 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:46.266+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:46.913 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:46 smithi134 podman[68615]: 2024-09-12 02:35:46.662859165 +0000 UTC m=+0.663770262 container remove 7627f385679f809fbc128fc88e5de2856352dcc4bba469a18f670f26f9125bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:35:47.341 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:46 smithi134 podman[68701]: 2024-09-12 02:35:46.876501249 +0000 UTC m=+0.015707155 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:47.341 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:46 smithi134 podman[68701]: 2024-09-12 02:35:46.997218603 +0000 UTC m=+0.136424513 container create 63dd9203dbf5f1dda75ba53958e17a835417a21b6c587415997637c2a0faf555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:35:47.341 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:47 smithi134 podman[68701]: 2024-09-12 02:35:47.341791477 +0000 UTC m=+0.480997396 container init 63dd9203dbf5f1dda75ba53958e17a835417a21b6c587415997637c2a0faf555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T02:35:47.342 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:46.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:47.342 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:46.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:47.342 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:46.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:47.342 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:46.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:47.342 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:46.916+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:47.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:46 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:46.918+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:47.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:46 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:46.918+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:47.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:46 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:46.918+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:47.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:46 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:46.918+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:47.663 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:47 smithi134 podman[68701]: 2024-09-12 02:35:47.34527017 +0000 UTC m=+0.484476087 container start 63dd9203dbf5f1dda75ba53958e17a835417a21b6c587415997637c2a0faf555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:35:47.663 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:47 smithi134 podman[68701]: 2024-09-12 02:35:47.44188053 +0000 UTC m=+0.581086436 container attach 63dd9203dbf5f1dda75ba53958e17a835417a21b6c587415997637c2a0faf555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:35:47.663 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 12 02:35:47 smithi134 podman[68701]: 2024-09-12 02:35:47.534720637 +0000 UTC m=+0.673926555 container died 63dd9203dbf5f1dda75ba53958e17a835417a21b6c587415997637c2a0faf555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:35:47.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:47.354+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:47.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:47.354+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:47.354+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:47.354+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:47.258+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:47.258+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:47.258+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:47.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:47 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:47.258+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:48.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:47 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:47.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:48.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:47 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:47.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:48.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:47 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:47.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:48.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:47 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:47.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:48.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:47 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:47.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:48.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:35:48.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:48.263 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:35:48.264 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:35:48.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:35:48.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:47 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:47.940+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:48.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:47 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:47.940+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:48.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:47 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:47.940+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:48.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:47 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:47.940+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:48.279+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:48.279+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:48.279+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:48.279+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 systemd[1]: Stopping Ceph osd.8 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.380+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:48.612 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.380+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:48.613 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.380+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:48.613 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.380+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:48.613 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.611+0000 7f213a67f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:48.613 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.611+0000 7f213a67f640 -1 osd.8 85 *** Got signal Terminated *** 2024-09-12T02:35:48.613 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:48 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:48.611+0000 7f213a67f640 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:49.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:48.928+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:49.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:48.928+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:49.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:48.928+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:49.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:48 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:48.928+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:49.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:48 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:48.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:49.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:48 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:48.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:49.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:48 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:48.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:49.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:48 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:48.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:49.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:48 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:48.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:49.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:49.366+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:49.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:49.366+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:49.366+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:49.366+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:49.248+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:49.248+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:49.248+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:49.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:49.248+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:50.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:49.916+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:50.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:49.916+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:50.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:49.916+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:50.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:49 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:49.916+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:50.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:49 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:49.918+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:50.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:49 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:49.918+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:50.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:49 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:49.918+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:50.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:49 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:49.918+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:50.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:49 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:49.918+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:50.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:50.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:50.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:50.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:50.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:50.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:50.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:50.399+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:50.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:50.202+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:50.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:50.202+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:50.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:50.202+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:50.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:50 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:50.202+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:51.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:50 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:50.876+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:51.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:50.904+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:51.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:50.904+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:51.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:50.904+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:51.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:50.904+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:51.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:50 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:50.904+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:51.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:51.404+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:51.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:51.404+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:51.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:51.404+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:51.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:51.404+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:51.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:51.180+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:51.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:51.180+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:51.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:51.180+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:51.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:51 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:51.180+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:52.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:51 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:51.849+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:52.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:51.935+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:52.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:51.935+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:52.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:51.935+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:52.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:51.935+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:52.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:51 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:51.935+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:52.425 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:52.166+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:52.426 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:52.166+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:52.426 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:52.166+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:52.426 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:52.166+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:52.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:52.425+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:52.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:52.425+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:52.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:52.425+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:52.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:52 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:52.425+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:53.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:53.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:53.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:53.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:53.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:53.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:52 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:52.819+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:53.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:52.888+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:53.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:52.888+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:53.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:52.888+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:53.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:52.888+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:53.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:52 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:52.888+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:53.446 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:53.182+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:53.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:53.182+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:53.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:53.182+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:53.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:53.182+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:53.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:53.182+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:53.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:53.446+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:55.586965+0000 front 2024-09-12T02:34:55.587221+0000 (oldest deadline 2024-09-12T02:35:21.487031+0000) 2024-09-12T02:35:53.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:53.446+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.187949+0000 front 2024-09-12T02:35:03.187976+0000 (oldest deadline 2024-09-12T02:35:26.688035+0000) 2024-09-12T02:35:53.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:53.446+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.289408+0000 front 2024-09-12T02:35:11.289531+0000 (oldest deadline 2024-09-12T02:35:36.589348+0000) 2024-09-12T02:35:53.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:53.446+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.191153+0000 front 2024-09-12T02:35:21.191301+0000 (oldest deadline 2024-09-12T02:35:43.491086+0000) 2024-09-12T02:35:53.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:53 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8[53373]: 2024-09-12T02:35:53.446+0000 7f2136c95640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.492453+0000 front 2024-09-12T02:35:27.492470+0000 (oldest deadline 2024-09-12T02:35:52.792602+0000) 2024-09-12T02:35:54.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:54.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:54.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:54.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:54.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:54.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:53 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:53.822+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:54.370 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:54 smithi173 podman[68962]: 2024-09-12 02:35:54.046610007 +0000 UTC m=+5.592019701 container died 6d7f42d6decfed7597c0dbbe4c226abff29d444acefdc350189d3879762881c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:54.173+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:54.173+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:54.173+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:54.173+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:54.371 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:54.173+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:53.896+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:53.896+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:53.896+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:53.896+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:54.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:53 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:53.896+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:54.697 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:54 smithi173 podman[68962]: 2024-09-12 02:35:54.478616569 +0000 UTC m=+6.024026250 container cleanup 6d7f42d6decfed7597c0dbbe4c226abff29d444acefdc350189d3879762881c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:35:54.698 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:54 smithi173 bash[68962]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:35:55.144 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:54 smithi173 podman[68977]: 2024-09-12 02:35:54.721773346 +0000 UTC m=+0.670268733 container remove 6d7f42d6decfed7597c0dbbe4c226abff29d444acefdc350189d3879762881c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:35:55.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:55.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:55.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:55.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:55.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:55.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:54 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:54.826+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:55.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:54 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:54.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:55.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:54 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:54.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:55.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:54 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:54.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:55.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:54 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:54.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:55.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:54 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:54.892+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:55.447 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.047269593 +0000 UTC m=+0.015764979 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.18088636 +0000 UTC m=+0.149381744 container create c62960632e3a565907ba4b4abedbd56045eddef8ce5a6c10a6640152c10d76b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.387394877 +0000 UTC m=+0.355890265 container init c62960632e3a565907ba4b4abedbd56045eddef8ce5a6c10a6640152c10d76b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.393024888 +0000 UTC m=+0.361520269 container start c62960632e3a565907ba4b4abedbd56045eddef8ce5a6c10a6640152c10d76b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:55 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:55.206+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:55 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:55.206+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:55.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:55 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:55.206+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:55.449 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:55 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:55.206+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:55.449 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:55 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:55.206+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:55.878 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.575589589 +0000 UTC m=+0.544084977 container attach c62960632e3a565907ba4b4abedbd56045eddef8ce5a6c10a6640152c10d76b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T02:35:55.878 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 02:35:55 smithi173 podman[69068]: 2024-09-12 02:35:55.583767536 +0000 UTC m=+0.552262912 container died c62960632e3a565907ba4b4abedbd56045eddef8ce5a6c10a6640152c10d76b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:56.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:55 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:55.838+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:56.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:35:56.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:35:56.259 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:35:56.259 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:35:56.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:35:56.288 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:55 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:55.890+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:56.289 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:55 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:55.890+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:56.289 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:55 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:55.890+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:56.289 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:55 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:55.890+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:56.289 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:55 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:55.890+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:56.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:56 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:56.163+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:56.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:56 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:56.163+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:56.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:56 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:56.163+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:56.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:56 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:56.163+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:56.448 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:56 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:56.163+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:56.576 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 systemd[1]: Stopping Ceph osd.9 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:35:56.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.575+0000 7f2e05682640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:35:56.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.575+0000 7f2e05682640 -1 osd.9 85 *** Got signal Terminated *** 2024-09-12T02:35:56.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.575+0000 7f2e05682640 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:57.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:56 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:56.878+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:57.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.936+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:57.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.936+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:57.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.936+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:57.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.936+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:57.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:56 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:56.936+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:57.420 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:57.117+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:57.420 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:57.117+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:57.420 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:57.117+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:57.420 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:57.117+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:57.420 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:57 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:57.117+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:58.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:58.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:58.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:58.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:58.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:58.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:57 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:57.847+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:58.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:57 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:57.964+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:58.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:57 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:57.964+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:58.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:57 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:57.964+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:58.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:57 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:57.964+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:58.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:57 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:57.964+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:58.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:58.139+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:58.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:58.139+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:58.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:58.139+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:58.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:58.139+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:58.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:58.139+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:35:59.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:35:59.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:35:59.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:35:59.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:35:59.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:35:59.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:58 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:58.891+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:35:59.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:58 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:58.985+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:35:59.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:58 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:58.985+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:35:59.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:58 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:58.985+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:35:59.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:58 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:58.985+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:35:59.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:58 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:58.985+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:35:59.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:59 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:59.159+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:35:59.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:59 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:59.159+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:35:59.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:59 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:59.159+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:35:59.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:59 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:59.159+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:35:59.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:35:59 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:35:59.159+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:00.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:59 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:59.990+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:36:00.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:59 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:59.990+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:36:00.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:59 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:59.990+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:36:00.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:59 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:59.990+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:36:00.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:35:59 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:35:59.990+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:00.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:35:59 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:35:59.930+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:00.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:00.197+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:00.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:00.197+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:00.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:00.197+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:00.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:00.197+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:00.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:00 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:00.197+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:01.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:44.664080+0000 front 2024-09-12T02:34:44.664099+0000 (oldest deadline 2024-09-12T02:35:14.064827+0000) 2024-09-12T02:36:01.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.065510+0000 front 2024-09-12T02:34:54.065598+0000 (oldest deadline 2024-09-12T02:35:19.266173+0000) 2024-09-12T02:36:01.376 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:04.368535+0000 front 2024-09-12T02:35:04.368623+0000 (oldest deadline 2024-09-12T02:35:28.468628+0000) 2024-09-12T02:36:01.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:11.969557+0000 front 2024-09-12T02:35:11.969545+0000 (oldest deadline 2024-09-12T02:35:37.869567+0000) 2024-09-12T02:36:01.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:27.171764+0000 front 2024-09-12T02:35:27.171729+0000 (oldest deadline 2024-09-12T02:35:50.671773+0000) 2024-09-12T02:36:01.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9[63189]: 2024-09-12T02:36:01.037+0000 7f2dfdc90640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:37.474352+0000 front 2024-09-12T02:35:37.474303+0000 (oldest deadline 2024-09-12T02:36:00.974334+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:01.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:00 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:00.947+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:01.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:01 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:01.216+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:02.176 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:01 smithi001 podman[94424]: 2024-09-12 02:36:01.911777296 +0000 UTC m=+5.440148052 container died 7a4e6fac8870e357fb3a67d9864f2e92c68b25a885f09bca70954730d3540b92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:02.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:02.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:01 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:01.941+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:02.536 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:02 smithi001 podman[94424]: 2024-09-12 02:36:02.350575065 +0000 UTC m=+5.878945824 container cleanup 7a4e6fac8870e357fb3a67d9864f2e92c68b25a885f09bca70954730d3540b92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True) 2024-09-12T02:36:02.536 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:02 smithi001 bash[94424]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:36:02.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:02.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:02.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:02.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:02.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:02.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:02.263+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:02.876 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:02 smithi001 podman[94439]: 2024-09-12 02:36:02.535215019 +0000 UTC m=+0.615672334 container remove 7a4e6fac8870e357fb3a67d9864f2e92c68b25a885f09bca70954730d3540b92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:36:03.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:03.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:03.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:03.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:03.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:03.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:03.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:02 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:02.908+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:03.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:02 smithi001 podman[94528]: 2024-09-12 02:36:02.856886312 +0000 UTC m=+0.016649368 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:03.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:02 smithi001 podman[94528]: 2024-09-12 02:36:02.969330656 +0000 UTC m=+0.129093701 container create 845a80d890da6cb27c617e75cb8c0bf2f1c649e1429df0e035f5f1503567ee20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T02:36:03.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:03 smithi001 podman[94528]: 2024-09-12 02:36:03.196998521 +0000 UTC m=+0.356761567 container init 845a80d890da6cb27c617e75cb8c0bf2f1c649e1429df0e035f5f1503567ee20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:03.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:03 smithi001 podman[94528]: 2024-09-12 02:36:03.200451215 +0000 UTC m=+0.360214262 container start 845a80d890da6cb27c617e75cb8c0bf2f1c649e1429df0e035f5f1503567ee20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:36:03.280 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:03 smithi001 podman[94528]: 2024-09-12 02:36:03.280094503 +0000 UTC m=+0.439857550 container attach 845a80d890da6cb27c617e75cb8c0bf2f1c649e1429df0e035f5f1503567ee20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:36:03.626 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 12 02:36:03 smithi001 podman[94528]: 2024-09-12 02:36:03.396150816 +0000 UTC m=+0.555913868 container died 845a80d890da6cb27c617e75cb8c0bf2f1c649e1429df0e035f5f1503567ee20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:36:03.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:03.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:03.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:03.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:03.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:03.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:03 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:03.284+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:04.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:36:04.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:04.157 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:36:04.158 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:36:04.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:36:04.184 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:04.185 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:03 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:03.923+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:04.464 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 systemd[1]: Stopping Ceph osd.10 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:04.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:04 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:04.329+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:04.913 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.463+0000 7f643057b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:04.913 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.463+0000 7f643057b640 -1 osd.10 85 *** Got signal Terminated *** 2024-09-12T02:36:04.914 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.463+0000 7f643057b640 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:36:05.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:05.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:05.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:05.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:05.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:05.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:05.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:04 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:04.952+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:05.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:05.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:05.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:05.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:05.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:05.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:05 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:05.308+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:06.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:06.414 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:05 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:05.935+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:06.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:06.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:06.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:06.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:06.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:06.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:06 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:06.334+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:07.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:07.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:06 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:06.893+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:07.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:07.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:07.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:07.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:07.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:07.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:07.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:07 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:07.348+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:08.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:08.164 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:07 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:07.844+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:08.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:08.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:08.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:08.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:08.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:08.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:08.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:08 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:08.313+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.889469+0000 front 2024-09-12T02:34:46.889376+0000 (oldest deadline 2024-09-12T02:35:10.989328+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:56.992560+0000 front 2024-09-12T02:34:56.992524+0000 (oldest deadline 2024-09-12T02:35:21.092631+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:03.393568+0000 front 2024-09-12T02:35:03.393691+0000 (oldest deadline 2024-09-12T02:35:26.893564+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-12T02:35:10.895037+0000 front 2024-09-12T02:35:10.895050+0000 (oldest deadline 2024-09-12T02:35:36.195056+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.396440+0000 front 2024-09-12T02:35:21.396456+0000 (oldest deadline 2024-09-12T02:35:46.096535+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.997972+0000 front 2024-09-12T02:35:28.997777+0000 (oldest deadline 2024-09-12T02:35:50.097656+0000) 2024-09-12T02:36:09.163 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:08 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10[59795]: 2024-09-12T02:36:08.881+0000 7f6428b89640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:33.598733+0000 front 2024-09-12T02:35:33.598802+0000 (oldest deadline 2024-09-12T02:35:59.498538+0000) 2024-09-12T02:36:09.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:09.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:09.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:09.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:09.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:09.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:09.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:09 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:09.332+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:10.114 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:09 smithi134 podman[68803]: 2024-09-12 02:36:09.838242981 +0000 UTC m=+5.483921460 container died 399286c9b51b1b8c9a0338c4328721b9dad99d6f6578969321b2863dcc5a4dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T02:36:10.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:10 smithi134 podman[68803]: 2024-09-12 02:36:10.188717661 +0000 UTC m=+5.834396142 container cleanup 399286c9b51b1b8c9a0338c4328721b9dad99d6f6578969321b2863dcc5a4dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:36:10.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:10 smithi134 bash[68803]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:36:10.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:10.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:10.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:10.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:10.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:10.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:10.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:10 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:10.301+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:10.809 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:10 smithi134 podman[68819]: 2024-09-12 02:36:10.464933018 +0000 UTC m=+0.624501907 container remove 399286c9b51b1b8c9a0338c4328721b9dad99d6f6578969321b2863dcc5a4dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:36:11.126 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:10 smithi134 podman[68908]: 2024-09-12 02:36:10.712599001 +0000 UTC m=+0.015609140 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:11.126 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:10 smithi134 podman[68908]: 2024-09-12 02:36:10.815574819 +0000 UTC m=+0.118585013 container create e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:11.126 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 podman[68908]: 2024-09-12 02:36:11.043069768 +0000 UTC m=+0.346079905 container init e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T02:36:11.126 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 podman[68908]: 2024-09-12 02:36:11.046557026 +0000 UTC m=+0.349567158 container start e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:11.126 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 podman[68908]: 2024-09-12 02:36:11.126262582 +0000 UTC m=+0.429272720 container attach e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:36:11.413 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 podman[68908]: 2024-09-12 02:36:11.235906123 +0000 UTC m=+0.538916254 container died e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:36:11.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:11.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:11.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:11.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:11.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:11.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:11.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:11.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:11.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:36:11.883 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 podman[68931]: 2024-09-12 02:36:11.796538808 +0000 UTC m=+0.554918843 container remove e2cf65b0d6aec57e141222238f4e604c40261d1bd03e7041b1978242b1af68b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:11.883 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-12T02:36:11.883 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 systemd[1]: Stopped Ceph osd.10 for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:36:11.884 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 12 02:36:11 smithi134 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.10.service: Consumed 7.414s CPU time. 2024-09-12T02:36:11.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:11.899 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:36:11.899 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:36:11.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:36:12.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:11 smithi173 systemd[1]: Stopping Ceph osd.11 for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:12.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.205+0000 7f90345a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:12.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.205+0000 7f90345a9640 -1 osd.11 85 *** Got signal Terminated *** 2024-09-12T02:36:12.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.205+0000 7f90345a9640 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:12.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:12 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:12.296+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:13.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:13.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:13.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:13.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:13.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:13.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:13.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:13 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:13.287+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:14.599 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:14 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:14.303+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-12T02:35:51.815830+0000 front 2024-09-12T02:35:51.815810+0000 (oldest deadline 2024-09-12T02:36:14.115889+0000) 2024-09-12T02:36:15.614 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:15.615 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:15.615 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:15.615 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:15.615 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:15.615 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:15.616 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:15.616 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:15 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:15.337+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-12T02:35:51.815830+0000 front 2024-09-12T02:35:51.815810+0000 (oldest deadline 2024-09-12T02:36:14.115889+0000) 2024-09-12T02:36:16.697 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-12T02:34:46.605513+0000 front 2024-09-12T02:34:46.605634+0000 (oldest deadline 2024-09-12T02:35:12.505611+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-12T02:34:54.806568+0000 front 2024-09-12T02:34:54.806588+0000 (oldest deadline 2024-09-12T02:35:20.106771+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T02:35:05.208819+0000 front 2024-09-12T02:35:05.208927+0000 (oldest deadline 2024-09-12T02:35:30.508956+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-12T02:35:21.511950+0000 front 2024-09-12T02:35:21.512019+0000 (oldest deadline 2024-09-12T02:35:42.011839+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T02:35:28.413286+0000 front 2024-09-12T02:35:28.413311+0000 (oldest deadline 2024-09-12T02:35:53.113427+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-12T02:35:34.814486+0000 front 2024-09-12T02:35:34.814593+0000 (oldest deadline 2024-09-12T02:36:01.214666+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-12T02:35:41.215248+0000 front 2024-09-12T02:35:41.215310+0000 (oldest deadline 2024-09-12T02:36:06.515081+0000) 2024-09-12T02:36:16.698 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:16 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11[60205]: 2024-09-12T02:36:16.315+0000 7f9030bbf640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-12T02:35:51.815830+0000 front 2024-09-12T02:35:51.815810+0000 (oldest deadline 2024-09-12T02:36:14.115889+0000) 2024-09-12T02:36:17.832 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:17 smithi173 podman[69182]: 2024-09-12 02:36:17.5602271 +0000 UTC m=+5.455741949 container died a324ef0e28d438293ff3c465dda80e9cebf9eb05e40891e3b0760befeff7bec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T02:36:18.174 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:17 smithi173 podman[69182]: 2024-09-12 02:36:17.923481496 +0000 UTC m=+5.818996339 container cleanup a324ef0e28d438293ff3c465dda80e9cebf9eb05e40891e3b0760befeff7bec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:36:18.174 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:17 smithi173 bash[69182]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:36:18.447 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69211]: 2024-09-12 02:36:18.174564208 +0000 UTC m=+0.614110532 container remove a324ef0e28d438293ff3c465dda80e9cebf9eb05e40891e3b0760befeff7bec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:18.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.395264506 +0000 UTC m=+0.015476253 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:36:18.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.533911073 +0000 UTC m=+0.154122810 container create 6ac2daef573a3ba4799af61161ce05ad0993783a83eb6bc30e210ec719b9341a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:36:18.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.744755756 +0000 UTC m=+0.364967493 container init 6ac2daef573a3ba4799af61161ce05ad0993783a83eb6bc30e210ec719b9341a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:36:19.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.74815376 +0000 UTC m=+0.368365507 container start 6ac2daef573a3ba4799af61161ce05ad0993783a83eb6bc30e210ec719b9341a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:36:19.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.828066823 +0000 UTC m=+0.448278571 container attach 6ac2daef573a3ba4799af61161ce05ad0993783a83eb6bc30e210ec719b9341a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:36:19.197 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 02:36:18 smithi173 podman[69299]: 2024-09-12 02:36:18.936469826 +0000 UTC m=+0.556681574 container died 6ac2daef573a3ba4799af61161ce05ad0993783a83eb6bc30e210ec719b9341a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T02:36:19.505 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:36:19.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:19.547 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:36:19.547 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:36:19.547 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:36:19.869 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:19 smithi001 systemd[1]: Stopping Ceph mds.a for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:20.126 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: 2024-09-12T02:36:19.868+0000 7f5dc95d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:20.126 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:19 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a[70060]: 2024-09-12T02:36:19.868+0000 7f5dc95d4640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:36:21.203 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:20 smithi001 podman[94630]: 2024-09-12 02:36:20.905602821 +0000 UTC m=+1.149510534 container died 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True) 2024-09-12T02:36:21.762 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:21 smithi001 podman[94630]: 2024-09-12 02:36:21.469453196 +0000 UTC m=+1.713360909 container cleanup 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:36:21.762 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:21 smithi001 bash[94630]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:36:22.043 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 12 02:36:21 smithi001 podman[94652]: 2024-09-12 02:36:21.762534176 +0000 UTC m=+0.851389402 container remove 440478e73963f777b500188422a2e16e1b26d84e338a030a204e21bde587485f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:36:22.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:36:22.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:22.106 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:36:22.106 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:36:22.106 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:36:22.376 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:22 smithi001 systemd[1]: Stopping Ceph mds.d for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:22.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d[68871]: 2024-09-12T02:36:22.440+0000 7f57f0b7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:22.876 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:22 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d[68871]: 2024-09-12T02:36:22.440+0000 7f57f0b7b640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:36:23.957 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:23 smithi001 podman[94763]: 2024-09-12 02:36:23.702643256 +0000 UTC m=+1.374896724 container died dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:24.233 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:24 smithi001 podman[94763]: 2024-09-12 02:36:24.031966937 +0000 UTC m=+1.704220396 container cleanup dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:36:24.233 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:24 smithi001 bash[94763]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:36:24.464 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:36:24.486 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:24 smithi001 podman[94776]: 2024-09-12 02:36:24.232970443 +0000 UTC m=+0.528238656 container remove dd78231229e3140c03b4f87d763c8ce516502e813d0544009dee69de70ba3cdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:36:24.486 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:24 smithi001 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-12T02:36:24.487 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 12 02:36:24 smithi001 systemd[1]: Stopped Ceph mds.d for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:36:24.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:24.499 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:36:24.499 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:36:24.499 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:36:24.819 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:24 smithi001 systemd[1]: Stopping Ceph mds.g for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:25.126 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: 2024-09-12T02:36:24.818+0000 7f8256270640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:25.126 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:24 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g[69678]: 2024-09-12T02:36:24.818+0000 7f8256270640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:36:29.111 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:28 smithi001 podman[94886]: 2024-09-12 02:36:28.830826622 +0000 UTC m=+4.110759415 container died e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T02:36:29.376 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:29 smithi001 podman[94886]: 2024-09-12 02:36:29.210575725 +0000 UTC m=+4.490508507 container cleanup e40d104572951fc8eb7a80b3a799128e54180c5cf5be95ebc979a8d81e9fdd68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:29.377 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 12 02:36:29 smithi001 bash[94886]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:36:29.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:36:29.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:29.650 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:36:29.650 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:36:29.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:36:30.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:29 smithi001 systemd[1]: Stopping Ceph mds.j for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:30.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j[68448]: 2024-09-12T02:36:29.980+0000 7f40ea9b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:30.126 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:29 smithi001 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j[68448]: 2024-09-12T02:36:29.980+0000 7f40ea9b4640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:36:32.297 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:31 smithi001 podman[95008]: 2024-09-12 02:36:31.898860946 +0000 UTC m=+2.022063253 container died ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:36:32.297 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:32 smithi001 podman[95008]: 2024-09-12 02:36:32.297838163 +0000 UTC m=+2.421040501 container cleanup ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:36:32.617 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:32 smithi001 bash[95008]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:36:32.617 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 12 02:36:32 smithi001 podman[95020]: 2024-09-12 02:36:32.507282494 +0000 UTC m=+0.604349169 container remove ec22af53d3dbd6e1ff507c76e6dfccd56eacce43795b1b7d84027a341d0e16be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:36:32.638 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:36:32.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:32.671 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:36:32.671 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:36:32.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:36:32.990 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:32 smithi134 systemd[1]: Stopping Ceph mds.b for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:33.413 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: 2024-09-12T02:36:32.989+0000 7f61219e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:33.413 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:32 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b[65002]: 2024-09-12T02:36:32.989+0000 7f61219e6640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:36:37.163 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:36 smithi134 podman[69022]: 2024-09-12 02:36:36.91056517 +0000 UTC m=+4.033392766 container died d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:36:37.448 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 podman[69022]: 2024-09-12 02:36:37.247141459 +0000 UTC m=+4.369969055 container cleanup d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:36:37.448 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 bash[69022]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:36:37.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:36:37.699 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 podman[69034]: 2024-09-12 02:36:37.448466135 +0000 UTC m=+0.533168265 container remove d3cd4fb4624af5031391d3a592549b873e735500336c18d8bded197ad09f4734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:36:37.699 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-12T02:36:37.699 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 systemd[1]: Stopped Ceph mds.b for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:36:37.699 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 12 02:36:37 smithi134 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.b.service: Consumed 2.207s CPU time. 2024-09-12T02:36:37.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:37.711 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:36:37.711 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:36:37.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:36:38.026 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:37 smithi134 systemd[1]: Stopping Ceph mds.e for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:38.413 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: 2024-09-12T02:36:38.025+0000 7f935a485640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:38.413 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:38 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e[64387]: 2024-09-12T02:36:38.025+0000 7f935a485640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:36:41.185 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:40 smithi134 podman[69144]: 2024-09-12 02:36:40.91635977 +0000 UTC m=+2.986844959 container died 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:36:41.510 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:41 smithi134 podman[69144]: 2024-09-12 02:36:41.267910145 +0000 UTC m=+3.338395335 container cleanup 6c44906707b2dc48c7f8a3472c18682e0f766dbf156ee11a490b091bb29b8dfb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:36:41.510 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 12 02:36:41 smithi134 bash[69144]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:36:41.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:36:41.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:41.676 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:36:41.676 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:36:41.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:36:41.913 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:41 smithi134 systemd[1]: Stopping Ceph mds.h for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:42.413 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: 2024-09-12T02:36:42.013+0000 7f3403d62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:42.413 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:42 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h[64689]: 2024-09-12T02:36:42.013+0000 7f3403d62640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:36:45.163 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:44 smithi134 podman[69263]: 2024-09-12 02:36:44.904843018 +0000 UTC m=+3.014858609 container died 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:36:45.539 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:45 smithi134 podman[69263]: 2024-09-12 02:36:45.280262724 +0000 UTC m=+3.390278304 container cleanup 63ebdf50224aef32e98520c4bc8143fcd8e353409fef32b0109c3f3e03e28793 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:36:45.539 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 12 02:36:45 smithi134 bash[69263]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:36:45.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:36:45.738 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:45.738 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:36:45.739 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:36:45.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:36:46.163 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:45 smithi134 systemd[1]: Stopping Ceph mds.k for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:46.163 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: 2024-09-12T02:36:46.047+0000 7f1d53c07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:46.163 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:46 smithi134 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k[64072]: 2024-09-12T02:36:46.047+0000 7f1d53c07640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:36:49.184 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:48 smithi134 podman[69397]: 2024-09-12 02:36:48.915302946 +0000 UTC m=+2.964189222 container died 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:36:49.587 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:49 smithi134 podman[69397]: 2024-09-12 02:36:49.258681816 +0000 UTC m=+3.307568050 container cleanup 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:36:49.587 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:49 smithi134 bash[69397]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:36:49.587 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 12 02:36:49 smithi134 podman[69409]: 2024-09-12 02:36:49.392950729 +0000 UTC m=+0.470308589 container remove 978f48ce8b01df89e86ee9aca3409601fb80b43ccd223c3e4c17e780da89112f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:36:49.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:36:49.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:49.636 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:36:49.636 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:36:49.637 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:36:49.932 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:49 smithi173 systemd[1]: Stopping Ceph mds.c for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:50.193 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: 2024-09-12T02:36:49.930+0000 7f394d36c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:50.193 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:49 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c[65033]: 2024-09-12T02:36:49.930+0000 7f394d36c640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:36:53.197 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:52 smithi173 podman[69400]: 2024-09-12 02:36:52.919643118 +0000 UTC m=+3.090500000 container died acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:36:53.557 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:53 smithi173 podman[69400]: 2024-09-12 02:36:53.289777772 +0000 UTC m=+3.460634648 container cleanup acf29e34348b9ddc73a7c8dbc117ccbebe35d475db8ba38cc427aa63a5837c80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:36:53.557 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 02:36:53 smithi173 bash[69400]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:36:53.692 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:36:53.728 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:53.728 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:36:53.728 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:36:53.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:36:53.947 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:53 smithi173 systemd[1]: Stopping Ceph mds.f for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:54.447 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: 2024-09-12T02:36:54.042+0000 7fefcbc5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:54.447 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:54 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f[64735]: 2024-09-12T02:36:54.042+0000 7fefcbc5f640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:36:57.197 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:56 smithi173 podman[69533]: 2024-09-12 02:36:56.923684386 +0000 UTC m=+2.980867402 container died ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:36:57.697 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:57 smithi173 podman[69533]: 2024-09-12 02:36:57.235859952 +0000 UTC m=+3.293042960 container cleanup ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:36:57.697 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:57 smithi173 bash[69533]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:36:57.697 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 02:36:57 smithi173 podman[69545]: 2024-09-12 02:36:57.462049777 +0000 UTC m=+0.537035779 container remove ee50058b83db728fc42e391d60f64adaf33e8e25472ebb64ee995060e360f57c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:36:57.719 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:36:57.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:36:57.752 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:36:57.752 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:36:57.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:36:58.064 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:36:57 smithi173 systemd[1]: Stopping Ceph mds.i for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:36:58.447 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:36:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: 2024-09-12T02:36:58.063+0000 7f3abd9e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:36:58.447 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:36:58 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i[65337]: 2024-09-12T02:36:58.063+0000 7f3abd9e8640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:37:01.197 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:37:00 smithi173 podman[69655]: 2024-09-12 02:37:00.921045172 +0000 UTC m=+2.955190223 container died e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:37:01.607 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:37:01 smithi173 podman[69655]: 2024-09-12 02:37:01.364597957 +0000 UTC m=+3.398743007 container cleanup e9c3f60710fc822318f7b262c6f7760164aa928ec3a1cd719b094668ccf268ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:37:01.607 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 02:37:01 smithi173 bash[69655]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:37:01.746 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:37:01.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:37:01.778 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:37:01.778 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:37:01.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:37:01.947 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:01 smithi173 systemd[1]: Stopping Ceph mds.l for 877143dc-70ad-11ef-bcea-c7b262605968... 2024-09-12T02:37:02.447 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: 2024-09-12T02:37:02.093+0000 7fabc1f28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:37:02.448 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:02 smithi173 ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l[64434]: 2024-09-12T02:37:02.093+0000 7fabc1f28640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:37:05.177 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:04 smithi173 podman[69776]: 2024-09-12 02:37:04.919154066 +0000 UTC m=+2.927146117 container died f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:37:05.444 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 podman[69776]: 2024-09-12 02:37:05.260376096 +0000 UTC m=+3.268368137 container cleanup f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:37:05.444 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 bash[69776]: ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:37:05.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:37:05.696 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 podman[69788]: 2024-09-12 02:37:05.444567534 +0000 UTC m=+0.519555357 container remove f8e25145860862116a02b7b8f353b922aa915a93856e651ed55ead316f40d5c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-877143dc-70ad-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:37:05.696 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-12T02:37:05.696 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 systemd[1]: Stopped Ceph mds.l for 877143dc-70ad-11ef-bcea-c7b262605968. 2024-09-12T02:37:05.697 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 02:37:05 smithi173 systemd[1]: ceph-877143dc-70ad-11ef-bcea-c7b262605968@mds.l.service: Consumed 1.451s CPU time. 2024-09-12T02:37:05.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:37:05.707 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:37:05.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:37:05.920 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:08.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:37:08.851 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:11.236 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:37:11.436 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:13.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:37:13.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:37:13.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:37:13.909 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:37:13.912 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi001/crash 2024-09-12T02:37:13.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:37:13.957 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:37:13.957 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:37:13.959 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi134/crash 2024-09-12T02:37:13.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:37:14.070 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:37:14.070 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:37:14.071 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi173/crash 2024-09-12T02:37:14.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:37:14.114 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/877143dc-70ad-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:37:14.114 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:37:14.115 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:37:14.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T02:37:14.158 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:37:14.159 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:37:14.202 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:37:14.204 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:: No such file or directory 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:37:14.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:37:14.228 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:37:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:37:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-09-12T02:37:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:37:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:37:14.229 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:: No such file or directory 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:37:14.237 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.6% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr: 82.6% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:37:14.238 INFO:teuthology.orchestra.run.smithi173.stderr: 90.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:37:14.239 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log: 86.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:37:14.239 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:37:14.239 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:37:14.241 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:37:14.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.b.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.k.log: /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:37:14.241 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:37:14.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log: 91.0% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:37:14.243 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:37:14.245 INFO:teuthology.orchestra.run.smithi134.stderr: 90.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:37:14.246 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:37:14.246 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:37:14.248 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log: 86.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:37:14.248 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:37:14.248 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:37:14.248 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:37:14.249 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.x.log: 94.7% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:37:14.251 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:37:14.252 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:37:14.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:37:14.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:37:14.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:37:14.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:37:14.257 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:37:14.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log: 86.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:37:14.259 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:37:14.260 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:37:14.263 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:37:14.263 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:37:14.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.h.log: 94.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:37:14.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:37:14.267 INFO:teuthology.orchestra.run.smithi001.stderr: 94.0% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:37:14.269 INFO:teuthology.orchestra.run.smithi001.stderr: 94.0% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:37:14.272 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:37:14.273 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% 94.0% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:37:14.278 INFO:teuthology.orchestra.run.smithi173.stderr: 92.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:37:14.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:37:14.283 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:37:14.284 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:37:14.291 INFO:teuthology.orchestra.run.smithi173.stderr: 92.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:37:14.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:37:14.301 INFO:teuthology.orchestra.run.smithi134.stderr: 92.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:37:14.310 INFO:teuthology.orchestra.run.smithi173.stderr: 92.0% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:37:14.353 INFO:teuthology.orchestra.run.smithi134.stderr: 93.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:37:14.429 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:37:14.457 INFO:teuthology.orchestra.run.smithi001.stderr: 90.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:37:14.477 INFO:teuthology.orchestra.run.smithi134.stderr: 91.8% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:37:14.514 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:37:14.643 INFO:teuthology.orchestra.run.smithi173.stderr: 93.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:37:14.699 INFO:teuthology.orchestra.run.smithi173.stderr: 92.6% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:37:14.701 INFO:teuthology.orchestra.run.smithi001.stderr: 92.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:37:14.808 INFO:teuthology.orchestra.run.smithi173.stderr: 92.7% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:37:14.836 INFO:teuthology.orchestra.run.smithi134.stderr: 92.5% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:37:14.959 INFO:teuthology.orchestra.run.smithi001.stderr: 90.5% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi001.stderr: 93.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi173.stderr: 93.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m0.965s 2024-09-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m2.696s 2024-09-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.118s 2024-09-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi001.stderr: 93.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:37:15.198 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:37:15.327 INFO:teuthology.orchestra.run.smithi134.stderr: 93.2% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:37:15.332 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:37:15.334 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-12T02:37:15.334 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m1.118s 2024-09-12T02:37:15.335 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m4.286s 2024-09-12T02:37:15.335 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.169s 2024-09-12T02:37:15.365 INFO:teuthology.orchestra.run.smithi001.stderr: 93.3% -- replaced with /var/log/ceph/877143dc-70ad-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-12T02:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m1.150s 2024-09-12T02:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m4.363s 2024-09-12T02:37:15.367 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.155s 2024-09-12T02:37:15.368 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:37:15.368 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi001/log 2024-09-12T02:37:15.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:37:16.034 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi134/log 2024-09-12T02:37:16.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:37:16.640 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi173/log 2024-09-12T02:37:16.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:37:17.069 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:37:17.070 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force 2024-09-12T02:37:17.284 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:17.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force 2024-09-12T02:37:17.756 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:18.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 877143dc-70ad-11ef-bcea-c7b262605968 --force 2024-09-12T02:37:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 877143dc-70ad-11ef-bcea-c7b262605968 2024-09-12T02:37:18.613 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:37:18.614 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:37:18.633 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:37:18.650 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:37:18.665 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:37:18.665 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:37:18.679 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:37:18.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:37:18.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:37:18.692 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:37:18.808 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:37:18.820 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:37:18.820 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:37:18.823 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:37:18.825 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:37:18.837 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:37:18.838 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:37:18.839 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:37:18.842 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:37:18.843 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-12T02:37:18.843 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -3261us[-3265us] +/- 65ms 2024-09-12T02:37:18.843 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 +1270us[+1270us] +/- 76ms 2024-09-12T02:37:18.843 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +3152us[+3152us] +/- 75ms 2024-09-12T02:37:18.843 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:37:18.844 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:37:18.844 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -3485us[-3433us] +/- 65ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +1061us[+1113us] +/- 76ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +2924us[+2924us] +/- 75ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -3459us[-3470us] +/- 65ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +1068us[+1057us] +/- 76ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +2955us[+2955us] +/- 75ms 2024-09-12T02:37:18.845 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:37:18.845 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:37:18.921 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:37:18.921 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:37:19.066 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:37:19.152 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:37:19.220 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:37:19.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:37:19.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:19.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:37:19.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:19.346 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:37:19.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:19.373 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:37:19.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:37:19.524 INFO:teuthology.task.internal:Duration was 1382.031510 seconds 2024-09-12T02:37:19.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:37:19.569 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:37:19.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:37:19.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:37:19.575 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:37:19.612 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:37:19.615 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:37:19.616 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:37:19.985 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:37:19.985 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-12T02:37:19.985 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:37:20.010 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-12T02:37:20.010 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:37:20.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-12T02:37:20.039 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:37:20.076 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:37:20.076 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:37:20.079 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:37:20.081 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:37:20.142 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:37:20.143 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:37:20.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:37:20.153 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:37:20.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:37:20.974 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:37:20.974 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:37:21.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:37:21.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:37:21.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:37:21.188 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.212 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-12T02:37:21.216 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-12T02:37:21.217 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-12T02:37:21.287 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:21.302 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:21.343 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:37:21.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:37:21.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:37:21.369 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:37:21.370 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi001 2024-09-12T02:37:21.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:37:21.423 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi134 2024-09-12T02:37:21.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:37:21.460 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901612/remote/smithi173 2024-09-12T02:37:21.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:37:21.496 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:37:21.496 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:37:21.499 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:37:21.501 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:37:21.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:37:21.560 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:37:21.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:37:21.608 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:37:21.608 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:37:21.611 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:37:21.613 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:37:21.624 INFO:teuthology.orchestra.run.smithi001.stdout: 262173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:37 /home/ubuntu/cephtest 2024-09-12T02:37:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:37 /home/ubuntu/cephtest 2024-09-12T02:37:21.628 INFO:teuthology.orchestra.run.smithi173.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:37 /home/ubuntu/cephtest 2024-09-12T02:37:21.629 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:37:21.709 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:37:21.844 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 1382.0315101146698 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:37:21.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:37:21.929 INFO:teuthology.run:pass